Jul 29 13:28:54 user nova-compute[231753]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code.
Jul 29 13:28:57 user nova-compute[231753]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_linux_bridge.linux_bridge.LinuxBridgePlugin'>' with name 'linux_bridge' {{(pid=231753) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_noop.noop.NoOpPlugin'>' with name 'noop' {{(pid=231753) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG os_vif [-] Loaded VIF plugin class '<class 'vif_plug_ovs.ovs.OvsPlugin'>' with name 'ovs' {{(pid=231753) initialize /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:44}}
Jul 29 13:28:57 user nova-compute[231753]: INFO os_vif [-] Loaded VIF plugins: linux_bridge, noop, ovs
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.019s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:28:57 user nova-compute[231753]: INFO nova.virt.driver [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] Loading compute driver 'libvirt.LibvirtDriver'
Jul 29 13:28:57 user nova-compute[231753]: INFO nova.compute.provider_config [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access.
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] Acquiring lock "singleton_lock" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] Acquired lock "singleton_lock" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] Releasing lock "singleton_lock" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] Full set of CONF: {{(pid=231753) _wait_for_exit_or_signal /usr/local/lib/python3.10/dist-packages/oslo_service/service.py:362}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] ******************************************************************************** {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2589}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] Configuration options gathered from: {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2590}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] command line args: ['--config-file', '/etc/nova/nova-cpu.conf'] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2591}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] config files: ['/etc/nova/nova-cpu.conf'] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2592}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] ================================================================================ {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2594}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] allow_resize_to_same_host      = True {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] arq_binding_timeout            = 300 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] backdoor_port                  = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] backdoor_socket                = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] block_device_allocate_retries  = 300 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] block_device_allocate_retries_interval = 5 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cert                           = self.pem {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] compute_driver                 = libvirt.LibvirtDriver {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] compute_monitors               = [] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] config_dir                     = [] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] config_drive_format            = iso9660 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] config_file                    = ['/etc/nova/nova-cpu.conf'] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] config_source                  = [] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] console_host                   = user {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] control_exchange               = nova {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cpu_allocation_ratio           = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] daemon                         = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] debug                          = True {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] default_access_ip_network_name = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] default_availability_zone      = nova {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] default_ephemeral_format       = ext4 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] default_schedule_zone          = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] disk_allocation_ratio          = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] enable_new_services            = True {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] enabled_apis                   = ['osapi_compute'] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] enabled_ssl_apis               = [] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] flat_injected                  = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] force_config_drive             = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] force_raw_images               = True {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] graceful_shutdown_timeout      = 5 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] heal_instance_info_cache_interval = 60 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] host                           = user {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] initial_cpu_allocation_ratio   = 4.0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] initial_disk_allocation_ratio  = 1.0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] initial_ram_allocation_ratio   = 1.0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] injected_network_template      = /opt/stack/nova/nova/virt/interfaces.template {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] instance_build_timeout         = 0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] instance_delete_interval       = 300 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] instance_format                = [instance: %(uuid)s]  {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] instance_name_template         = instance-%08x {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] instance_usage_audit           = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] instance_usage_audit_period    = month {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] instances_path                 = /opt/stack/data/nova/instances {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] internal_service_availability_zone = internal {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] key                            = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] live_migration_retry_count     = 30 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] log_config_append              = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] log_dir                        = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] log_file                       = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] log_options                    = True {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] log_rotate_interval            = 1 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] log_rotate_interval_type       = days {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] log_rotation_type              = none {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] long_rpc_timeout               = 1800 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] max_concurrent_builds          = 10 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] max_concurrent_live_migrations = 1 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] max_concurrent_snapshots       = 5 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] max_local_block_devices        = 3 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] max_logfile_count              = 30 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] max_logfile_size_mb            = 200 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] maximum_instance_delete_attempts = 5 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] metadata_listen                = 0.0.0.0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] metadata_listen_port           = 8775 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] metadata_workers               = 3 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] migrate_max_retries            = -1 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] mkisofs_cmd                    = genisoimage {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] my_block_storage_ip            = 10.0.0.210 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] my_ip                          = 10.0.0.210 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] network_allocate_retries       = 0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] osapi_compute_listen           = 0.0.0.0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] osapi_compute_listen_port      = 8774 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] osapi_compute_unique_server_name_scope =  {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] osapi_compute_workers          = 3 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] password_length                = 12 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] periodic_enable                = True {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] periodic_fuzzy_delay           = 60 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] pointer_model                  = ps2mouse {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] preallocate_images             = none {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] publish_errors                 = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] pybasedir                      = /opt/stack/nova {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] ram_allocation_ratio           = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] rate_limit_burst               = 0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] rate_limit_except_level        = CRITICAL {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] rate_limit_interval            = 0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] reboot_timeout                 = 0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] reclaim_instance_interval      = 0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] record                         = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] reimage_timeout_per_gb         = 60 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] report_interval                = 10 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] rescue_timeout                 = 0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] reserved_host_cpus             = 0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] reserved_host_disk_mb          = 0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] reserved_host_memory_mb        = 512 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] reserved_huge_pages            = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] resize_confirm_window          = 0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] resize_fs_using_block_device   = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] resume_guests_state_on_host_boot = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] rootwrap_config                = /etc/nova/rootwrap.conf {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] rpc_response_timeout           = 60 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] run_external_periodic_tasks    = True {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] running_deleted_instance_action = reap {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] running_deleted_instance_poll_interval = 1800 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] running_deleted_instance_timeout = 0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] scheduler_instance_sync_interval = 120 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] service_down_time              = 60 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] servicegroup_driver            = db {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] shelved_offload_time           = 0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] shelved_poll_interval          = 3600 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] shutdown_timeout               = 0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] source_is_ipv6                 = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] ssl_only                       = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] state_path                     = /opt/stack/data/nova {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] sync_power_state_interval      = 600 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] sync_power_state_pool_size     = 1000 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] syslog_log_facility            = LOG_USER {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] tempdir                        = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] timeout_nbd                    = 10 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] transport_url                  = **** {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] update_resources_interval      = 0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] use_cow_images                 = True {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] use_eventlog                   = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] use_journal                    = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] use_json                       = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] use_rootwrap_daemon            = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] use_stderr                     = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] use_syslog                     = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vcpu_pin_set                   = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vif_plugging_is_fatal          = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vif_plugging_timeout           = 0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] virt_mkfs                      = [] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] volume_usage_poll_interval     = 0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] watch_log_file                 = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] web                            = /usr/share/spice-html5 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2602}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_concurrency.disable_process_locking = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_concurrency.lock_path     = /opt/stack/data/nova {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api.auth_strategy              = keystone {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api.compute_link_prefix        = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api.dhcp_domain                = novalocal {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api.enable_instance_password   = True {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api.glance_link_prefix         = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api.instance_list_cells_batch_fixed_size = 100 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api.instance_list_cells_batch_strategy = distributed {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api.instance_list_per_project_cells = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api.list_records_by_skipping_down_cells = True {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api.local_metadata_per_cell    = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api.max_limit                  = 1000 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api.metadata_cache_expiration  = 15 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api.neutron_default_tenant_id  = default {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api.use_forwarded_for          = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api.use_neutron_default_nets   = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api.vendordata_dynamic_connect_timeout = 5 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api.vendordata_dynamic_failure_fatal = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api.vendordata_dynamic_read_timeout = 5 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api.vendordata_dynamic_ssl_certfile =  {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api.vendordata_dynamic_targets = [] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api.vendordata_jsonfile_path   = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api.vendordata_providers       = ['StaticJSON'] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cache.backend                  = dogpile.cache.memcached {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cache.backend_argument         = **** {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cache.config_prefix            = cache.oslo {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cache.dead_timeout             = 60.0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cache.debug_cache_backend      = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cache.enable_retry_client      = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cache.enable_socket_keepalive  = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cache.enabled                  = True {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cache.expiration_time          = 600 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cache.hashclient_retry_attempts = 2 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cache.hashclient_retry_delay   = 1.0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cache.memcache_dead_retry      = 300 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cache.memcache_password        =  {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cache.memcache_pool_maxsize    = 10 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cache.memcache_sasl_enabled    = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cache.memcache_socket_timeout  = 1.0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cache.memcache_username        =  {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cache.proxies                  = [] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cache.retry_attempts           = 2 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cache.retry_delay              = 0.0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cache.socket_keepalive_count   = 1 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cache.socket_keepalive_idle    = 1 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cache.socket_keepalive_interval = 1 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cache.tls_allowed_ciphers      = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cache.tls_cafile               = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cache.tls_certfile             = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cache.tls_enabled              = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cache.tls_keyfile              = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cinder.auth_section            = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cinder.auth_type               = password {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cinder.cafile                  = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cinder.catalog_info            = volumev3::publicURL {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cinder.certfile                = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cinder.collect_timing          = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cinder.cross_az_attach         = True {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cinder.debug                   = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cinder.endpoint_template       = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cinder.http_retries            = 3 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cinder.insecure                = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cinder.keyfile                 = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cinder.os_region_name          = RegionOne {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cinder.split_loggers           = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cinder.timeout                 = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] compute.consecutive_build_service_disable_threshold = 10 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] compute.cpu_dedicated_set      = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] compute.cpu_shared_set         = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] compute.image_type_exclude_list = [] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] compute.live_migration_wait_for_vif_plug = True {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] compute.max_concurrent_disk_ops = 0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] compute.max_disk_devices_to_attach = -1 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] compute.resource_provider_association_refresh = 300 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] compute.shutdown_retry_interval = 10 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] compute.vmdk_allowed_types     = ['streamOptimized', 'monolithicSparse'] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] conductor.workers              = 3 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] console.allowed_origins        = [] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] console.ssl_ciphers            = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] console.ssl_minimum_version    = default {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] consoleauth.token_ttl          = 600 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cyborg.cafile                  = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cyborg.certfile                = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cyborg.collect_timing          = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cyborg.connect_retries         = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cyborg.connect_retry_delay     = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cyborg.endpoint_override       = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cyborg.insecure                = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cyborg.keyfile                 = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cyborg.max_version             = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cyborg.min_version             = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cyborg.region_name             = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cyborg.service_name            = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cyborg.service_type            = accelerator {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cyborg.split_loggers           = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cyborg.status_code_retries     = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cyborg.status_code_retry_delay = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cyborg.timeout                 = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cyborg.valid_interfaces        = ['internal', 'public'] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] cyborg.version                 = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] database.backend               = sqlalchemy {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] database.connection            = **** {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] database.connection_debug      = 0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] database.connection_parameters =  {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] database.connection_recycle_time = 3600 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] database.connection_trace      = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] database.db_inc_retry_interval = True {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] database.db_max_retries        = 20 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] database.db_max_retry_interval = 10 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] database.db_retry_interval     = 1 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] database.max_overflow          = 50 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] database.max_pool_size         = 5 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] database.max_retries           = 10 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] database.mysql_enable_ndb      = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] database.mysql_wsrep_sync_wait = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] database.pool_timeout          = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] database.retry_interval        = 10 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] database.slave_connection      = **** {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] database.sqlite_synchronous    = True {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api_database.backend           = sqlalchemy {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api_database.connection        = **** {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api_database.connection_debug  = 0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api_database.connection_parameters =  {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api_database.connection_recycle_time = 3600 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api_database.connection_trace  = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api_database.db_inc_retry_interval = True {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api_database.db_max_retries    = 20 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api_database.db_max_retry_interval = 10 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api_database.db_retry_interval = 1 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api_database.max_overflow      = 50 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api_database.max_pool_size     = 5 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api_database.max_retries       = 10 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api_database.mysql_enable_ndb  = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api_database.mysql_sql_mode    = TRADITIONAL {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api_database.mysql_wsrep_sync_wait = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api_database.pool_timeout      = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api_database.retry_interval    = 10 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api_database.slave_connection  = **** {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] api_database.sqlite_synchronous = True {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] devices.enabled_mdev_types     = [] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] ephemeral_storage_encryption.enabled = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] ephemeral_storage_encryption.key_size = 512 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] glance.api_servers             = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] glance.cafile                  = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] glance.certfile                = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] glance.collect_timing          = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] glance.connect_retries         = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] glance.connect_retry_delay     = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] glance.debug                   = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] glance.default_trusted_certificate_ids = [] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] glance.enable_certificate_validation = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] glance.enable_rbd_download     = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] glance.endpoint_override       = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] glance.insecure                = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] glance.keyfile                 = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] glance.max_version             = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] glance.min_version             = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] glance.num_retries             = 3 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] glance.rbd_ceph_conf           =  {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] glance.rbd_connect_timeout     = 5 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] glance.rbd_pool                =  {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] glance.rbd_user                =  {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] glance.region_name             = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] glance.service_name            = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] glance.service_type            = image {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] glance.split_loggers           = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] glance.status_code_retries     = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] glance.status_code_retry_delay = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] glance.timeout                 = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] glance.valid_interfaces        = ['internal', 'public'] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] glance.verify_glance_signatures = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] glance.version                 = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] guestfs.debug                  = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] hyperv.config_drive_cdrom      = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] hyperv.config_drive_inject_password = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] hyperv.dynamic_memory_ratio    = 1.0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] hyperv.enable_instance_metrics_collection = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] hyperv.enable_remotefx         = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] hyperv.instances_path_share    =  {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] hyperv.iscsi_initiator_list    = [] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] hyperv.limit_cpu_features      = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] hyperv.mounted_disk_query_retry_count = 10 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] hyperv.power_state_check_timeframe = 60 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] hyperv.power_state_event_polling_interval = 2 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] hyperv.qemu_img_cmd            = qemu-img.exe {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] hyperv.use_multipath_io        = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] hyperv.volume_attach_retry_count = 10 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] hyperv.volume_attach_retry_interval = 5 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] hyperv.vswitch_name            = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] hyperv.wait_soft_reboot_seconds = 60 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] mks.enabled                    = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] mks.mksproxy_base_url          = http://127.0.0.1:6090/ {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] image_cache.manager_interval   = 2400 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] image_cache.precache_concurrency = 1 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] image_cache.remove_unused_base_images = True {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] image_cache.subdirectory_name  = _base {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] ironic.api_max_retries         = 60 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] ironic.api_retry_interval      = 2 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] ironic.auth_section            = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] ironic.auth_type               = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] ironic.cafile                  = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] ironic.certfile                = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] ironic.collect_timing          = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] ironic.connect_retries         = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] ironic.connect_retry_delay     = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] ironic.endpoint_override       = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] ironic.insecure                = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] ironic.keyfile                 = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] ironic.max_version             = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] ironic.min_version             = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] ironic.partition_key           = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] ironic.peer_list               = [] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] ironic.region_name             = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] ironic.serial_console_state_timeout = 10 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] ironic.service_name            = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] ironic.service_type            = baremetal {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] ironic.split_loggers           = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] ironic.status_code_retries     = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] ironic.status_code_retry_delay = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] ironic.timeout                 = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] ironic.valid_interfaces        = ['internal', 'public'] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] ironic.version                 = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] key_manager.backend            = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] key_manager.fixed_key          = **** {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] barbican.barbican_api_version  = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] barbican.barbican_endpoint     = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] barbican.barbican_endpoint_type = public {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] barbican.barbican_region_name  = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] barbican.cafile                = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] barbican.certfile              = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] barbican.collect_timing        = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] barbican.insecure              = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] barbican.keyfile               = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] barbican.number_of_retries     = 60 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] barbican.retry_delay           = 1 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] barbican.send_service_user_token = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] barbican.split_loggers         = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] barbican.timeout               = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] barbican.verify_ssl            = True {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] barbican.verify_ssl_path       = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] barbican_service_user.auth_section = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] barbican_service_user.auth_type = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] barbican_service_user.cafile   = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] barbican_service_user.certfile = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] barbican_service_user.collect_timing = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] barbican_service_user.insecure = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] barbican_service_user.keyfile  = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] barbican_service_user.split_loggers = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] barbican_service_user.timeout  = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vault.approle_role_id          = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vault.approle_secret_id        = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vault.cafile                   = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vault.certfile                 = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vault.collect_timing           = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vault.insecure                 = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vault.keyfile                  = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vault.kv_mountpoint            = secret {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vault.kv_version               = 2 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vault.namespace                = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vault.root_token_id            = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vault.split_loggers            = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vault.ssl_ca_crt_file          = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vault.timeout                  = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vault.use_ssl                  = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] keystone.cafile                = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] keystone.certfile              = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] keystone.collect_timing        = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] keystone.connect_retries       = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] keystone.connect_retry_delay   = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] keystone.endpoint_override     = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] keystone.insecure              = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] keystone.keyfile               = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] keystone.max_version           = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] keystone.min_version           = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] keystone.region_name           = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] keystone.service_name          = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] keystone.service_type          = identity {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] keystone.split_loggers         = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] keystone.status_code_retries   = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] keystone.status_code_retry_delay = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] keystone.timeout               = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] keystone.valid_interfaces      = ['internal', 'public'] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] keystone.version               = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.connection_uri         =  {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.cpu_mode               = custom {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.cpu_model_extra_flags  = [] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: WARNING oslo_config.cfg [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] Deprecated: Option "cpu_model" from group "libvirt" is deprecated. Use option "cpu_models" from group "libvirt".
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.cpu_models             = ['Nehalem'] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.cpu_power_governor_high = performance {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.cpu_power_governor_low = powersave {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.cpu_power_management   = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.cpu_power_management_strategy = cpu_state {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.device_detach_attempts = 8 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.device_detach_timeout  = 20 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.disk_cachemodes        = [] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.disk_prefix            = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.enabled_perf_events    = [] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.file_backed_memory     = 0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.gid_maps               = [] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.hw_disk_discard        = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.hw_machine_type        = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.images_rbd_ceph_conf   =  {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.images_rbd_glance_store_name =  {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.images_rbd_pool        = rbd {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.images_type            = default {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.images_volume_group    = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.inject_key             = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.inject_partition       = -2 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.inject_password        = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.iscsi_iface            = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.iser_use_multipath     = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.live_migration_bandwidth = 0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.live_migration_completion_timeout = 800 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.live_migration_downtime = 500 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.live_migration_downtime_delay = 75 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.live_migration_downtime_steps = 10 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.live_migration_inbound_addr = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.live_migration_permit_auto_converge = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.live_migration_permit_post_copy = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.live_migration_scheme  = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.live_migration_timeout_action = abort {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.live_migration_tunnelled = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: WARNING oslo_config.cfg [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] Deprecated: Option "live_migration_uri" from group "libvirt" is deprecated for removal (
Jul 29 13:28:57 user nova-compute[231753]: live_migration_uri is deprecated for removal in favor of two other options that
Jul 29 13:28:57 user nova-compute[231753]: allow to change live migration scheme and target URI: ``live_migration_scheme``
Jul 29 13:28:57 user nova-compute[231753]: and ``live_migration_inbound_addr`` respectively.
Jul 29 13:28:57 user nova-compute[231753]: ).  Its value may be silently ignored in the future.
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.live_migration_uri     = qemu+ssh://stack@%s/system {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.live_migration_with_native_tls = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.max_queues             = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.mem_stats_period_seconds = 10 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.nfs_mount_options      = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.nfs_mount_point_base   = /opt/stack/data/nova/mnt {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.num_aoe_discover_tries = 3 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.num_iser_scan_tries    = 5 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.num_memory_encrypted_guests = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.num_nvme_discover_tries = 5 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.num_pcie_ports         = 0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.num_volume_scan_tries  = 5 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.pmem_namespaces        = [] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.quobyte_client_cfg     = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.rbd_connect_timeout    = 5 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.rbd_destroy_volume_retries = 12 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.rbd_secret_uuid        = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.rbd_user               = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.realtime_scheduler_priority = 1 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.remote_filesystem_transport = ssh {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.rescue_image_id        = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.rescue_kernel_id       = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.rescue_ramdisk_id      = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.rng_dev_path           = /dev/urandom {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.rx_queue_size          = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.smbfs_mount_options    =  {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.snapshot_compression   = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.snapshot_image_format  = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.snapshots_directory    = /opt/stack/data/nova/instances/snapshots {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.sparse_logical_volumes = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.swtpm_enabled          = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.swtpm_group            = tss {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.swtpm_user             = tss {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.sysinfo_serial         = unique {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.tb_cache_size          = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.tx_queue_size          = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.uid_maps               = [] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.use_virtio_for_bridges = True {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.virt_type              = kvm {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.volume_clear           = zero {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.volume_clear_size      = 0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.volume_use_multipath   = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.vzstorage_cache_path   = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.vzstorage_log_path     = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.vzstorage_mount_group  = qemu {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.vzstorage_mount_opts   = [] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.vzstorage_mount_perms  = 0770 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.vzstorage_mount_user   = stack {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] libvirt.wait_soft_reboot_seconds = 120 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] neutron.auth_section           = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] neutron.auth_type              = password {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] neutron.cafile                 = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] neutron.certfile               = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] neutron.collect_timing         = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] neutron.connect_retries        = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] neutron.connect_retry_delay    = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] neutron.default_floating_pool  = public {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] neutron.endpoint_override      = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] neutron.extension_sync_interval = 600 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] neutron.http_retries           = 3 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] neutron.insecure               = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] neutron.keyfile                = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] neutron.max_version            = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] neutron.metadata_proxy_shared_secret = **** {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] neutron.min_version            = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] neutron.ovs_bridge             = br-int {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] neutron.physnets               = [] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] neutron.region_name            = RegionOne {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] neutron.service_metadata_proxy = True {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] neutron.service_name           = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] neutron.service_type           = network {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] neutron.split_loggers          = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] neutron.status_code_retries    = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] neutron.status_code_retry_delay = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] neutron.timeout                = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] neutron.valid_interfaces       = ['internal', 'public'] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] neutron.version                = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] notifications.bdms_in_notifications = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] notifications.default_level    = INFO {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] notifications.notification_format = unversioned {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] notifications.notify_on_state_change = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] pci.alias                      = [] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] pci.device_spec                = [] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] pci.report_in_placement        = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.auth_section         = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.auth_type            = password {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.auth_url             = http://10.0.0.210/identity {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.cafile               = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.certfile             = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.collect_timing       = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.connect_retries      = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.connect_retry_delay  = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.default_domain_id    = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.default_domain_name  = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.domain_id            = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.domain_name          = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.endpoint_override    = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.insecure             = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.keyfile              = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.max_version          = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.min_version          = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.password             = **** {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.project_domain_id    = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.project_domain_name  = Default {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.project_id           = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.project_name         = service {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.region_name          = RegionOne {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.service_name         = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.service_type         = placement {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.split_loggers        = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.status_code_retries  = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.status_code_retry_delay = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.system_scope         = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.timeout              = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.trust_id             = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.user_domain_id       = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.user_domain_name     = Default {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.user_id              = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.username             = placement {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.valid_interfaces     = ['internal', 'public'] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] placement.version              = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] quota.cores                    = 20 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] quota.count_usage_from_placement = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] quota.driver                   = nova.quota.DbQuotaDriver {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] quota.injected_file_content_bytes = 10240 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] quota.injected_file_path_length = 255 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] quota.injected_files           = 5 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] quota.instances                = 10 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] quota.key_pairs                = 100 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] quota.metadata_items           = 128 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] quota.ram                      = 51200 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] quota.recheck_quota            = True {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] quota.server_group_members     = 10 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] quota.server_groups            = 10 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] rdp.enabled                    = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] rdp.html5_proxy_base_url       = http://127.0.0.1:6083/ {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] scheduler.enable_isolated_aggregate_filtering = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] scheduler.image_metadata_prefilter = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] scheduler.max_attempts         = 3 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] scheduler.max_placement_results = 1000 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] scheduler.placement_aggregate_required_for_tenants = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] scheduler.query_placement_for_availability_zone = True {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] scheduler.query_placement_for_image_type_support = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] scheduler.workers              = 3 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] filter_scheduler.enabled_filters = ['ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] filter_scheduler.host_subset_size = 1 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] filter_scheduler.hypervisor_version_weight_multiplier = 1.0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] filter_scheduler.image_properties_default_architecture = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] filter_scheduler.isolated_hosts = [] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] filter_scheduler.isolated_images = [] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] filter_scheduler.max_instances_per_host = 50 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] filter_scheduler.max_io_ops_per_host = 8 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] filter_scheduler.pci_in_placement = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] filter_scheduler.track_instance_changes = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] metrics.required               = True {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] metrics.weight_multiplier      = 1.0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] metrics.weight_of_unavailable  = -10000.0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] metrics.weight_setting         = [] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] serial_console.base_url        = ws://127.0.0.1:6083/ {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] serial_console.enabled         = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] serial_console.port_range      = 10000:20000 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] serial_console.proxyclient_address = 127.0.0.1 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] serial_console.serialproxy_host = 0.0.0.0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] serial_console.serialproxy_port = 6083 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] service_user.auth_section      = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] service_user.auth_type         = password {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] service_user.cafile            = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] service_user.certfile          = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] service_user.collect_timing    = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] service_user.insecure          = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] service_user.keyfile           = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] service_user.send_service_user_token = True {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] service_user.split_loggers     = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] service_user.timeout           = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] spice.agent_enabled            = True {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] spice.enabled                  = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] spice.html5proxy_base_url      = http://10.0.0.210:6081/spice_auto.html {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] spice.html5proxy_host          = 0.0.0.0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] spice.html5proxy_port          = 6082 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] spice.image_compression        = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] spice.jpeg_compression         = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] spice.playback_compression     = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] spice.server_listen            = 127.0.0.1 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] spice.server_proxyclient_address = 127.0.0.1 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] spice.streaming_mode           = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] spice.zlib_compression         = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] upgrade_levels.baseapi         = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] upgrade_levels.cert            = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] upgrade_levels.compute         = auto {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] upgrade_levels.conductor       = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] upgrade_levels.scheduler       = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vendordata_dynamic_auth.auth_section = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vendordata_dynamic_auth.auth_type = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vendordata_dynamic_auth.cafile = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vendordata_dynamic_auth.certfile = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vendordata_dynamic_auth.collect_timing = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vendordata_dynamic_auth.insecure = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vendordata_dynamic_auth.keyfile = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vendordata_dynamic_auth.split_loggers = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vendordata_dynamic_auth.timeout = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vmware.api_retry_count         = 10 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vmware.ca_file                 = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vmware.cache_prefix            = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vmware.cluster_name            = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vmware.connection_pool_size    = 10 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vmware.console_delay_seconds   = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vmware.datastore_regex         = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vmware.host_ip                 = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vmware.host_password           = **** {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vmware.host_port               = 443 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vmware.host_username           = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vmware.insecure                = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vmware.integration_bridge      = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vmware.maximum_objects         = 100 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vmware.pbm_default_policy      = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vmware.pbm_enabled             = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vmware.pbm_wsdl_location       = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vmware.serial_log_dir          = /opt/vmware/vspc {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vmware.serial_port_proxy_uri   = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vmware.serial_port_service_uri = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vmware.task_poll_interval      = 0.5 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vmware.use_linked_clone        = True {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vmware.vnc_keymap              = en-us {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vmware.vnc_port                = 5900 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vmware.vnc_port_total          = 10000 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vnc.auth_schemes               = ['none'] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vnc.enabled                    = True {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vnc.novncproxy_base_url        = http://10.0.0.210:6080/vnc_lite.html {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vnc.novncproxy_host            = 0.0.0.0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vnc.novncproxy_port            = 6080 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vnc.server_listen              = 0.0.0.0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vnc.server_proxyclient_address = 10.0.0.210 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vnc.vencrypt_ca_certs          = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vnc.vencrypt_client_cert       = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vnc.vencrypt_client_key        = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] workarounds.disable_compute_service_check_for_ffu = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] workarounds.disable_fallback_pcpu_query = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] workarounds.disable_group_policy_check_upcall = True {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] workarounds.disable_libvirt_livesnapshot = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] workarounds.disable_rootwrap   = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] workarounds.enable_numa_live_migration = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] workarounds.enable_qemu_monitor_announce_self = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] workarounds.handle_virt_lifecycle_events = True {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] workarounds.libvirt_disable_apic = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] workarounds.never_download_image_if_on_rbd = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] workarounds.qemu_monitor_announce_self_count = 3 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] workarounds.qemu_monitor_announce_self_interval = 1 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] workarounds.skip_cpu_compare_at_startup = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] workarounds.skip_cpu_compare_on_dest = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] workarounds.skip_reserve_in_use_ironic_nodes = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] wsgi.api_paste_config          = /etc/nova/api-paste.ini {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] wsgi.client_socket_timeout     = 900 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] wsgi.default_pool_size         = 1000 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] wsgi.keep_alive                = True {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] wsgi.max_header_line           = 16384 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] wsgi.secure_proxy_ssl_header   = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] wsgi.ssl_ca_file               = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] wsgi.ssl_cert_file             = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] wsgi.ssl_key_file              = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] wsgi.tcp_keepidle              = 600 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] wsgi.wsgi_log_format           = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] zvm.ca_file                    = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] zvm.cloud_connector_url        = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] zvm.image_tmp_path             = /opt/stack/data/nova/images {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] zvm.reachable_timeout          = 300 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_policy.enforce_new_defaults = True {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_policy.enforce_scope      = True {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_policy.policy_default_rule = default {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_policy.policy_file        = policy.yaml {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] profiler.connection_string     = messaging:// {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] profiler.enabled               = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] profiler.es_doc_type           = notification {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] profiler.es_scroll_size        = 10000 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] profiler.es_scroll_time        = 2m {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] profiler.filter_error_trace    = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] profiler.hmac_keys             = **** {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] profiler.sentinel_service_name = mymaster {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] profiler.socket_timeout        = 0.1 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] profiler.trace_requests        = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] profiler.trace_sqlalchemy      = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] profiler_jaeger.process_tags   = {} {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] profiler_jaeger.service_name_prefix = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] profiler_otlp.service_name_prefix = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] remote_debug.host              = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] remote_debug.port              = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_rabbit.heartbeat_rate = 2 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_rabbit.ssl      = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_rabbit.ssl_version =  {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_notifications.retry = -1 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_messaging_notifications.transport_url = **** {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_limit.auth_section        = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_limit.auth_type           = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_limit.cafile              = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_limit.certfile            = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_limit.collect_timing      = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_limit.connect_retries     = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_limit.connect_retry_delay = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_limit.endpoint_id         = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_limit.endpoint_override   = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_limit.insecure            = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_limit.keyfile             = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_limit.max_version         = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_limit.min_version         = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_limit.region_name         = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_limit.service_name        = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_limit.service_type        = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_limit.split_loggers       = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_limit.status_code_retries = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_limit.status_code_retry_delay = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_limit.timeout             = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_limit.valid_interfaces    = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_limit.version             = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_reports.file_event_handler = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] oslo_reports.log_dir           = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vif_plug_linux_bridge_privileged.capabilities = [12] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vif_plug_linux_bridge_privileged.group = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vif_plug_linux_bridge_privileged.helper_command = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vif_plug_linux_bridge_privileged.logger_name = oslo_privsep.daemon {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vif_plug_linux_bridge_privileged.thread_pool_size = 12 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vif_plug_linux_bridge_privileged.user = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vif_plug_ovs_privileged.capabilities = [12, 1] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vif_plug_ovs_privileged.group  = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vif_plug_ovs_privileged.helper_command = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vif_plug_ovs_privileged.logger_name = oslo_privsep.daemon {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vif_plug_ovs_privileged.thread_pool_size = 12 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] vif_plug_ovs_privileged.user   = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] os_vif_linux_bridge.flat_interface = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] os_vif_linux_bridge.forward_bridge_interface = ['all'] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] os_vif_linux_bridge.iptables_bottom_regex =  {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] os_vif_linux_bridge.iptables_drop_action = DROP {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] os_vif_linux_bridge.iptables_top_regex =  {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] os_vif_linux_bridge.network_device_mtu = 1500 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] os_vif_linux_bridge.use_ipv6   = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] os_vif_linux_bridge.vlan_interface = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] os_vif_ovs.isolate_vif         = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] os_vif_ovs.network_device_mtu  = 1500 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] os_vif_ovs.ovs_vsctl_timeout   = 120 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] os_vif_ovs.ovsdb_connection    = tcp:127.0.0.1:6640 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] os_vif_ovs.ovsdb_interface     = native {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] os_vif_ovs.per_port_bridge     = False {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] os_brick.lock_path             = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] privsep_osbrick.capabilities   = [21] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] privsep_osbrick.group          = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] privsep_osbrick.helper_command = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] privsep_osbrick.thread_pool_size = 12 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] privsep_osbrick.user           = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] nova_sys_admin.capabilities    = [0, 1, 2, 3, 12, 21] {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] nova_sys_admin.group           = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] nova_sys_admin.helper_command  = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] nova_sys_admin.logger_name     = oslo_privsep.daemon {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] nova_sys_admin.thread_pool_size = 12 {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] nova_sys_admin.user            = None {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2609}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG oslo_service.service [None req-24c08eda-ff89-47fb-b32d-419b4708fec9 None None] ******************************************************************************** {{(pid=231753) log_opt_values /usr/local/lib/python3.10/dist-packages/oslo_config/cfg.py:2613}}
Jul 29 13:28:57 user nova-compute[231753]: INFO nova.service [-] Starting compute node (version 0.0.0)
Jul 29 13:28:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Starting native event thread {{(pid=231753) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:492}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Starting green dispatch thread {{(pid=231753) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:498}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Starting connection event dispatch thread {{(pid=231753) initialize /opt/stack/nova/nova/virt/libvirt/host.py:620}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Connecting to libvirt: qemu:///system {{(pid=231753) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:503}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Registering for lifecycle events <nova.virt.libvirt.host.Host object at 0x7f7ca27cb790> {{(pid=231753) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:509}}
Jul 29 13:28:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Registering for connection events: <nova.virt.libvirt.host.Host object at 0x7f7ca27cb790> {{(pid=231753) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:530}}
Jul 29 13:28:57 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Connection event '1' reason 'None'
Jul 29 13:28:57 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Cannot update service status on host "user" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 29 13:28:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.mount [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Initialising _HostMountState generation 0 {{(pid=231753) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}}
Jul 29 13:29:04 user nova-compute[231753]: INFO nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Libvirt host capabilities <capabilities>
Jul 29 13:29:04 user nova-compute[231753]:   <host>
Jul 29 13:29:04 user nova-compute[231753]:     <uuid>e20c3142-5af9-7467-ecd8-70b2e4a210d6</uuid>
Jul 29 13:29:04 user nova-compute[231753]:     <cpu>
Jul 29 13:29:04 user nova-compute[231753]:       <arch>x86_64</arch>
Jul 29 13:29:04 user nova-compute[231753]:       <model>IvyBridge-IBRS</model>
Jul 29 13:29:04 user nova-compute[231753]:       <vendor>Intel</vendor>
Jul 29 13:29:04 user nova-compute[231753]:       <microcode version='1070'/>
Jul 29 13:29:04 user nova-compute[231753]:       <counter name='tsc' frequency='2094952000' scaling='no'/>
Jul 29 13:29:04 user nova-compute[231753]:       <topology sockets='6' dies='1' cores='1' threads='1'/>
Jul 29 13:29:04 user nova-compute[231753]:       <feature name='ss'/>
Jul 29 13:29:04 user nova-compute[231753]:       <feature name='vmx'/>
Jul 29 13:29:04 user nova-compute[231753]:       <feature name='pcid'/>
Jul 29 13:29:04 user nova-compute[231753]:       <feature name='osxsave'/>
Jul 29 13:29:04 user nova-compute[231753]:       <feature name='hypervisor'/>
Jul 29 13:29:04 user nova-compute[231753]:       <feature name='arat'/>
Jul 29 13:29:04 user nova-compute[231753]:       <feature name='tsc_adjust'/>
Jul 29 13:29:04 user nova-compute[231753]:       <feature name='md-clear'/>
Jul 29 13:29:04 user nova-compute[231753]:       <feature name='stibp'/>
Jul 29 13:29:04 user nova-compute[231753]:       <feature name='arch-capabilities'/>
Jul 29 13:29:04 user nova-compute[231753]:       <feature name='ssbd'/>
Jul 29 13:29:04 user nova-compute[231753]:       <feature name='invtsc'/>
Jul 29 13:29:04 user nova-compute[231753]:       <feature name='rsba'/>
Jul 29 13:29:04 user nova-compute[231753]:       <feature name='skip-l1dfl-vmentry'/>
Jul 29 13:29:04 user nova-compute[231753]:       <pages unit='KiB' size='4'/>
Jul 29 13:29:04 user nova-compute[231753]:       <pages unit='KiB' size='2048'/>
Jul 29 13:29:04 user nova-compute[231753]:     </cpu>
Jul 29 13:29:04 user nova-compute[231753]:     <power_management>
Jul 29 13:29:04 user nova-compute[231753]:       <suspend_mem/>
Jul 29 13:29:04 user nova-compute[231753]:       <suspend_disk/>
Jul 29 13:29:04 user nova-compute[231753]:       <suspend_hybrid/>
Jul 29 13:29:04 user nova-compute[231753]:     </power_management>
Jul 29 13:29:04 user nova-compute[231753]:     <iommu support='no'/>
Jul 29 13:29:04 user nova-compute[231753]:     <migration_features>
Jul 29 13:29:04 user nova-compute[231753]:       <live/>
Jul 29 13:29:04 user nova-compute[231753]:       <uri_transports>
Jul 29 13:29:04 user nova-compute[231753]:         <uri_transport>tcp</uri_transport>
Jul 29 13:29:04 user nova-compute[231753]:         <uri_transport>rdma</uri_transport>
Jul 29 13:29:04 user nova-compute[231753]:       </uri_transports>
Jul 29 13:29:04 user nova-compute[231753]:     </migration_features>
Jul 29 13:29:04 user nova-compute[231753]:     <topology>
Jul 29 13:29:04 user nova-compute[231753]:       <cells num='2'>
Jul 29 13:29:04 user nova-compute[231753]:         <cell id='0'>
Jul 29 13:29:04 user nova-compute[231753]:           <memory unit='KiB'>8189224</memory>
Jul 29 13:29:04 user nova-compute[231753]:           <pages unit='KiB' size='4'>2047306</pages>
Jul 29 13:29:04 user nova-compute[231753]:           <pages unit='KiB' size='2048'>0</pages>
Jul 29 13:29:04 user nova-compute[231753]:           <distances>
Jul 29 13:29:04 user nova-compute[231753]:             <sibling id='0' value='10'/>
Jul 29 13:29:04 user nova-compute[231753]:             <sibling id='1' value='20'/>
Jul 29 13:29:04 user nova-compute[231753]:           </distances>
Jul 29 13:29:04 user nova-compute[231753]:           <cpus num='6'>
Jul 29 13:29:04 user nova-compute[231753]:             <cpu id='0' socket_id='0' die_id='0' core_id='0' siblings='0'/>
Jul 29 13:29:04 user nova-compute[231753]:             <cpu id='1' socket_id='2' die_id='0' core_id='0' siblings='1'/>
Jul 29 13:29:04 user nova-compute[231753]:             <cpu id='2' socket_id='4' die_id='0' core_id='0' siblings='2'/>
Jul 29 13:29:04 user nova-compute[231753]:             <cpu id='3' socket_id='6' die_id='0' core_id='0' siblings='3'/>
Jul 29 13:29:04 user nova-compute[231753]:             <cpu id='4' socket_id='8' die_id='0' core_id='0' siblings='4'/>
Jul 29 13:29:04 user nova-compute[231753]:             <cpu id='5' socket_id='10' die_id='0' core_id='0' siblings='5'/>
Jul 29 13:29:04 user nova-compute[231753]:           </cpus>
Jul 29 13:29:04 user nova-compute[231753]:         </cell>
Jul 29 13:29:04 user nova-compute[231753]:         <cell id='1'>
Jul 29 13:29:04 user nova-compute[231753]:           <memory unit='KiB'>8206460</memory>
Jul 29 13:29:04 user nova-compute[231753]:           <pages unit='KiB' size='4'>2051615</pages>
Jul 29 13:29:04 user nova-compute[231753]:           <pages unit='KiB' size='2048'>0</pages>
Jul 29 13:29:04 user nova-compute[231753]:           <distances>
Jul 29 13:29:04 user nova-compute[231753]:             <sibling id='0' value='20'/>
Jul 29 13:29:04 user nova-compute[231753]:             <sibling id='1' value='10'/>
Jul 29 13:29:04 user nova-compute[231753]:           </distances>
Jul 29 13:29:04 user nova-compute[231753]:           <cpus num='6'>
Jul 29 13:29:04 user nova-compute[231753]:             <cpu id='6' socket_id='12' die_id='0' core_id='0' siblings='6'/>
Jul 29 13:29:04 user nova-compute[231753]:             <cpu id='7' socket_id='14' die_id='0' core_id='0' siblings='7'/>
Jul 29 13:29:04 user nova-compute[231753]:             <cpu id='8' socket_id='16' die_id='0' core_id='0' siblings='8'/>
Jul 29 13:29:04 user nova-compute[231753]:             <cpu id='9' socket_id='18' die_id='0' core_id='0' siblings='9'/>
Jul 29 13:29:04 user nova-compute[231753]:             <cpu id='10' socket_id='20' die_id='0' core_id='0' siblings='10'/>
Jul 29 13:29:04 user nova-compute[231753]:             <cpu id='11' socket_id='22' die_id='0' core_id='0' siblings='11'/>
Jul 29 13:29:04 user nova-compute[231753]:           </cpus>
Jul 29 13:29:04 user nova-compute[231753]:         </cell>
Jul 29 13:29:04 user nova-compute[231753]:       </cells>
Jul 29 13:29:04 user nova-compute[231753]:     </topology>
Jul 29 13:29:04 user nova-compute[231753]:     <cache>
Jul 29 13:29:04 user nova-compute[231753]:       <bank id='0' level='3' type='both' size='15' unit='MiB' cpus='0'/>
Jul 29 13:29:04 user nova-compute[231753]:       <bank id='2' level='3' type='both' size='15' unit='MiB' cpus='1'/>
Jul 29 13:29:04 user nova-compute[231753]:       <bank id='4' level='3' type='both' size='15' unit='MiB' cpus='2'/>
Jul 29 13:29:04 user nova-compute[231753]:       <bank id='6' level='3' type='both' size='15' unit='MiB' cpus='3'/>
Jul 29 13:29:04 user nova-compute[231753]:       <bank id='8' level='3' type='both' size='15' unit='MiB' cpus='4'/>
Jul 29 13:29:04 user nova-compute[231753]:       <bank id='10' level='3' type='both' size='15' unit='MiB' cpus='5'/>
Jul 29 13:29:04 user nova-compute[231753]:       <bank id='12' level='3' type='both' size='15' unit='MiB' cpus='6'/>
Jul 29 13:29:04 user nova-compute[231753]:       <bank id='14' level='3' type='both' size='15' unit='MiB' cpus='7'/>
Jul 29 13:29:04 user nova-compute[231753]:       <bank id='16' level='3' type='both' size='15' unit='MiB' cpus='8'/>
Jul 29 13:29:04 user nova-compute[231753]:       <bank id='18' level='3' type='both' size='15' unit='MiB' cpus='9'/>
Jul 29 13:29:04 user nova-compute[231753]:       <bank id='20' level='3' type='both' size='15' unit='MiB' cpus='10'/>
Jul 29 13:29:04 user nova-compute[231753]:       <bank id='22' level='3' type='both' size='15' unit='MiB' cpus='11'/>
Jul 29 13:29:04 user nova-compute[231753]:     </cache>
Jul 29 13:29:04 user nova-compute[231753]:     <secmodel>
Jul 29 13:29:04 user nova-compute[231753]:       <model>apparmor</model>
Jul 29 13:29:04 user nova-compute[231753]:       <doi>0</doi>
Jul 29 13:29:04 user nova-compute[231753]:     </secmodel>
Jul 29 13:29:04 user nova-compute[231753]:     <secmodel>
Jul 29 13:29:04 user nova-compute[231753]:       <model>dac</model>
Jul 29 13:29:04 user nova-compute[231753]:       <doi>0</doi>
Jul 29 13:29:04 user nova-compute[231753]:       <baselabel type='kvm'>+64055:+108</baselabel>
Jul 29 13:29:04 user nova-compute[231753]:       <baselabel type='qemu'>+64055:+108</baselabel>
Jul 29 13:29:04 user nova-compute[231753]:     </secmodel>
Jul 29 13:29:04 user nova-compute[231753]:   </host>
Jul 29 13:29:04 user nova-compute[231753]:   <guest>
Jul 29 13:29:04 user nova-compute[231753]:     <os_type>hvm</os_type>
Jul 29 13:29:04 user nova-compute[231753]:     <arch name='alpha'>
Jul 29 13:29:04 user nova-compute[231753]:       <wordsize>64</wordsize>
Jul 29 13:29:04 user nova-compute[231753]:       <emulator>/usr/bin/qemu-system-alpha</emulator>
Jul 29 13:29:04 user nova-compute[231753]:       <machine maxCpus='4'>clipper</machine>
Jul 29 13:29:04 user nova-compute[231753]:       <domain type='qemu'/>
Jul 29 13:29:04 user nova-compute[231753]:     </arch>
Jul 29 13:29:04 user nova-compute[231753]:     <features>
Jul 29 13:29:04 user nova-compute[231753]:       <cpuselection/>
Jul 29 13:29:04 user nova-compute[231753]:       <deviceboot/>
Jul 29 13:29:04 user nova-compute[231753]:       <disksnapshot default='on' toggle='no'/>
Jul 29 13:29:04 user nova-compute[231753]:     </features>
Jul 29 13:29:04 user nova-compute[231753]:   </guest>
Jul 29 13:29:04 user nova-compute[231753]:   <guest>
Jul 29 13:29:04 user nova-compute[231753]:     <os_type>hvm</os_type>
Jul 29 13:29:04 user nova-compute[231753]:     <arch name='armv6l'>
Jul 29 13:29:04 user nova-compute[231753]:       <wordsize>32</wordsize>
Jul 29 13:29:04 user nova-compute[231753]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 29 13:29:04 user nova-compute[231753]:       <machine maxCpus='1'>integratorcp</machine>
Jul 29 13:29:04 user nova-compute[231753]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 29 13:29:04 user nova-compute[231753]:       <machine maxCpus='1'>borzoi</machine>
Jul 29 13:29:04 user nova-compute[231753]:       <machine maxCpus='1'>spitz</machine>
Jul 29 13:29:04 user nova-compute[231753]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 29 13:29:04 user nova-compute[231753]:       <machine maxCpus='2'>nuri</machine>
Jul 29 13:29:04 user nova-compute[231753]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 29 13:29:04 user nova-compute[231753]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 29 13:29:04 user nova-compute[231753]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 29 13:29:04 user nova-compute[231753]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 29 13:29:04 user nova-compute[231753]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 29 13:29:04 user nova-compute[231753]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 29 13:29:04 user nova-compute[231753]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 29 13:29:04 user nova-compute[231753]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 29 13:29:04 user nova-compute[231753]:       <machine maxCpus='2'>musca-b1</machine>
Jul 29 13:29:04 user nova-compute[231753]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 29 13:29:04 user nova-compute[231753]:       <machine maxCpus='1'>versatileab</machine>
Jul 29 13:29:04 user nova-compute[231753]:       <machine maxCpus='1'>kzm</machine>
Jul 29 13:29:04 user nova-compute[231753]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 29 13:29:04 user nova-compute[231753]:       <machine maxCpus='2'>musca-a</machine>
Jul 29 13:29:04 user nova-compute[231753]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 29 13:29:04 user nova-compute[231753]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 29 13:29:04 user nova-compute[231753]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 29 13:29:04 user nova-compute[231753]:       <machine maxCpus='2'>smdkc210</machine>
Jul 29 13:29:04 user nova-compute[231753]:       <machine maxCpus='1'>sx1</machine>
Jul 29 13:29:04 user nova-compute[231753]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 29 13:29:04 user nova-compute[231753]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 29 13:29:04 user nova-compute[231753]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>z2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>tosa</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='4'>sabrelite</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>realview-eb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>n810</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>n800</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>versatilepb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>terrier</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>mainstone</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='4'>midway</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>musicpal</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>microbit</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>cubieboard</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>verdex</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>netduino2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='4'>raspi2b</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>cheetah</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='4'>highbank</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>akita</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>connex</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>collie</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>raspi0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <domain type='qemu'/>
Jul 29 13:29:05 user nova-compute[231753]:     </arch>
Jul 29 13:29:05 user nova-compute[231753]:     <features>
Jul 29 13:29:05 user nova-compute[231753]:       <cpuselection/>
Jul 29 13:29:05 user nova-compute[231753]:       <deviceboot/>
Jul 29 13:29:05 user nova-compute[231753]:       <disksnapshot default='on' toggle='no'/>
Jul 29 13:29:05 user nova-compute[231753]:     </features>
Jul 29 13:29:05 user nova-compute[231753]:   </guest>
Jul 29 13:29:05 user nova-compute[231753]:   <guest>
Jul 29 13:29:05 user nova-compute[231753]:     <os_type>hvm</os_type>
Jul 29 13:29:05 user nova-compute[231753]:     <arch name='armv7l'>
Jul 29 13:29:05 user nova-compute[231753]:       <wordsize>32</wordsize>
Jul 29 13:29:05 user nova-compute[231753]:       <emulator>/usr/bin/qemu-system-arm</emulator>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>integratorcp</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>borzoi</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>spitz</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>nuri</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>musca-b1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>versatileab</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>kzm</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>musca-a</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>smdkc210</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>sx1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>z2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>tosa</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='4'>sabrelite</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>realview-eb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>n810</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>n800</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>versatilepb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>terrier</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>mainstone</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='4'>midway</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>musicpal</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>microbit</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>cubieboard</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>verdex</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>netduino2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='4'>raspi2b</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>cheetah</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='4'>highbank</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>akita</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>connex</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>collie</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>raspi0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <domain type='qemu'/>
Jul 29 13:29:05 user nova-compute[231753]:     </arch>
Jul 29 13:29:05 user nova-compute[231753]:     <features>
Jul 29 13:29:05 user nova-compute[231753]:       <cpuselection/>
Jul 29 13:29:05 user nova-compute[231753]:       <deviceboot/>
Jul 29 13:29:05 user nova-compute[231753]:       <disksnapshot default='on' toggle='no'/>
Jul 29 13:29:05 user nova-compute[231753]:     </features>
Jul 29 13:29:05 user nova-compute[231753]:   </guest>
Jul 29 13:29:05 user nova-compute[231753]:   <guest>
Jul 29 13:29:05 user nova-compute[231753]:     <os_type>hvm</os_type>
Jul 29 13:29:05 user nova-compute[231753]:     <arch name='aarch64'>
Jul 29 13:29:05 user nova-compute[231753]:       <wordsize>64</wordsize>
Jul 29 13:29:05 user nova-compute[231753]:       <emulator>/usr/bin/qemu-system-aarch64</emulator>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>integratorcp</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>ast2600-evb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>borzoi</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>spitz</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>virt-2.7</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>nuri</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>mcimx7d-sabre</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>romulus-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='512'>virt-3.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='512'>virt-5.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>npcm750-evb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>virt-2.10</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>rainier-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>mps3-an547</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>virt-2.8</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>musca-b1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='4'>realview-pbx-a9</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>versatileab</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>kzm</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>musca-a</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='512'>virt-3.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>mcimx6ul-evk</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='512'>virt-5.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>smdkc210</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>sx1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>virt-2.11</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>imx25-pdk</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>stm32vldiscovery</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>virt-2.9</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='4'>orangepi-pc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>quanta-q71l-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>z2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='512'>virt-5.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>xilinx-zynq-a9</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='6'>xlnx-zcu102</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>tosa</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>mps2-an500</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>virt-2.12</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>mps2-an521</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='4'>sabrelite</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>mps2-an511</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>canon-a1100</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>realview-eb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>quanta-gbs-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>emcraft-sf2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>realview-pb-a8</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='512'>sbsa-ref</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='512'>virt-4.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>raspi1ap</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>palmetto-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>sx1-v1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>n810</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>g220a-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>n800</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>tacoma-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='512'>virt-4.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>quanta-gsj</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>versatilepb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>terrier</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>mainstone</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='4'>realview-eb-mpcore</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>supermicrox11-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='512'>virt-4.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>witherspoon-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>mps3-an524</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1' deprecated='yes'>swift-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>kudo-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='4'>vexpress-a9</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='4'>midway</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>musicpal</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>lm3s811evb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>lm3s6965evb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>microbit</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>mps2-an505</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>mps2-an385</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='512'>virt-6.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='4'>raspi3ap</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>cubieboard</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>verdex</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>netduino2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>xlnx-versal-virt</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>mps2-an386</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='512'>virt-6.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='4'>raspi3b</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='4'>raspi2b</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='4'>vexpress-a15</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2'>fuji-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='512'>virt-6.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine canonical='virt-6.2' maxCpus='512'>virt</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>sonorapass-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>cheetah</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>virt-2.6</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>ast2500-evb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='4'>highbank</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>akita</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>connex</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>netduinoplus2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>collie</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>raspi0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>fp5280g2-bmc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <domain type='qemu'/>
Jul 29 13:29:05 user nova-compute[231753]:     </arch>
Jul 29 13:29:05 user nova-compute[231753]:     <features>
Jul 29 13:29:05 user nova-compute[231753]:       <acpi default='on' toggle='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:       <cpuselection/>
Jul 29 13:29:05 user nova-compute[231753]:       <deviceboot/>
Jul 29 13:29:05 user nova-compute[231753]:       <disksnapshot default='on' toggle='no'/>
Jul 29 13:29:05 user nova-compute[231753]:     </features>
Jul 29 13:29:05 user nova-compute[231753]:   </guest>
Jul 29 13:29:05 user nova-compute[231753]:   <guest>
Jul 29 13:29:05 user nova-compute[231753]:     <os_type>hvm</os_type>
Jul 29 13:29:05 user nova-compute[231753]:     <arch name='cris'>
Jul 29 13:29:05 user nova-compute[231753]:       <wordsize>32</wordsize>
Jul 29 13:29:05 user nova-compute[231753]:       <emulator>/usr/bin/qemu-system-cris</emulator>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>axis-dev88</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <domain type='qemu'/>
Jul 29 13:29:05 user nova-compute[231753]:     </arch>
Jul 29 13:29:05 user nova-compute[231753]:     <features>
Jul 29 13:29:05 user nova-compute[231753]:       <cpuselection/>
Jul 29 13:29:05 user nova-compute[231753]:       <deviceboot/>
Jul 29 13:29:05 user nova-compute[231753]:       <disksnapshot default='on' toggle='no'/>
Jul 29 13:29:05 user nova-compute[231753]:     </features>
Jul 29 13:29:05 user nova-compute[231753]:   </guest>
Jul 29 13:29:05 user nova-compute[231753]:   <guest>
Jul 29 13:29:05 user nova-compute[231753]:     <os_type>hvm</os_type>
Jul 29 13:29:05 user nova-compute[231753]:     <arch name='i686'>
Jul 29 13:29:05 user nova-compute[231753]:       <wordsize>32</wordsize>
Jul 29 13:29:05 user nova-compute[231753]:       <emulator>/usr/bin/qemu-system-i386</emulator>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>x-remote</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>isapc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>microvm</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <domain type='qemu'/>
Jul 29 13:29:05 user nova-compute[231753]:       <domain type='kvm'/>
Jul 29 13:29:05 user nova-compute[231753]:     </arch>
Jul 29 13:29:05 user nova-compute[231753]:     <features>
Jul 29 13:29:05 user nova-compute[231753]:       <pae/>
Jul 29 13:29:05 user nova-compute[231753]:       <nonpae/>
Jul 29 13:29:05 user nova-compute[231753]:       <acpi default='on' toggle='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:       <apic default='on' toggle='no'/>
Jul 29 13:29:05 user nova-compute[231753]:       <cpuselection/>
Jul 29 13:29:05 user nova-compute[231753]:       <deviceboot/>
Jul 29 13:29:05 user nova-compute[231753]:       <disksnapshot default='on' toggle='no'/>
Jul 29 13:29:05 user nova-compute[231753]:     </features>
Jul 29 13:29:05 user nova-compute[231753]:   </guest>
Jul 29 13:29:05 user nova-compute[231753]:   <guest>
Jul 29 13:29:05 user nova-compute[231753]:     <os_type>hvm</os_type>
Jul 29 13:29:05 user nova-compute[231753]:     <arch name='m68k'>
Jul 29 13:29:05 user nova-compute[231753]:       <wordsize>32</wordsize>
Jul 29 13:29:05 user nova-compute[231753]:       <emulator>/usr/bin/qemu-system-m68k</emulator>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>mcf5208evb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>an5206</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>virt-6.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>q800</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>virt-6.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine canonical='virt-6.2' maxCpus='1'>virt</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>next-cube</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>virt-6.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <domain type='qemu'/>
Jul 29 13:29:05 user nova-compute[231753]:     </arch>
Jul 29 13:29:05 user nova-compute[231753]:     <features>
Jul 29 13:29:05 user nova-compute[231753]:       <cpuselection/>
Jul 29 13:29:05 user nova-compute[231753]:       <deviceboot/>
Jul 29 13:29:05 user nova-compute[231753]:       <disksnapshot default='on' toggle='no'/>
Jul 29 13:29:05 user nova-compute[231753]:     </features>
Jul 29 13:29:05 user nova-compute[231753]:   </guest>
Jul 29 13:29:05 user nova-compute[231753]:   <guest>
Jul 29 13:29:05 user nova-compute[231753]:     <os_type>hvm</os_type>
Jul 29 13:29:05 user nova-compute[231753]:     <arch name='microblaze'>
Jul 29 13:29:05 user nova-compute[231753]:       <wordsize>32</wordsize>
Jul 29 13:29:05 user nova-compute[231753]:       <emulator>/usr/bin/qemu-system-microblaze</emulator>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <domain type='qemu'/>
Jul 29 13:29:05 user nova-compute[231753]:     </arch>
Jul 29 13:29:05 user nova-compute[231753]:     <features>
Jul 29 13:29:05 user nova-compute[231753]:       <cpuselection/>
Jul 29 13:29:05 user nova-compute[231753]:       <deviceboot/>
Jul 29 13:29:05 user nova-compute[231753]:       <disksnapshot default='on' toggle='no'/>
Jul 29 13:29:05 user nova-compute[231753]:     </features>
Jul 29 13:29:05 user nova-compute[231753]:   </guest>
Jul 29 13:29:05 user nova-compute[231753]:   <guest>
Jul 29 13:29:05 user nova-compute[231753]:     <os_type>hvm</os_type>
Jul 29 13:29:05 user nova-compute[231753]:     <arch name='microblazeel'>
Jul 29 13:29:05 user nova-compute[231753]:       <wordsize>32</wordsize>
Jul 29 13:29:05 user nova-compute[231753]:       <emulator>/usr/bin/qemu-system-microblazeel</emulator>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>petalogix-s3adsp1800</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>petalogix-ml605</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>xlnx-zynqmp-pmu</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <domain type='qemu'/>
Jul 29 13:29:05 user nova-compute[231753]:     </arch>
Jul 29 13:29:05 user nova-compute[231753]:     <features>
Jul 29 13:29:05 user nova-compute[231753]:       <cpuselection/>
Jul 29 13:29:05 user nova-compute[231753]:       <deviceboot/>
Jul 29 13:29:05 user nova-compute[231753]:       <disksnapshot default='on' toggle='no'/>
Jul 29 13:29:05 user nova-compute[231753]:     </features>
Jul 29 13:29:05 user nova-compute[231753]:   </guest>
Jul 29 13:29:05 user nova-compute[231753]:   <guest>
Jul 29 13:29:05 user nova-compute[231753]:     <os_type>hvm</os_type>
Jul 29 13:29:05 user nova-compute[231753]:     <arch name='mips'>
Jul 29 13:29:05 user nova-compute[231753]:       <wordsize>32</wordsize>
Jul 29 13:29:05 user nova-compute[231753]:       <emulator>/usr/bin/qemu-system-mips</emulator>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='16'>malta</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>mipssim</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <domain type='qemu'/>
Jul 29 13:29:05 user nova-compute[231753]:     </arch>
Jul 29 13:29:05 user nova-compute[231753]:     <features>
Jul 29 13:29:05 user nova-compute[231753]:       <cpuselection/>
Jul 29 13:29:05 user nova-compute[231753]:       <deviceboot/>
Jul 29 13:29:05 user nova-compute[231753]:       <disksnapshot default='on' toggle='no'/>
Jul 29 13:29:05 user nova-compute[231753]:     </features>
Jul 29 13:29:05 user nova-compute[231753]:   </guest>
Jul 29 13:29:05 user nova-compute[231753]:   <guest>
Jul 29 13:29:05 user nova-compute[231753]:     <os_type>hvm</os_type>
Jul 29 13:29:05 user nova-compute[231753]:     <arch name='mipsel'>
Jul 29 13:29:05 user nova-compute[231753]:       <wordsize>32</wordsize>
Jul 29 13:29:05 user nova-compute[231753]:       <emulator>/usr/bin/qemu-system-mipsel</emulator>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='16'>malta</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>mipssim</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <domain type='qemu'/>
Jul 29 13:29:05 user nova-compute[231753]:     </arch>
Jul 29 13:29:05 user nova-compute[231753]:     <features>
Jul 29 13:29:05 user nova-compute[231753]:       <cpuselection/>
Jul 29 13:29:05 user nova-compute[231753]:       <deviceboot/>
Jul 29 13:29:05 user nova-compute[231753]:       <disksnapshot default='on' toggle='no'/>
Jul 29 13:29:05 user nova-compute[231753]:     </features>
Jul 29 13:29:05 user nova-compute[231753]:   </guest>
Jul 29 13:29:05 user nova-compute[231753]:   <guest>
Jul 29 13:29:05 user nova-compute[231753]:     <os_type>hvm</os_type>
Jul 29 13:29:05 user nova-compute[231753]:     <arch name='mips64'>
Jul 29 13:29:05 user nova-compute[231753]:       <wordsize>64</wordsize>
Jul 29 13:29:05 user nova-compute[231753]:       <emulator>/usr/bin/qemu-system-mips64</emulator>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='16'>malta</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>mipssim</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>pica61</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>magnum</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <domain type='qemu'/>
Jul 29 13:29:05 user nova-compute[231753]:     </arch>
Jul 29 13:29:05 user nova-compute[231753]:     <features>
Jul 29 13:29:05 user nova-compute[231753]:       <cpuselection/>
Jul 29 13:29:05 user nova-compute[231753]:       <deviceboot/>
Jul 29 13:29:05 user nova-compute[231753]:       <disksnapshot default='on' toggle='no'/>
Jul 29 13:29:05 user nova-compute[231753]:     </features>
Jul 29 13:29:05 user nova-compute[231753]:   </guest>
Jul 29 13:29:05 user nova-compute[231753]:   <guest>
Jul 29 13:29:05 user nova-compute[231753]:     <os_type>hvm</os_type>
Jul 29 13:29:05 user nova-compute[231753]:     <arch name='mips64el'>
Jul 29 13:29:05 user nova-compute[231753]:       <wordsize>64</wordsize>
Jul 29 13:29:05 user nova-compute[231753]:       <emulator>/usr/bin/qemu-system-mips64el</emulator>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='16'>malta</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='16'>loongson3-virt</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>mipssim</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>pica61</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>magnum</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='16'>boston</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>fuloong2e</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <domain type='qemu'/>
Jul 29 13:29:05 user nova-compute[231753]:     </arch>
Jul 29 13:29:05 user nova-compute[231753]:     <features>
Jul 29 13:29:05 user nova-compute[231753]:       <cpuselection/>
Jul 29 13:29:05 user nova-compute[231753]:       <deviceboot/>
Jul 29 13:29:05 user nova-compute[231753]:       <disksnapshot default='on' toggle='no'/>
Jul 29 13:29:05 user nova-compute[231753]:     </features>
Jul 29 13:29:05 user nova-compute[231753]:   </guest>
Jul 29 13:29:05 user nova-compute[231753]:   <guest>
Jul 29 13:29:05 user nova-compute[231753]:     <os_type>hvm</os_type>
Jul 29 13:29:05 user nova-compute[231753]:     <arch name='ppc'>
Jul 29 13:29:05 user nova-compute[231753]:       <wordsize>32</wordsize>
Jul 29 13:29:05 user nova-compute[231753]:       <emulator>/usr/bin/qemu-system-ppc</emulator>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>g3beige</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>mac99</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='32'>ppce500</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>pegasos2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>sam460ex</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>bamboo</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>40p</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>ref405ep</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>taihu</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <domain type='qemu'/>
Jul 29 13:29:05 user nova-compute[231753]:     </arch>
Jul 29 13:29:05 user nova-compute[231753]:     <features>
Jul 29 13:29:05 user nova-compute[231753]:       <cpuselection/>
Jul 29 13:29:05 user nova-compute[231753]:       <deviceboot/>
Jul 29 13:29:05 user nova-compute[231753]:       <disksnapshot default='on' toggle='no'/>
Jul 29 13:29:05 user nova-compute[231753]:     </features>
Jul 29 13:29:05 user nova-compute[231753]:   </guest>
Jul 29 13:29:05 user nova-compute[231753]:   <guest>
Jul 29 13:29:05 user nova-compute[231753]:     <os_type>hvm</os_type>
Jul 29 13:29:05 user nova-compute[231753]:     <arch name='ppc64'>
Jul 29 13:29:05 user nova-compute[231753]:       <wordsize>64</wordsize>
Jul 29 13:29:05 user nova-compute[231753]:       <emulator>/usr/bin/qemu-system-ppc64</emulator>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2048'>powernv9</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>taihu</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2048'>powernv10</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='32'>ppce500</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>40p</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>pegasos2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>bamboo</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>g3beige</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>mac99</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>sam460ex</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>ref405ep</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2048'>powernv8</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <domain type='qemu'/>
Jul 29 13:29:05 user nova-compute[231753]:     </arch>
Jul 29 13:29:05 user nova-compute[231753]:     <features>
Jul 29 13:29:05 user nova-compute[231753]:       <cpuselection/>
Jul 29 13:29:05 user nova-compute[231753]:       <deviceboot/>
Jul 29 13:29:05 user nova-compute[231753]:       <disksnapshot default='on' toggle='no'/>
Jul 29 13:29:05 user nova-compute[231753]:     </features>
Jul 29 13:29:05 user nova-compute[231753]:   </guest>
Jul 29 13:29:05 user nova-compute[231753]:   <guest>
Jul 29 13:29:05 user nova-compute[231753]:     <os_type>hvm</os_type>
Jul 29 13:29:05 user nova-compute[231753]:     <arch name='ppc64le'>
Jul 29 13:29:05 user nova-compute[231753]:       <wordsize>64</wordsize>
Jul 29 13:29:05 user nova-compute[231753]:       <emulator>/usr/bin/qemu-system-ppc64le</emulator>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-jammy</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine canonical='pseries-jammy' maxCpus='2147483647'>pseries</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2048'>powernv9</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine canonical='powernv9' maxCpus='2048'>powernv</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>taihu</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-4.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='15'>mpc8544ds</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-6.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-2.5</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2048'>powernv10</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-xenial</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-4.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-6.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-yakkety</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-2.6</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='32'>ppce500</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-bionic-sxxm</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-2.7</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-3.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-5.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>40p</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-2.8</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>pegasos2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-hirsute</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-3.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-5.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-eoan</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-2.9</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-zesty</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>bamboo</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-groovy</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-focal</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>g3beige</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-5.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-disco</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-2.12-sxxm</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-2.10</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>virtex-ml507</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-2.11</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-2.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-cosmic</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-bionic</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-2.12</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-2.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>mac99</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-impish</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-artful</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>sam460ex</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>ref405ep</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-2.3</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2048'>powernv8</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-4.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-6.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='2147483647'>pseries-2.4</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <domain type='qemu'/>
Jul 29 13:29:05 user nova-compute[231753]:     </arch>
Jul 29 13:29:05 user nova-compute[231753]:     <features>
Jul 29 13:29:05 user nova-compute[231753]:       <cpuselection/>
Jul 29 13:29:05 user nova-compute[231753]:       <deviceboot/>
Jul 29 13:29:05 user nova-compute[231753]:       <disksnapshot default='on' toggle='no'/>
Jul 29 13:29:05 user nova-compute[231753]:     </features>
Jul 29 13:29:05 user nova-compute[231753]:   </guest>
Jul 29 13:29:05 user nova-compute[231753]:   <guest>
Jul 29 13:29:05 user nova-compute[231753]:     <os_type>hvm</os_type>
Jul 29 13:29:05 user nova-compute[231753]:     <arch name='riscv32'>
Jul 29 13:29:05 user nova-compute[231753]:       <wordsize>32</wordsize>
Jul 29 13:29:05 user nova-compute[231753]:       <emulator>/usr/bin/qemu-system-riscv32</emulator>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='8'>spike</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>opentitan</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='5'>sifive_u</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>sifive_e</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='8'>virt</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <domain type='qemu'/>
Jul 29 13:29:05 user nova-compute[231753]:     </arch>
Jul 29 13:29:05 user nova-compute[231753]:     <features>
Jul 29 13:29:05 user nova-compute[231753]:       <cpuselection/>
Jul 29 13:29:05 user nova-compute[231753]:       <deviceboot/>
Jul 29 13:29:05 user nova-compute[231753]:       <disksnapshot default='on' toggle='no'/>
Jul 29 13:29:05 user nova-compute[231753]:     </features>
Jul 29 13:29:05 user nova-compute[231753]:   </guest>
Jul 29 13:29:05 user nova-compute[231753]:   <guest>
Jul 29 13:29:05 user nova-compute[231753]:     <os_type>hvm</os_type>
Jul 29 13:29:05 user nova-compute[231753]:     <arch name='riscv64'>
Jul 29 13:29:05 user nova-compute[231753]:       <wordsize>64</wordsize>
Jul 29 13:29:05 user nova-compute[231753]:       <emulator>/usr/bin/qemu-system-riscv64</emulator>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='8'>spike</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='5'>microchip-icicle-kit</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='5'>sifive_u</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>shakti_c</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>sifive_e</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='8'>virt</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <domain type='qemu'/>
Jul 29 13:29:05 user nova-compute[231753]:     </arch>
Jul 29 13:29:05 user nova-compute[231753]:     <features>
Jul 29 13:29:05 user nova-compute[231753]:       <cpuselection/>
Jul 29 13:29:05 user nova-compute[231753]:       <deviceboot/>
Jul 29 13:29:05 user nova-compute[231753]:       <disksnapshot default='on' toggle='no'/>
Jul 29 13:29:05 user nova-compute[231753]:     </features>
Jul 29 13:29:05 user nova-compute[231753]:   </guest>
Jul 29 13:29:05 user nova-compute[231753]:   <guest>
Jul 29 13:29:05 user nova-compute[231753]:     <os_type>hvm</os_type>
Jul 29 13:29:05 user nova-compute[231753]:     <arch name='s390x'>
Jul 29 13:29:05 user nova-compute[231753]:       <wordsize>64</wordsize>
Jul 29 13:29:05 user nova-compute[231753]:       <emulator>/usr/bin/qemu-system-s390x</emulator>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='248'>s390-ccw-virtio-jammy</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine canonical='s390-ccw-virtio-jammy' maxCpus='248'>s390-ccw-virtio</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='248'>s390-ccw-virtio-4.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='248'>s390-ccw-virtio-5.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='248'>s390-ccw-virtio-artful</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='248'>s390-ccw-virtio-3.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='248'>s390-ccw-virtio-groovy</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='248'>s390-ccw-virtio-hirsute</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='248'>s390-ccw-virtio-disco</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='248'>s390-ccw-virtio-2.12</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='248'>s390-ccw-virtio-2.6</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='248'>s390-ccw-virtio-yakkety</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='248'>s390-ccw-virtio-eoan</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='248'>s390-ccw-virtio-2.9</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='248'>s390-ccw-virtio-6.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='248'>s390-ccw-virtio-5.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='248'>s390-ccw-virtio-3.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='248'>s390-ccw-virtio-4.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='248'>s390-ccw-virtio-2.5</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='248'>s390-ccw-virtio-2.11</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='248'>s390-ccw-virtio-xenial</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='248'>s390-ccw-virtio-focal</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='248'>s390-ccw-virtio-2.8</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='248'>s390-ccw-virtio-impish</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='248'>s390-ccw-virtio-bionic</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='248'>s390-ccw-virtio-5.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='248'>s390-ccw-virtio-6.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='248'>s390-ccw-virtio-zesty</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='248'>s390-ccw-virtio-4.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='248'>s390-ccw-virtio-cosmic</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='248'>s390-ccw-virtio-2.4</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='248'>s390-ccw-virtio-2.10</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='248'>s390-ccw-virtio-2.7</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='248'>s390-ccw-virtio-6.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <domain type='qemu'/>
Jul 29 13:29:05 user nova-compute[231753]:     </arch>
Jul 29 13:29:05 user nova-compute[231753]:     <features>
Jul 29 13:29:05 user nova-compute[231753]:       <cpuselection/>
Jul 29 13:29:05 user nova-compute[231753]:       <deviceboot/>
Jul 29 13:29:05 user nova-compute[231753]:       <disksnapshot default='on' toggle='no'/>
Jul 29 13:29:05 user nova-compute[231753]:     </features>
Jul 29 13:29:05 user nova-compute[231753]:   </guest>
Jul 29 13:29:05 user nova-compute[231753]:   <guest>
Jul 29 13:29:05 user nova-compute[231753]:     <os_type>hvm</os_type>
Jul 29 13:29:05 user nova-compute[231753]:     <arch name='sh4'>
Jul 29 13:29:05 user nova-compute[231753]:       <wordsize>32</wordsize>
Jul 29 13:29:05 user nova-compute[231753]:       <emulator>/usr/bin/qemu-system-sh4</emulator>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>shix</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>r2d</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <domain type='qemu'/>
Jul 29 13:29:05 user nova-compute[231753]:     </arch>
Jul 29 13:29:05 user nova-compute[231753]:     <features>
Jul 29 13:29:05 user nova-compute[231753]:       <cpuselection/>
Jul 29 13:29:05 user nova-compute[231753]:       <deviceboot/>
Jul 29 13:29:05 user nova-compute[231753]:       <disksnapshot default='on' toggle='no'/>
Jul 29 13:29:05 user nova-compute[231753]:     </features>
Jul 29 13:29:05 user nova-compute[231753]:   </guest>
Jul 29 13:29:05 user nova-compute[231753]:   <guest>
Jul 29 13:29:05 user nova-compute[231753]:     <os_type>hvm</os_type>
Jul 29 13:29:05 user nova-compute[231753]:     <arch name='sh4eb'>
Jul 29 13:29:05 user nova-compute[231753]:       <wordsize>64</wordsize>
Jul 29 13:29:05 user nova-compute[231753]:       <emulator>/usr/bin/qemu-system-sh4eb</emulator>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>shix</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>r2d</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <domain type='qemu'/>
Jul 29 13:29:05 user nova-compute[231753]:     </arch>
Jul 29 13:29:05 user nova-compute[231753]:     <features>
Jul 29 13:29:05 user nova-compute[231753]:       <cpuselection/>
Jul 29 13:29:05 user nova-compute[231753]:       <deviceboot/>
Jul 29 13:29:05 user nova-compute[231753]:       <disksnapshot default='on' toggle='no'/>
Jul 29 13:29:05 user nova-compute[231753]:     </features>
Jul 29 13:29:05 user nova-compute[231753]:   </guest>
Jul 29 13:29:05 user nova-compute[231753]:   <guest>
Jul 29 13:29:05 user nova-compute[231753]:     <os_type>hvm</os_type>
Jul 29 13:29:05 user nova-compute[231753]:     <arch name='sparc'>
Jul 29 13:29:05 user nova-compute[231753]:       <wordsize>32</wordsize>
Jul 29 13:29:05 user nova-compute[231753]:       <emulator>/usr/bin/qemu-system-sparc</emulator>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>SS-5</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='4'>SS-20</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>LX</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>SPARCClassic</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>leon3_generic</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>SPARCbook</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>SS-4</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='4'>SS-600MP</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='4'>SS-10</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>Voyager</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <domain type='qemu'/>
Jul 29 13:29:05 user nova-compute[231753]:     </arch>
Jul 29 13:29:05 user nova-compute[231753]:     <features>
Jul 29 13:29:05 user nova-compute[231753]:       <cpuselection/>
Jul 29 13:29:05 user nova-compute[231753]:       <deviceboot/>
Jul 29 13:29:05 user nova-compute[231753]:       <disksnapshot default='on' toggle='no'/>
Jul 29 13:29:05 user nova-compute[231753]:     </features>
Jul 29 13:29:05 user nova-compute[231753]:   </guest>
Jul 29 13:29:05 user nova-compute[231753]:   <guest>
Jul 29 13:29:05 user nova-compute[231753]:     <os_type>hvm</os_type>
Jul 29 13:29:05 user nova-compute[231753]:     <arch name='sparc64'>
Jul 29 13:29:05 user nova-compute[231753]:       <wordsize>64</wordsize>
Jul 29 13:29:05 user nova-compute[231753]:       <emulator>/usr/bin/qemu-system-sparc64</emulator>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>sun4u</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>niagara</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>sun4v</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <domain type='qemu'/>
Jul 29 13:29:05 user nova-compute[231753]:     </arch>
Jul 29 13:29:05 user nova-compute[231753]:     <features>
Jul 29 13:29:05 user nova-compute[231753]:       <cpuselection/>
Jul 29 13:29:05 user nova-compute[231753]:       <deviceboot/>
Jul 29 13:29:05 user nova-compute[231753]:       <disksnapshot default='on' toggle='no'/>
Jul 29 13:29:05 user nova-compute[231753]:     </features>
Jul 29 13:29:05 user nova-compute[231753]:   </guest>
Jul 29 13:29:05 user nova-compute[231753]:   <guest>
Jul 29 13:29:05 user nova-compute[231753]:     <os_type>hvm</os_type>
Jul 29 13:29:05 user nova-compute[231753]:     <arch name='x86_64'>
Jul 29 13:29:05 user nova-compute[231753]:       <wordsize>64</wordsize>
Jul 29 13:29:05 user nova-compute[231753]:       <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-jammy</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine canonical='pc-i440fx-jammy' maxCpus='255'>ubuntu</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-impish-hpb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-5.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-2.12</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-2.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-xenial</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-6.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine canonical='pc-i440fx-6.2' maxCpus='255'>pc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-4.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-2.5</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-4.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-hirsute</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-focal</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-q35-xenial</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-jammy-hpb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-5.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-1.5</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-q35-2.7</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-eoan-hpb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-zesty</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-disco-hpb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-groovy</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-groovy</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-artful</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-trusty</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-2.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-focal-hpb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-eoan-hpb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-bionic-hpb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-artful</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-2.7</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-6.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-yakkety</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-q35-2.4</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-cosmic-hpb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-2.10</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>x-remote</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-5.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-1.7</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-2.9</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-2.11</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-3.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-6.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-4.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-jammy</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine canonical='pc-q35-jammy' maxCpus='288'>ubuntu-q35</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-2.4</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-4.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-eoan</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-jammy-hpb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-5.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-2.9</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-bionic-hpb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='1'>isapc</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-1.4</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-cosmic</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-q35-2.6</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-3.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-bionic</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-disco-hpb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-cosmic</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-2.12</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-bionic</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-groovy-hpb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-disco</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-cosmic-hpb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-2.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-wily</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-impish</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-2.6</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-6.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-impish</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-impish-hpb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-hirsute</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-4.0.1</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-hirsute-hpb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-1.6</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-5.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-2.8</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-2.10</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-3.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-zesty</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-4.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-focal</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>microvm</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-6.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-2.3</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-disco</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-focal-hpb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-4.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-groovy-hpb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-hirsute-hpb</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-5.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-2.8</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-6.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine canonical='pc-q35-6.2' maxCpus='288'>q35</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-eoan</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-q35-2.5</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-i440fx-3.0</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='255'>pc-q35-yakkety</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='288'>pc-q35-2.11</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <domain type='qemu'/>
Jul 29 13:29:05 user nova-compute[231753]:       <domain type='kvm'/>
Jul 29 13:29:05 user nova-compute[231753]:     </arch>
Jul 29 13:29:05 user nova-compute[231753]:     <features>
Jul 29 13:29:05 user nova-compute[231753]:       <acpi default='on' toggle='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:       <apic default='on' toggle='no'/>
Jul 29 13:29:05 user nova-compute[231753]:       <cpuselection/>
Jul 29 13:29:05 user nova-compute[231753]:       <deviceboot/>
Jul 29 13:29:05 user nova-compute[231753]:       <disksnapshot default='on' toggle='no'/>
Jul 29 13:29:05 user nova-compute[231753]:     </features>
Jul 29 13:29:05 user nova-compute[231753]:   </guest>
Jul 29 13:29:05 user nova-compute[231753]:   <guest>
Jul 29 13:29:05 user nova-compute[231753]:     <os_type>hvm</os_type>
Jul 29 13:29:05 user nova-compute[231753]:     <arch name='xtensa'>
Jul 29 13:29:05 user nova-compute[231753]:       <wordsize>32</wordsize>
Jul 29 13:29:05 user nova-compute[231753]:       <emulator>/usr/bin/qemu-system-xtensa</emulator>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='4'>sim</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='32'>kc705</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='32'>ml605</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='32'>virt</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='32'>lx200</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='32'>lx60</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <domain type='qemu'/>
Jul 29 13:29:05 user nova-compute[231753]:     </arch>
Jul 29 13:29:05 user nova-compute[231753]:     <features>
Jul 29 13:29:05 user nova-compute[231753]:       <cpuselection/>
Jul 29 13:29:05 user nova-compute[231753]:       <deviceboot/>
Jul 29 13:29:05 user nova-compute[231753]:       <disksnapshot default='on' toggle='no'/>
Jul 29 13:29:05 user nova-compute[231753]:     </features>
Jul 29 13:29:05 user nova-compute[231753]:   </guest>
Jul 29 13:29:05 user nova-compute[231753]:   <guest>
Jul 29 13:29:05 user nova-compute[231753]:     <os_type>hvm</os_type>
Jul 29 13:29:05 user nova-compute[231753]:     <arch name='xtensaeb'>
Jul 29 13:29:05 user nova-compute[231753]:       <wordsize>32</wordsize>
Jul 29 13:29:05 user nova-compute[231753]:       <emulator>/usr/bin/qemu-system-xtensaeb</emulator>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='4'>sim</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='32'>kc705</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='32'>ml605</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='32'>ml605-nommu</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='32'>virt</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='32'>lx60-nommu</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='32'>lx200</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='32'>lx200-nommu</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='32'>lx60</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <machine maxCpus='32'>kc705-nommu</machine>
Jul 29 13:29:05 user nova-compute[231753]:       <domain type='qemu'/>
Jul 29 13:29:05 user nova-compute[231753]:     </arch>
Jul 29 13:29:05 user nova-compute[231753]:     <features>
Jul 29 13:29:05 user nova-compute[231753]:       <cpuselection/>
Jul 29 13:29:05 user nova-compute[231753]:       <deviceboot/>
Jul 29 13:29:05 user nova-compute[231753]:       <disksnapshot default='on' toggle='no'/>
Jul 29 13:29:05 user nova-compute[231753]:     </features>
Jul 29 13:29:05 user nova-compute[231753]:   </guest>
Jul 29 13:29:05 user nova-compute[231753]: </capabilities>
Jul 29 13:29:05 user nova-compute[231753]: 
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=231753) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Error from libvirt when retrieving domain capabilities for arch alpha / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-alpha' on this host {{(pid=231753) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=231753) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=231753) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Error from libvirt when retrieving domain capabilities for arch armv6l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=231753) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=231753) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Error from libvirt when retrieving domain capabilities for arch armv7l / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-arm' on this host {{(pid=231753) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=231753) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Error from libvirt when retrieving domain capabilities for arch aarch64 / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-aarch64' on this host {{(pid=231753) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=231753) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Error from libvirt when retrieving domain capabilities for arch cris / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-cris' on this host {{(pid=231753) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'pc', 'ubuntu-q35', 'q35'} {{(pid=231753) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu:
Jul 29 13:29:05 user nova-compute[231753]: <domainCapabilities>
Jul 29 13:29:05 user nova-compute[231753]:   <path>/usr/bin/qemu-system-i386</path>
Jul 29 13:29:05 user nova-compute[231753]:   <domain>kvm</domain>
Jul 29 13:29:05 user nova-compute[231753]:   <machine>pc-i440fx-jammy</machine>
Jul 29 13:29:05 user nova-compute[231753]:   <arch>i686</arch>
Jul 29 13:29:05 user nova-compute[231753]:   <vcpu max='255'/>
Jul 29 13:29:05 user nova-compute[231753]:   <iothreads supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:   <os supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:     <enum name='firmware'/>
Jul 29 13:29:05 user nova-compute[231753]:     <loader supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 29 13:29:05 user nova-compute[231753]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 29 13:29:05 user nova-compute[231753]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 29 13:29:05 user nova-compute[231753]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 29 13:29:05 user nova-compute[231753]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='type'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>rom</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>pflash</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='readonly'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>yes</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>no</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='secure'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>no</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </loader>
Jul 29 13:29:05 user nova-compute[231753]:   </os>
Jul 29 13:29:05 user nova-compute[231753]:   <cpu>
Jul 29 13:29:05 user nova-compute[231753]:     <mode name='host-passthrough' supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='hostPassthroughMigratable'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>off</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </mode>
Jul 29 13:29:05 user nova-compute[231753]:     <mode name='maximum' supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='maximumMigratable'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>on</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>off</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </mode>
Jul 29 13:29:05 user nova-compute[231753]:     <mode name='host-model' supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <vendor>Intel</vendor>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='ss'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='vmx'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='pcid'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='hypervisor'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='arat'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='tsc_adjust'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='umip'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='md-clear'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='stibp'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='arch-capabilities'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='ssbd'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='ibpb'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='ibrs'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='amd-stibp'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='amd-ssbd'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='disable' name='erms'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='disable' name='xsaveopt'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='disable' name='lm'/>
Jul 29 13:29:05 user nova-compute[231753]:     </mode>
Jul 29 13:29:05 user nova-compute[231753]:     <mode name='custom' supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>qemu64</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>qemu32</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>phenom</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>pentium3</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>pentium2</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>pentium</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>n270</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>kvm64</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>kvm32</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>coreduo</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>core2duo</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>athlon</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Westmere-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Westmere</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Snowridge</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Server</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Client</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>SandyBridge</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Penryn</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Opteron_G5</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Opteron_G4</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Opteron_G3</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Opteron_G2</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Opteron_G1</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Nehalem-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Nehalem</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>IvyBridge</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Icelake-Server</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Haswell-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Haswell-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Haswell</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>EPYC-Rome</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>EPYC-Milan</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>EPYC-IBPB</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>EPYC</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Dhyana</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Cooperlake</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Conroe</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Cascadelake-Server</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Broadwell-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Broadwell-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Broadwell</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>486</model>
Jul 29 13:29:05 user nova-compute[231753]:     </mode>
Jul 29 13:29:05 user nova-compute[231753]:   </cpu>
Jul 29 13:29:05 user nova-compute[231753]:   <memoryBacking supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:     <enum name='sourceType'>
Jul 29 13:29:05 user nova-compute[231753]:       <value>file</value>
Jul 29 13:29:05 user nova-compute[231753]:       <value>anonymous</value>
Jul 29 13:29:05 user nova-compute[231753]:       <value>memfd</value>
Jul 29 13:29:05 user nova-compute[231753]:     </enum>
Jul 29 13:29:05 user nova-compute[231753]:   </memoryBacking>
Jul 29 13:29:05 user nova-compute[231753]:   <devices>
Jul 29 13:29:05 user nova-compute[231753]:     <disk supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='diskDevice'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>disk</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>cdrom</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>floppy</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>lun</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='bus'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>ide</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>fdc</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>scsi</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>usb</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>sata</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='model'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio-transitional</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio-non-transitional</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </disk>
Jul 29 13:29:05 user nova-compute[231753]:     <graphics supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='type'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>sdl</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>vnc</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>spice</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>egl-headless</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </graphics>
Jul 29 13:29:05 user nova-compute[231753]:     <video supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='modelType'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>vga</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>cirrus</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>vmvga</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>qxl</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>none</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>bochs</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>ramfb</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </video>
Jul 29 13:29:05 user nova-compute[231753]:     <hostdev supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='mode'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>subsystem</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='startupPolicy'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>default</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>mandatory</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>requisite</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>optional</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='subsysType'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>usb</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>pci</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>scsi</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='capsType'/>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='pciBackend'/>
Jul 29 13:29:05 user nova-compute[231753]:     </hostdev>
Jul 29 13:29:05 user nova-compute[231753]:     <rng supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='model'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio-transitional</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio-non-transitional</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='backendModel'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>random</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>egd</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>builtin</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </rng>
Jul 29 13:29:05 user nova-compute[231753]:     <filesystem supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='driverType'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>path</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>handle</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtiofs</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </filesystem>
Jul 29 13:29:05 user nova-compute[231753]:     <tpm supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='model'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>tpm-tis</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>tpm-crb</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='backendModel'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>passthrough</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>emulator</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </tpm>
Jul 29 13:29:05 user nova-compute[231753]:   </devices>
Jul 29 13:29:05 user nova-compute[231753]:   <features>
Jul 29 13:29:05 user nova-compute[231753]:     <gic supported='no'/>
Jul 29 13:29:05 user nova-compute[231753]:     <vmcoreinfo supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:     <genid supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:     <backingStoreInput supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:     <backup supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:     <sev supported='no'/>
Jul 29 13:29:05 user nova-compute[231753]:   </features>
Jul 29 13:29:05 user nova-compute[231753]: </domainCapabilities>
Jul 29 13:29:05 user nova-compute[231753]:  {{(pid=231753) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc:
Jul 29 13:29:05 user nova-compute[231753]: <domainCapabilities>
Jul 29 13:29:05 user nova-compute[231753]:   <path>/usr/bin/qemu-system-i386</path>
Jul 29 13:29:05 user nova-compute[231753]:   <domain>kvm</domain>
Jul 29 13:29:05 user nova-compute[231753]:   <machine>pc-i440fx-6.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:   <arch>i686</arch>
Jul 29 13:29:05 user nova-compute[231753]:   <vcpu max='255'/>
Jul 29 13:29:05 user nova-compute[231753]:   <iothreads supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:   <os supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:     <enum name='firmware'/>
Jul 29 13:29:05 user nova-compute[231753]:     <loader supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 29 13:29:05 user nova-compute[231753]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 29 13:29:05 user nova-compute[231753]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 29 13:29:05 user nova-compute[231753]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 29 13:29:05 user nova-compute[231753]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='type'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>rom</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>pflash</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='readonly'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>yes</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>no</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='secure'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>no</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </loader>
Jul 29 13:29:05 user nova-compute[231753]:   </os>
Jul 29 13:29:05 user nova-compute[231753]:   <cpu>
Jul 29 13:29:05 user nova-compute[231753]:     <mode name='host-passthrough' supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='hostPassthroughMigratable'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>off</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </mode>
Jul 29 13:29:05 user nova-compute[231753]:     <mode name='maximum' supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='maximumMigratable'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>on</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>off</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </mode>
Jul 29 13:29:05 user nova-compute[231753]:     <mode name='host-model' supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <vendor>Intel</vendor>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='ss'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='vmx'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='pcid'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='hypervisor'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='arat'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='tsc_adjust'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='umip'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='md-clear'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='stibp'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='arch-capabilities'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='ssbd'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='ibpb'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='ibrs'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='amd-stibp'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='amd-ssbd'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='disable' name='erms'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='disable' name='xsaveopt'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='disable' name='lm'/>
Jul 29 13:29:05 user nova-compute[231753]:     </mode>
Jul 29 13:29:05 user nova-compute[231753]:     <mode name='custom' supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>qemu64</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>qemu32</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>phenom</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>pentium3</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>pentium2</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>pentium</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>n270</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>kvm64</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>kvm32</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>coreduo</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>core2duo</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>athlon</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Westmere-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Westmere</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Snowridge</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Server</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Client</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>SandyBridge</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Penryn</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Opteron_G5</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Opteron_G4</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Opteron_G3</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Opteron_G2</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Opteron_G1</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Nehalem-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Nehalem</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>IvyBridge</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Icelake-Server</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Haswell-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Haswell-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Haswell</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>EPYC-Rome</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>EPYC-Milan</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>EPYC-IBPB</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>EPYC</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Dhyana</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Cooperlake</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Conroe</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Cascadelake-Server</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Broadwell-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Broadwell-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Broadwell</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>486</model>
Jul 29 13:29:05 user nova-compute[231753]:     </mode>
Jul 29 13:29:05 user nova-compute[231753]:   </cpu>
Jul 29 13:29:05 user nova-compute[231753]:   <memoryBacking supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:     <enum name='sourceType'>
Jul 29 13:29:05 user nova-compute[231753]:       <value>file</value>
Jul 29 13:29:05 user nova-compute[231753]:       <value>anonymous</value>
Jul 29 13:29:05 user nova-compute[231753]:       <value>memfd</value>
Jul 29 13:29:05 user nova-compute[231753]:     </enum>
Jul 29 13:29:05 user nova-compute[231753]:   </memoryBacking>
Jul 29 13:29:05 user nova-compute[231753]:   <devices>
Jul 29 13:29:05 user nova-compute[231753]:     <disk supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='diskDevice'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>disk</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>cdrom</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>floppy</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>lun</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='bus'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>ide</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>fdc</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>scsi</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>usb</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>sata</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='model'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio-transitional</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio-non-transitional</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </disk>
Jul 29 13:29:05 user nova-compute[231753]:     <graphics supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='type'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>sdl</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>vnc</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>spice</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>egl-headless</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </graphics>
Jul 29 13:29:05 user nova-compute[231753]:     <video supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='modelType'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>vga</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>cirrus</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>vmvga</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>qxl</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>none</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>bochs</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>ramfb</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </video>
Jul 29 13:29:05 user nova-compute[231753]:     <hostdev supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='mode'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>subsystem</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='startupPolicy'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>default</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>mandatory</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>requisite</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>optional</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='subsysType'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>usb</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>pci</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>scsi</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='capsType'/>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='pciBackend'/>
Jul 29 13:29:05 user nova-compute[231753]:     </hostdev>
Jul 29 13:29:05 user nova-compute[231753]:     <rng supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='model'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio-transitional</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio-non-transitional</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='backendModel'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>random</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>egd</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>builtin</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </rng>
Jul 29 13:29:05 user nova-compute[231753]:     <filesystem supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='driverType'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>path</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>handle</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtiofs</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </filesystem>
Jul 29 13:29:05 user nova-compute[231753]:     <tpm supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='model'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>tpm-tis</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>tpm-crb</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='backendModel'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>passthrough</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>emulator</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </tpm>
Jul 29 13:29:05 user nova-compute[231753]:   </devices>
Jul 29 13:29:05 user nova-compute[231753]:   <features>
Jul 29 13:29:05 user nova-compute[231753]:     <gic supported='no'/>
Jul 29 13:29:05 user nova-compute[231753]:     <vmcoreinfo supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:     <genid supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:     <backingStoreInput supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:     <backup supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:     <sev supported='no'/>
Jul 29 13:29:05 user nova-compute[231753]:   </features>
Jul 29 13:29:05 user nova-compute[231753]: </domainCapabilities>
Jul 29 13:29:05 user nova-compute[231753]:  {{(pid=231753) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35:
Jul 29 13:29:05 user nova-compute[231753]: <domainCapabilities>
Jul 29 13:29:05 user nova-compute[231753]:   <path>/usr/bin/qemu-system-i386</path>
Jul 29 13:29:05 user nova-compute[231753]:   <domain>kvm</domain>
Jul 29 13:29:05 user nova-compute[231753]:   <machine>pc-q35-jammy</machine>
Jul 29 13:29:05 user nova-compute[231753]:   <arch>i686</arch>
Jul 29 13:29:05 user nova-compute[231753]:   <vcpu max='288'/>
Jul 29 13:29:05 user nova-compute[231753]:   <iothreads supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:   <os supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:     <enum name='firmware'/>
Jul 29 13:29:05 user nova-compute[231753]:     <loader supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 29 13:29:05 user nova-compute[231753]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 29 13:29:05 user nova-compute[231753]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 29 13:29:05 user nova-compute[231753]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 29 13:29:05 user nova-compute[231753]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='type'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>rom</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>pflash</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='readonly'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>yes</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>no</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='secure'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>no</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </loader>
Jul 29 13:29:05 user nova-compute[231753]:   </os>
Jul 29 13:29:05 user nova-compute[231753]:   <cpu>
Jul 29 13:29:05 user nova-compute[231753]:     <mode name='host-passthrough' supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='hostPassthroughMigratable'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>off</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </mode>
Jul 29 13:29:05 user nova-compute[231753]:     <mode name='maximum' supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='maximumMigratable'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>on</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>off</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </mode>
Jul 29 13:29:05 user nova-compute[231753]:     <mode name='host-model' supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <vendor>Intel</vendor>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='ss'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='vmx'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='pcid'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='hypervisor'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='arat'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='tsc_adjust'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='umip'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='md-clear'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='stibp'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='arch-capabilities'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='ssbd'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='ibpb'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='ibrs'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='amd-stibp'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='amd-ssbd'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='disable' name='erms'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='disable' name='xsaveopt'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='disable' name='lm'/>
Jul 29 13:29:05 user nova-compute[231753]:     </mode>
Jul 29 13:29:05 user nova-compute[231753]:     <mode name='custom' supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>qemu64</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>qemu32</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>phenom</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>pentium3</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>pentium2</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>pentium</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>n270</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>kvm64</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>kvm32</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>coreduo</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>core2duo</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>athlon</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Westmere-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Westmere</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Snowridge</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Server</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Client</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>SandyBridge</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Penryn</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Opteron_G5</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Opteron_G4</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Opteron_G3</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Opteron_G2</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Opteron_G1</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Nehalem-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Nehalem</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>IvyBridge</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Icelake-Server</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Haswell-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Haswell-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Haswell</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>EPYC-Rome</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>EPYC-Milan</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>EPYC-IBPB</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>EPYC</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Dhyana</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Cooperlake</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Conroe</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Cascadelake-Server</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Broadwell-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Broadwell-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Broadwell</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>486</model>
Jul 29 13:29:05 user nova-compute[231753]:     </mode>
Jul 29 13:29:05 user nova-compute[231753]:   </cpu>
Jul 29 13:29:05 user nova-compute[231753]:   <memoryBacking supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:     <enum name='sourceType'>
Jul 29 13:29:05 user nova-compute[231753]:       <value>file</value>
Jul 29 13:29:05 user nova-compute[231753]:       <value>anonymous</value>
Jul 29 13:29:05 user nova-compute[231753]:       <value>memfd</value>
Jul 29 13:29:05 user nova-compute[231753]:     </enum>
Jul 29 13:29:05 user nova-compute[231753]:   </memoryBacking>
Jul 29 13:29:05 user nova-compute[231753]:   <devices>
Jul 29 13:29:05 user nova-compute[231753]:     <disk supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='diskDevice'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>disk</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>cdrom</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>floppy</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>lun</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='bus'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>fdc</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>scsi</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>usb</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>sata</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='model'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio-transitional</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio-non-transitional</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </disk>
Jul 29 13:29:05 user nova-compute[231753]:     <graphics supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='type'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>sdl</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>vnc</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>spice</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>egl-headless</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </graphics>
Jul 29 13:29:05 user nova-compute[231753]:     <video supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='modelType'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>vga</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>cirrus</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>vmvga</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>qxl</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>none</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>bochs</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>ramfb</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </video>
Jul 29 13:29:05 user nova-compute[231753]:     <hostdev supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='mode'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>subsystem</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='startupPolicy'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>default</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>mandatory</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>requisite</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>optional</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='subsysType'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>usb</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>pci</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>scsi</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='capsType'/>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='pciBackend'/>
Jul 29 13:29:05 user nova-compute[231753]:     </hostdev>
Jul 29 13:29:05 user nova-compute[231753]:     <rng supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='model'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio-transitional</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio-non-transitional</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='backendModel'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>random</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>egd</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>builtin</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </rng>
Jul 29 13:29:05 user nova-compute[231753]:     <filesystem supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='driverType'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>path</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>handle</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtiofs</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </filesystem>
Jul 29 13:29:05 user nova-compute[231753]:     <tpm supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='model'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>tpm-tis</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>tpm-crb</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='backendModel'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>passthrough</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>emulator</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </tpm>
Jul 29 13:29:05 user nova-compute[231753]:   </devices>
Jul 29 13:29:05 user nova-compute[231753]:   <features>
Jul 29 13:29:05 user nova-compute[231753]:     <gic supported='no'/>
Jul 29 13:29:05 user nova-compute[231753]:     <vmcoreinfo supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:     <genid supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:     <backingStoreInput supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:     <backup supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:     <sev supported='no'/>
Jul 29 13:29:05 user nova-compute[231753]:   </features>
Jul 29 13:29:05 user nova-compute[231753]: </domainCapabilities>
Jul 29 13:29:05 user nova-compute[231753]:  {{(pid=231753) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35:
Jul 29 13:29:05 user nova-compute[231753]: <domainCapabilities>
Jul 29 13:29:05 user nova-compute[231753]:   <path>/usr/bin/qemu-system-i386</path>
Jul 29 13:29:05 user nova-compute[231753]:   <domain>kvm</domain>
Jul 29 13:29:05 user nova-compute[231753]:   <machine>pc-q35-6.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:   <arch>i686</arch>
Jul 29 13:29:05 user nova-compute[231753]:   <vcpu max='288'/>
Jul 29 13:29:05 user nova-compute[231753]:   <iothreads supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:   <os supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:     <enum name='firmware'/>
Jul 29 13:29:05 user nova-compute[231753]:     <loader supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <value>/usr/share/OVMF/OVMF_CODE.fd</value>
Jul 29 13:29:05 user nova-compute[231753]:       <value>/usr/share/OVMF/OVMF_CODE.secboot.fd</value>
Jul 29 13:29:05 user nova-compute[231753]:       <value>/usr/share/AAVMF/AAVMF_CODE.fd</value>
Jul 29 13:29:05 user nova-compute[231753]:       <value>/usr/share/AAVMF/AAVMF32_CODE.fd</value>
Jul 29 13:29:05 user nova-compute[231753]:       <value>/usr/share/OVMF/OVMF_CODE.ms.fd</value>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='type'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>rom</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>pflash</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='readonly'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>yes</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>no</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='secure'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>no</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </loader>
Jul 29 13:29:05 user nova-compute[231753]:   </os>
Jul 29 13:29:05 user nova-compute[231753]:   <cpu>
Jul 29 13:29:05 user nova-compute[231753]:     <mode name='host-passthrough' supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='hostPassthroughMigratable'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>off</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </mode>
Jul 29 13:29:05 user nova-compute[231753]:     <mode name='maximum' supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='maximumMigratable'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>on</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>off</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </mode>
Jul 29 13:29:05 user nova-compute[231753]:     <mode name='host-model' supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <vendor>Intel</vendor>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='ss'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='vmx'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='pcid'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='hypervisor'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='arat'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='tsc_adjust'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='umip'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='md-clear'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='stibp'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='arch-capabilities'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='ssbd'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='ibpb'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='ibrs'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='amd-stibp'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='amd-ssbd'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='disable' name='erms'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='disable' name='xsaveopt'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='disable' name='lm'/>
Jul 29 13:29:05 user nova-compute[231753]:     </mode>
Jul 29 13:29:05 user nova-compute[231753]:     <mode name='custom' supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>qemu64</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>qemu32</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>phenom</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>pentium3</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>pentium2</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>pentium</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>n270</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>kvm64</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>kvm32</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>coreduo</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>core2duo</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>athlon</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Westmere-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Westmere</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Snowridge</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Server</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Client</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>SandyBridge</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Penryn</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Opteron_G5</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Opteron_G4</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Opteron_G3</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Opteron_G2</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Opteron_G1</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Nehalem-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Nehalem</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>IvyBridge</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Icelake-Server</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Haswell-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Haswell-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Haswell</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>EPYC-Rome</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>EPYC-Milan</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>EPYC-IBPB</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>EPYC</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Dhyana</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Cooperlake</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Conroe</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Cascadelake-Server</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Broadwell-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Broadwell-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Broadwell</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>486</model>
Jul 29 13:29:05 user nova-compute[231753]:     </mode>
Jul 29 13:29:05 user nova-compute[231753]:   </cpu>
Jul 29 13:29:05 user nova-compute[231753]:   <memoryBacking supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:     <enum name='sourceType'>
Jul 29 13:29:05 user nova-compute[231753]:       <value>file</value>
Jul 29 13:29:05 user nova-compute[231753]:       <value>anonymous</value>
Jul 29 13:29:05 user nova-compute[231753]:       <value>memfd</value>
Jul 29 13:29:05 user nova-compute[231753]:     </enum>
Jul 29 13:29:05 user nova-compute[231753]:   </memoryBacking>
Jul 29 13:29:05 user nova-compute[231753]:   <devices>
Jul 29 13:29:05 user nova-compute[231753]:     <disk supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='diskDevice'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>disk</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>cdrom</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>floppy</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>lun</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='bus'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>fdc</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>scsi</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>usb</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>sata</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='model'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio-transitional</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio-non-transitional</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </disk>
Jul 29 13:29:05 user nova-compute[231753]:     <graphics supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='type'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>sdl</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>vnc</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>spice</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>egl-headless</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </graphics>
Jul 29 13:29:05 user nova-compute[231753]:     <video supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='modelType'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>vga</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>cirrus</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>vmvga</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>qxl</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>none</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>bochs</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>ramfb</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </video>
Jul 29 13:29:05 user nova-compute[231753]:     <hostdev supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='mode'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>subsystem</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='startupPolicy'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>default</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>mandatory</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>requisite</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>optional</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='subsysType'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>usb</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>pci</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>scsi</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='capsType'/>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='pciBackend'/>
Jul 29 13:29:05 user nova-compute[231753]:     </hostdev>
Jul 29 13:29:05 user nova-compute[231753]:     <rng supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='model'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio-transitional</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio-non-transitional</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='backendModel'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>random</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>egd</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>builtin</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </rng>
Jul 29 13:29:05 user nova-compute[231753]:     <filesystem supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='driverType'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>path</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>handle</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtiofs</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </filesystem>
Jul 29 13:29:05 user nova-compute[231753]:     <tpm supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='model'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>tpm-tis</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>tpm-crb</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='backendModel'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>passthrough</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>emulator</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </tpm>
Jul 29 13:29:05 user nova-compute[231753]:   </devices>
Jul 29 13:29:05 user nova-compute[231753]:   <features>
Jul 29 13:29:05 user nova-compute[231753]:     <gic supported='no'/>
Jul 29 13:29:05 user nova-compute[231753]:     <vmcoreinfo supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:     <genid supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:     <backingStoreInput supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:     <backup supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:     <sev supported='no'/>
Jul 29 13:29:05 user nova-compute[231753]:   </features>
Jul 29 13:29:05 user nova-compute[231753]: </domainCapabilities>
Jul 29 13:29:05 user nova-compute[231753]:  {{(pid=231753) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=231753) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=231753) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Error from libvirt when retrieving domain capabilities for arch m68k / virt_type kvm / machine_type virt: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-m68k' on this host {{(pid=231753) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=231753) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Error from libvirt when retrieving domain capabilities for arch microblaze / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblaze' on this host {{(pid=231753) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=231753) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Error from libvirt when retrieving domain capabilities for arch microblazeel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-microblazeel' on this host {{(pid=231753) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=231753) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Error from libvirt when retrieving domain capabilities for arch mips / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips' on this host {{(pid=231753) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=231753) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Error from libvirt when retrieving domain capabilities for arch mipsel / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mipsel' on this host {{(pid=231753) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=231753) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Error from libvirt when retrieving domain capabilities for arch mips64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64' on this host {{(pid=231753) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=231753) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Error from libvirt when retrieving domain capabilities for arch mips64el / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-mips64el' on this host {{(pid=231753) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=231753) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Error from libvirt when retrieving domain capabilities for arch ppc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc' on this host {{(pid=231753) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Getting domain capabilities for ppc64 via machine types: {'pseries', 'powernv', None} {{(pid=231753) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=231753) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=231753) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Error from libvirt when retrieving domain capabilities for arch ppc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64' on this host {{(pid=231753) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Getting domain capabilities for ppc64le via machine types: {'pseries', 'powernv'} {{(pid=231753) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type pseries: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=231753) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Error from libvirt when retrieving domain capabilities for arch ppc64le / virt_type kvm / machine_type powernv: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-ppc64le' on this host {{(pid=231753) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=231753) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Error from libvirt when retrieving domain capabilities for arch riscv32 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv32' on this host {{(pid=231753) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=231753) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Error from libvirt when retrieving domain capabilities for arch riscv64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-riscv64' on this host {{(pid=231753) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=231753) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Error from libvirt when retrieving domain capabilities for arch s390x / virt_type kvm / machine_type s390-ccw-virtio: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-s390x' on this host {{(pid=231753) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=231753) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Error from libvirt when retrieving domain capabilities for arch sh4 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4' on this host {{(pid=231753) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=231753) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Error from libvirt when retrieving domain capabilities for arch sh4eb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sh4eb' on this host {{(pid=231753) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=231753) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Error from libvirt when retrieving domain capabilities for arch sparc / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc' on this host {{(pid=231753) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=231753) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Error from libvirt when retrieving domain capabilities for arch sparc64 / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-sparc64' on this host {{(pid=231753) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'pc', 'ubuntu-q35', 'q35'} {{(pid=231753) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu:
Jul 29 13:29:05 user nova-compute[231753]: <domainCapabilities>
Jul 29 13:29:05 user nova-compute[231753]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 29 13:29:05 user nova-compute[231753]:   <domain>kvm</domain>
Jul 29 13:29:05 user nova-compute[231753]:   <machine>pc-i440fx-jammy</machine>
Jul 29 13:29:05 user nova-compute[231753]:   <arch>x86_64</arch>
Jul 29 13:29:05 user nova-compute[231753]:   <vcpu max='255'/>
Jul 29 13:29:05 user nova-compute[231753]:   <iothreads supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:   <os supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:     <enum name='firmware'>
Jul 29 13:29:05 user nova-compute[231753]:       <value>efi</value>
Jul 29 13:29:05 user nova-compute[231753]:     </enum>
Jul 29 13:29:05 user nova-compute[231753]:     <loader supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='type'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>rom</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>pflash</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='readonly'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>yes</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>no</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='secure'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>no</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </loader>
Jul 29 13:29:05 user nova-compute[231753]:   </os>
Jul 29 13:29:05 user nova-compute[231753]:   <cpu>
Jul 29 13:29:05 user nova-compute[231753]:     <mode name='host-passthrough' supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='hostPassthroughMigratable'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>on</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>off</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </mode>
Jul 29 13:29:05 user nova-compute[231753]:     <mode name='maximum' supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='maximumMigratable'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>on</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>off</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </mode>
Jul 29 13:29:05 user nova-compute[231753]:     <mode name='host-model' supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <vendor>Intel</vendor>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='ss'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='vmx'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='pcid'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='hypervisor'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='arat'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='tsc_adjust'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='umip'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='md-clear'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='stibp'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='arch-capabilities'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='ssbd'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='invtsc'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='ibpb'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='ibrs'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='amd-stibp'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='amd-ssbd'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='rsba'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='pschange-mc-no'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='disable' name='erms'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='disable' name='xsaveopt'/>
Jul 29 13:29:05 user nova-compute[231753]:     </mode>
Jul 29 13:29:05 user nova-compute[231753]:     <mode name='custom' supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>qemu64</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>qemu32</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>phenom</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>pentium3</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>pentium2</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>pentium</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>n270</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>kvm64</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>kvm32</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>coreduo</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>core2duo</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>athlon</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>Westmere-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>Westmere</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Snowridge</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Server</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Client</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>SandyBridge</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>Penryn</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Opteron_G5</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Opteron_G4</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Opteron_G3</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Opteron_G2</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>Opteron_G1</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>Nehalem</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>IvyBridge</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Icelake-Server</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Haswell-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Haswell-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Haswell</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>EPYC-Rome</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>EPYC-Milan</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>EPYC-IBPB</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>EPYC</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Dhyana</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Cooperlake</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>Conroe</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Cascadelake-Server</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Broadwell-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Broadwell-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Broadwell</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>486</model>
Jul 29 13:29:05 user nova-compute[231753]:     </mode>
Jul 29 13:29:05 user nova-compute[231753]:   </cpu>
Jul 29 13:29:05 user nova-compute[231753]:   <memoryBacking supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:     <enum name='sourceType'>
Jul 29 13:29:05 user nova-compute[231753]:       <value>file</value>
Jul 29 13:29:05 user nova-compute[231753]:       <value>anonymous</value>
Jul 29 13:29:05 user nova-compute[231753]:       <value>memfd</value>
Jul 29 13:29:05 user nova-compute[231753]:     </enum>
Jul 29 13:29:05 user nova-compute[231753]:   </memoryBacking>
Jul 29 13:29:05 user nova-compute[231753]:   <devices>
Jul 29 13:29:05 user nova-compute[231753]:     <disk supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='diskDevice'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>disk</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>cdrom</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>floppy</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>lun</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='bus'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>ide</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>fdc</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>scsi</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>usb</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>sata</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='model'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio-transitional</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio-non-transitional</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </disk>
Jul 29 13:29:05 user nova-compute[231753]:     <graphics supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='type'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>sdl</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>vnc</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>spice</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>egl-headless</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </graphics>
Jul 29 13:29:05 user nova-compute[231753]:     <video supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='modelType'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>vga</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>cirrus</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>vmvga</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>qxl</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>none</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>bochs</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>ramfb</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </video>
Jul 29 13:29:05 user nova-compute[231753]:     <hostdev supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='mode'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>subsystem</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='startupPolicy'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>default</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>mandatory</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>requisite</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>optional</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='subsysType'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>usb</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>pci</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>scsi</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='capsType'/>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='pciBackend'/>
Jul 29 13:29:05 user nova-compute[231753]:     </hostdev>
Jul 29 13:29:05 user nova-compute[231753]:     <rng supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='model'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio-transitional</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio-non-transitional</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='backendModel'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>random</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>egd</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>builtin</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </rng>
Jul 29 13:29:05 user nova-compute[231753]:     <filesystem supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='driverType'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>path</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>handle</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtiofs</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </filesystem>
Jul 29 13:29:05 user nova-compute[231753]:     <tpm supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='model'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>tpm-tis</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>tpm-crb</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='backendModel'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>passthrough</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>emulator</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </tpm>
Jul 29 13:29:05 user nova-compute[231753]:   </devices>
Jul 29 13:29:05 user nova-compute[231753]:   <features>
Jul 29 13:29:05 user nova-compute[231753]:     <gic supported='no'/>
Jul 29 13:29:05 user nova-compute[231753]:     <vmcoreinfo supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:     <genid supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:     <backingStoreInput supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:     <backup supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:     <sev supported='no'/>
Jul 29 13:29:05 user nova-compute[231753]:   </features>
Jul 29 13:29:05 user nova-compute[231753]: </domainCapabilities>
Jul 29 13:29:05 user nova-compute[231753]:  {{(pid=231753) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc:
Jul 29 13:29:05 user nova-compute[231753]: <domainCapabilities>
Jul 29 13:29:05 user nova-compute[231753]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 29 13:29:05 user nova-compute[231753]:   <domain>kvm</domain>
Jul 29 13:29:05 user nova-compute[231753]:   <machine>pc-i440fx-6.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:   <arch>x86_64</arch>
Jul 29 13:29:05 user nova-compute[231753]:   <vcpu max='255'/>
Jul 29 13:29:05 user nova-compute[231753]:   <iothreads supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:   <os supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:     <enum name='firmware'>
Jul 29 13:29:05 user nova-compute[231753]:       <value>efi</value>
Jul 29 13:29:05 user nova-compute[231753]:     </enum>
Jul 29 13:29:05 user nova-compute[231753]:     <loader supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='type'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>rom</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>pflash</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='readonly'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>yes</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>no</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='secure'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>no</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </loader>
Jul 29 13:29:05 user nova-compute[231753]:   </os>
Jul 29 13:29:05 user nova-compute[231753]:   <cpu>
Jul 29 13:29:05 user nova-compute[231753]:     <mode name='host-passthrough' supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='hostPassthroughMigratable'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>on</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>off</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </mode>
Jul 29 13:29:05 user nova-compute[231753]:     <mode name='maximum' supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='maximumMigratable'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>on</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>off</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </mode>
Jul 29 13:29:05 user nova-compute[231753]:     <mode name='host-model' supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <vendor>Intel</vendor>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='ss'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='vmx'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='pcid'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='hypervisor'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='arat'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='tsc_adjust'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='umip'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='md-clear'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='stibp'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='arch-capabilities'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='ssbd'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='invtsc'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='ibpb'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='ibrs'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='amd-stibp'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='amd-ssbd'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='rsba'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='pschange-mc-no'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='disable' name='erms'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='disable' name='xsaveopt'/>
Jul 29 13:29:05 user nova-compute[231753]:     </mode>
Jul 29 13:29:05 user nova-compute[231753]:     <mode name='custom' supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>qemu64</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>qemu32</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>phenom</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>pentium3</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>pentium2</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>pentium</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>n270</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>kvm64</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>kvm32</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>coreduo</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>core2duo</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>athlon</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>Westmere-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>Westmere</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Snowridge</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Server</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Client</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>SandyBridge</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>Penryn</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Opteron_G5</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Opteron_G4</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Opteron_G3</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Opteron_G2</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>Opteron_G1</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>Nehalem</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>IvyBridge</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Icelake-Server</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Haswell-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Haswell-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Haswell</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>EPYC-Rome</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>EPYC-Milan</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>EPYC-IBPB</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>EPYC</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Dhyana</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Cooperlake</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>Conroe</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Cascadelake-Server</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Broadwell-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Broadwell-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Broadwell</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>486</model>
Jul 29 13:29:05 user nova-compute[231753]:     </mode>
Jul 29 13:29:05 user nova-compute[231753]:   </cpu>
Jul 29 13:29:05 user nova-compute[231753]:   <memoryBacking supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:     <enum name='sourceType'>
Jul 29 13:29:05 user nova-compute[231753]:       <value>file</value>
Jul 29 13:29:05 user nova-compute[231753]:       <value>anonymous</value>
Jul 29 13:29:05 user nova-compute[231753]:       <value>memfd</value>
Jul 29 13:29:05 user nova-compute[231753]:     </enum>
Jul 29 13:29:05 user nova-compute[231753]:   </memoryBacking>
Jul 29 13:29:05 user nova-compute[231753]:   <devices>
Jul 29 13:29:05 user nova-compute[231753]:     <disk supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='diskDevice'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>disk</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>cdrom</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>floppy</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>lun</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='bus'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>ide</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>fdc</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>scsi</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>usb</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>sata</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='model'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio-transitional</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio-non-transitional</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </disk>
Jul 29 13:29:05 user nova-compute[231753]:     <graphics supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='type'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>sdl</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>vnc</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>spice</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>egl-headless</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </graphics>
Jul 29 13:29:05 user nova-compute[231753]:     <video supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='modelType'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>vga</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>cirrus</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>vmvga</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>qxl</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>none</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>bochs</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>ramfb</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </video>
Jul 29 13:29:05 user nova-compute[231753]:     <hostdev supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='mode'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>subsystem</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='startupPolicy'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>default</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>mandatory</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>requisite</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>optional</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='subsysType'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>usb</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>pci</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>scsi</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='capsType'/>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='pciBackend'/>
Jul 29 13:29:05 user nova-compute[231753]:     </hostdev>
Jul 29 13:29:05 user nova-compute[231753]:     <rng supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='model'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio-transitional</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio-non-transitional</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='backendModel'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>random</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>egd</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>builtin</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </rng>
Jul 29 13:29:05 user nova-compute[231753]:     <filesystem supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='driverType'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>path</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>handle</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtiofs</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </filesystem>
Jul 29 13:29:05 user nova-compute[231753]:     <tpm supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='model'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>tpm-tis</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>tpm-crb</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='backendModel'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>passthrough</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>emulator</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </tpm>
Jul 29 13:29:05 user nova-compute[231753]:   </devices>
Jul 29 13:29:05 user nova-compute[231753]:   <features>
Jul 29 13:29:05 user nova-compute[231753]:     <gic supported='no'/>
Jul 29 13:29:05 user nova-compute[231753]:     <vmcoreinfo supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:     <genid supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:     <backingStoreInput supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:     <backup supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:     <sev supported='no'/>
Jul 29 13:29:05 user nova-compute[231753]:   </features>
Jul 29 13:29:05 user nova-compute[231753]: </domainCapabilities>
Jul 29 13:29:05 user nova-compute[231753]:  {{(pid=231753) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35:
Jul 29 13:29:05 user nova-compute[231753]: <domainCapabilities>
Jul 29 13:29:05 user nova-compute[231753]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 29 13:29:05 user nova-compute[231753]:   <domain>kvm</domain>
Jul 29 13:29:05 user nova-compute[231753]:   <machine>pc-q35-jammy</machine>
Jul 29 13:29:05 user nova-compute[231753]:   <arch>x86_64</arch>
Jul 29 13:29:05 user nova-compute[231753]:   <vcpu max='288'/>
Jul 29 13:29:05 user nova-compute[231753]:   <iothreads supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:   <os supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:     <enum name='firmware'>
Jul 29 13:29:05 user nova-compute[231753]:       <value>efi</value>
Jul 29 13:29:05 user nova-compute[231753]:     </enum>
Jul 29 13:29:05 user nova-compute[231753]:     <loader supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 29 13:29:05 user nova-compute[231753]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 29 13:29:05 user nova-compute[231753]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='type'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>rom</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>pflash</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='readonly'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>yes</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>no</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='secure'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>yes</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>no</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </loader>
Jul 29 13:29:05 user nova-compute[231753]:   </os>
Jul 29 13:29:05 user nova-compute[231753]:   <cpu>
Jul 29 13:29:05 user nova-compute[231753]:     <mode name='host-passthrough' supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='hostPassthroughMigratable'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>on</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>off</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </mode>
Jul 29 13:29:05 user nova-compute[231753]:     <mode name='maximum' supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='maximumMigratable'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>on</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>off</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </mode>
Jul 29 13:29:05 user nova-compute[231753]:     <mode name='host-model' supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <vendor>Intel</vendor>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='ss'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='vmx'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='pcid'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='hypervisor'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='arat'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='tsc_adjust'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='umip'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='md-clear'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='stibp'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='arch-capabilities'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='ssbd'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='invtsc'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='ibpb'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='ibrs'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='amd-stibp'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='amd-ssbd'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='rsba'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='pschange-mc-no'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='disable' name='erms'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='disable' name='xsaveopt'/>
Jul 29 13:29:05 user nova-compute[231753]:     </mode>
Jul 29 13:29:05 user nova-compute[231753]:     <mode name='custom' supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>qemu64</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>qemu32</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>phenom</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>pentium3</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>pentium2</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>pentium</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>n270</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>kvm64</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>kvm32</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>coreduo</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>core2duo</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>athlon</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>Westmere-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>Westmere</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Snowridge</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Server</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Client</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>SandyBridge</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>Penryn</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Opteron_G5</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Opteron_G4</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Opteron_G3</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Opteron_G2</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>Opteron_G1</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>Nehalem</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>IvyBridge</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Icelake-Server</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Haswell-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Haswell-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Haswell</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>EPYC-Rome</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>EPYC-Milan</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>EPYC-IBPB</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>EPYC</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Dhyana</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Cooperlake</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>Conroe</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Cascadelake-Server</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Broadwell-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Broadwell-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Broadwell</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>486</model>
Jul 29 13:29:05 user nova-compute[231753]:     </mode>
Jul 29 13:29:05 user nova-compute[231753]:   </cpu>
Jul 29 13:29:05 user nova-compute[231753]:   <memoryBacking supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:     <enum name='sourceType'>
Jul 29 13:29:05 user nova-compute[231753]:       <value>file</value>
Jul 29 13:29:05 user nova-compute[231753]:       <value>anonymous</value>
Jul 29 13:29:05 user nova-compute[231753]:       <value>memfd</value>
Jul 29 13:29:05 user nova-compute[231753]:     </enum>
Jul 29 13:29:05 user nova-compute[231753]:   </memoryBacking>
Jul 29 13:29:05 user nova-compute[231753]:   <devices>
Jul 29 13:29:05 user nova-compute[231753]:     <disk supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='diskDevice'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>disk</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>cdrom</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>floppy</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>lun</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='bus'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>fdc</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>scsi</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>usb</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>sata</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='model'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio-transitional</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio-non-transitional</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </disk>
Jul 29 13:29:05 user nova-compute[231753]:     <graphics supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='type'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>sdl</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>vnc</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>spice</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>egl-headless</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </graphics>
Jul 29 13:29:05 user nova-compute[231753]:     <video supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='modelType'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>vga</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>cirrus</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>vmvga</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>qxl</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>none</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>bochs</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>ramfb</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </video>
Jul 29 13:29:05 user nova-compute[231753]:     <hostdev supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='mode'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>subsystem</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='startupPolicy'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>default</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>mandatory</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>requisite</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>optional</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='subsysType'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>usb</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>pci</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>scsi</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='capsType'/>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='pciBackend'/>
Jul 29 13:29:05 user nova-compute[231753]:     </hostdev>
Jul 29 13:29:05 user nova-compute[231753]:     <rng supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='model'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio-transitional</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio-non-transitional</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='backendModel'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>random</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>egd</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>builtin</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </rng>
Jul 29 13:29:05 user nova-compute[231753]:     <filesystem supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='driverType'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>path</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>handle</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtiofs</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </filesystem>
Jul 29 13:29:05 user nova-compute[231753]:     <tpm supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='model'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>tpm-tis</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>tpm-crb</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='backendModel'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>passthrough</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>emulator</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </tpm>
Jul 29 13:29:05 user nova-compute[231753]:   </devices>
Jul 29 13:29:05 user nova-compute[231753]:   <features>
Jul 29 13:29:05 user nova-compute[231753]:     <gic supported='no'/>
Jul 29 13:29:05 user nova-compute[231753]:     <vmcoreinfo supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:     <genid supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:     <backingStoreInput supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:     <backup supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:     <sev supported='no'/>
Jul 29 13:29:05 user nova-compute[231753]:   </features>
Jul 29 13:29:05 user nova-compute[231753]: </domainCapabilities>
Jul 29 13:29:05 user nova-compute[231753]:  {{(pid=231753) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35:
Jul 29 13:29:05 user nova-compute[231753]: <domainCapabilities>
Jul 29 13:29:05 user nova-compute[231753]:   <path>/usr/bin/qemu-system-x86_64</path>
Jul 29 13:29:05 user nova-compute[231753]:   <domain>kvm</domain>
Jul 29 13:29:05 user nova-compute[231753]:   <machine>pc-q35-6.2</machine>
Jul 29 13:29:05 user nova-compute[231753]:   <arch>x86_64</arch>
Jul 29 13:29:05 user nova-compute[231753]:   <vcpu max='288'/>
Jul 29 13:29:05 user nova-compute[231753]:   <iothreads supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:   <os supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:     <enum name='firmware'>
Jul 29 13:29:05 user nova-compute[231753]:       <value>efi</value>
Jul 29 13:29:05 user nova-compute[231753]:     </enum>
Jul 29 13:29:05 user nova-compute[231753]:     <loader supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <value>/usr/share/OVMF/OVMF_CODE_4M.ms.fd</value>
Jul 29 13:29:05 user nova-compute[231753]:       <value>/usr/share/OVMF/OVMF_CODE_4M.secboot.fd</value>
Jul 29 13:29:05 user nova-compute[231753]:       <value>/usr/share/OVMF/OVMF_CODE_4M.fd</value>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='type'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>rom</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>pflash</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='readonly'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>yes</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>no</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='secure'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>yes</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>no</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </loader>
Jul 29 13:29:05 user nova-compute[231753]:   </os>
Jul 29 13:29:05 user nova-compute[231753]:   <cpu>
Jul 29 13:29:05 user nova-compute[231753]:     <mode name='host-passthrough' supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='hostPassthroughMigratable'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>on</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>off</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </mode>
Jul 29 13:29:05 user nova-compute[231753]:     <mode name='maximum' supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='maximumMigratable'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>on</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>off</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </mode>
Jul 29 13:29:05 user nova-compute[231753]:     <mode name='host-model' supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <model fallback='forbid'>IvyBridge-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <vendor>Intel</vendor>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='ss'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='vmx'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='pcid'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='hypervisor'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='arat'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='tsc_adjust'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='umip'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='md-clear'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='stibp'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='arch-capabilities'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='ssbd'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='invtsc'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='ibpb'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='ibrs'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='amd-stibp'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='amd-ssbd'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='rsba'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='skip-l1dfl-vmentry'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='require' name='pschange-mc-no'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='disable' name='erms'/>
Jul 29 13:29:05 user nova-compute[231753]:       <feature policy='disable' name='xsaveopt'/>
Jul 29 13:29:05 user nova-compute[231753]:     </mode>
Jul 29 13:29:05 user nova-compute[231753]:     <mode name='custom' supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>qemu64</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>qemu32</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>phenom</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>pentium3</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>pentium2</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>pentium</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>n270</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>kvm64</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>kvm32</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>coreduo</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>core2duo</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>athlon</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>Westmere-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>Westmere</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Snowridge</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Server-noTSX-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Server-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Server</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Client-noTSX-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Client-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Skylake-Client</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>SandyBridge-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>SandyBridge</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>Penryn</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Opteron_G5</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Opteron_G4</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Opteron_G3</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Opteron_G2</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>Opteron_G1</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>Nehalem-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>Nehalem</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>IvyBridge-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>IvyBridge</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Icelake-Server-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Icelake-Server</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no' deprecated='yes'>Icelake-Client-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no' deprecated='yes'>Icelake-Client</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Haswell-noTSX-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Haswell-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Haswell-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Haswell</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>EPYC-Rome</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>EPYC-Milan</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>EPYC-IBPB</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>EPYC</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Dhyana</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Cooperlake</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>Conroe</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Cascadelake-Server-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Cascadelake-Server</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Broadwell-noTSX-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Broadwell-noTSX</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Broadwell-IBRS</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='no'>Broadwell</model>
Jul 29 13:29:05 user nova-compute[231753]:       <model usable='yes'>486</model>
Jul 29 13:29:05 user nova-compute[231753]:     </mode>
Jul 29 13:29:05 user nova-compute[231753]:   </cpu>
Jul 29 13:29:05 user nova-compute[231753]:   <memoryBacking supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:     <enum name='sourceType'>
Jul 29 13:29:05 user nova-compute[231753]:       <value>file</value>
Jul 29 13:29:05 user nova-compute[231753]:       <value>anonymous</value>
Jul 29 13:29:05 user nova-compute[231753]:       <value>memfd</value>
Jul 29 13:29:05 user nova-compute[231753]:     </enum>
Jul 29 13:29:05 user nova-compute[231753]:   </memoryBacking>
Jul 29 13:29:05 user nova-compute[231753]:   <devices>
Jul 29 13:29:05 user nova-compute[231753]:     <disk supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='diskDevice'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>disk</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>cdrom</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>floppy</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>lun</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='bus'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>fdc</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>scsi</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>usb</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>sata</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='model'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio-transitional</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio-non-transitional</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </disk>
Jul 29 13:29:05 user nova-compute[231753]:     <graphics supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='type'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>sdl</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>vnc</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>spice</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>egl-headless</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </graphics>
Jul 29 13:29:05 user nova-compute[231753]:     <video supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='modelType'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>vga</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>cirrus</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>vmvga</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>qxl</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>none</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>bochs</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>ramfb</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </video>
Jul 29 13:29:05 user nova-compute[231753]:     <hostdev supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='mode'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>subsystem</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='startupPolicy'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>default</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>mandatory</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>requisite</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>optional</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='subsysType'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>usb</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>pci</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>scsi</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='capsType'/>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='pciBackend'/>
Jul 29 13:29:05 user nova-compute[231753]:     </hostdev>
Jul 29 13:29:05 user nova-compute[231753]:     <rng supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='model'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio-transitional</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtio-non-transitional</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='backendModel'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>random</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>egd</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>builtin</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </rng>
Jul 29 13:29:05 user nova-compute[231753]:     <filesystem supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='driverType'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>path</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>handle</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>virtiofs</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </filesystem>
Jul 29 13:29:05 user nova-compute[231753]:     <tpm supported='yes'>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='model'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>tpm-tis</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>tpm-crb</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:       <enum name='backendModel'>
Jul 29 13:29:05 user nova-compute[231753]:         <value>passthrough</value>
Jul 29 13:29:05 user nova-compute[231753]:         <value>emulator</value>
Jul 29 13:29:05 user nova-compute[231753]:       </enum>
Jul 29 13:29:05 user nova-compute[231753]:     </tpm>
Jul 29 13:29:05 user nova-compute[231753]:   </devices>
Jul 29 13:29:05 user nova-compute[231753]:   <features>
Jul 29 13:29:05 user nova-compute[231753]:     <gic supported='no'/>
Jul 29 13:29:05 user nova-compute[231753]:     <vmcoreinfo supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:     <genid supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:     <backingStoreInput supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:     <backup supported='yes'/>
Jul 29 13:29:05 user nova-compute[231753]:     <sev supported='no'/>
Jul 29 13:29:05 user nova-compute[231753]:   </features>
Jul 29 13:29:05 user nova-compute[231753]: </domainCapabilities>
Jul 29 13:29:05 user nova-compute[231753]:  {{(pid=231753) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1037}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=231753) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Error from libvirt when retrieving domain capabilities for arch xtensa / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensa' on this host {{(pid=231753) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=231753) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:952}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Error from libvirt when retrieving domain capabilities for arch xtensaeb / virt_type kvm / machine_type None: [Error Code 8]: invalid argument: KVM is not supported by '/usr/bin/qemu-system-xtensaeb' on this host {{(pid=231753) _add_to_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:991}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Checking secure boot support for host arch (x86_64) {{(pid=231753) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Checking secure boot support for host arch (x86_64) {{(pid=231753) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Checking secure boot support for host arch (x86_64) {{(pid=231753) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Checking secure boot support for host arch (x86_64) {{(pid=231753) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Checking secure boot support for host arch (x86_64) {{(pid=231753) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1779}}
Jul 29 13:29:05 user nova-compute[231753]: INFO nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Secure Boot support detected
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] cpu compare xml: <cpu match="exact">
Jul 29 13:29:05 user nova-compute[231753]:   <model>Nehalem</model>
Jul 29 13:29:05 user nova-compute[231753]: </cpu>
Jul 29 13:29:05 user nova-compute[231753]:  {{(pid=231753) _compare_cpu /opt/stack/nova/nova/virt/libvirt/driver.py:10023}}
Jul 29 13:29:05 user nova-compute[231753]: INFO nova.virt.node [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Generated node identity 222db5c7-e17f-4307-968d-4284bf5c19f4
Jul 29 13:29:05 user nova-compute[231753]: INFO nova.virt.node [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Wrote node identity 222db5c7-e17f-4307-968d-4284bf5c19f4 to /opt/stack/data/nova/compute_id
Jul 29 13:29:05 user nova-compute[231753]: WARNING nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Compute nodes ['222db5c7-e17f-4307-968d-4284bf5c19f4'] for host user were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning.
Jul 29 13:29:05 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host
Jul 29 13:29:05 user nova-compute[231753]: WARNING nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] No compute node record found for host user. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host user could not be found.
Jul 29 13:29:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 13:29:05 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:29:05 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Hypervisor/Node resource view: name=user free_ram=10773MB free_disk=26.215133666992188GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:29:05 user nova-compute[231753]: WARNING nova.compute.resource_tracker [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] No compute node record for user:222db5c7-e17f-4307-968d-4284bf5c19f4: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 222db5c7-e17f-4307-968d-4284bf5c19f4 could not be found.
Jul 29 13:29:05 user nova-compute[231753]: INFO nova.compute.resource_tracker [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Compute node record created for user:user with uuid: 222db5c7-e17f-4307-968d-4284bf5c19f4
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 13:29:05 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [req-6aeff2db-2ea8-437a-afa2-58170fb37c0f] Created resource provider record via placement API for resource provider with UUID 222db5c7-e17f-4307-968d-4284bf5c19f4 and name user.
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] /sys/module/kvm_amd/parameters/sev does not exist {{(pid=231753) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:1795}}
Jul 29 13:29:05 user nova-compute[231753]: INFO nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] kernel doesn't support AMD SEV
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Updating inventory in ProviderTree for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 with inventory: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 29 13:29:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:29:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Libvirt baseline CPU <cpu>
Jul 29 13:29:06 user nova-compute[231753]:   <arch>x86_64</arch>
Jul 29 13:29:06 user nova-compute[231753]:   <model>Nehalem</model>
Jul 29 13:29:06 user nova-compute[231753]:   <vendor>Intel</vendor>
Jul 29 13:29:06 user nova-compute[231753]:   <topology sockets="6" cores="1" threads="1"/>
Jul 29 13:29:06 user nova-compute[231753]: </cpu>
Jul 29 13:29:06 user nova-compute[231753]:  {{(pid=231753) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:12513}}
Jul 29 13:29:06 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Updated inventory for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 16011, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 12, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 40, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:957}}
Jul 29 13:29:06 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Updating resource provider 222db5c7-e17f-4307-968d-4284bf5c19f4 generation from 0 to 1 during operation: update_inventory {{(pid=231753) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 29 13:29:06 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Updating inventory in ProviderTree for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 with inventory: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 29 13:29:06 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Updating resource provider 222db5c7-e17f-4307-968d-4284bf5c19f4 generation from 1 to 2 during operation: update_traits {{(pid=231753) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}}
Jul 29 13:29:06 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 13:29:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.647s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:29:06 user nova-compute[231753]: DEBUG nova.service [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Creating RPC server for service compute {{(pid=231753) start /opt/stack/nova/nova/service.py:182}}
Jul 29 13:29:06 user nova-compute[231753]: DEBUG nova.service [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Join ServiceGroup membership for this service compute {{(pid=231753) start /opt/stack/nova/nova/service.py:199}}
Jul 29 13:29:06 user nova-compute[231753]: DEBUG nova.servicegroup.drivers.db [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] DB_Driver: join new ServiceGroup member user to the compute group, service = <Service: host=user, binary=nova-compute, manager_class_name=nova.compute.manager.ComputeManager> {{(pid=231753) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}}
Jul 29 13:29:24 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._sync_power_states {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:29:24 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:29:57 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:29:57 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:29:57 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 13:29:57 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Rebuilding the list of instances to heal {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 13:29:57 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Didn't find any instances for network info cache update. {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 29 13:29:57 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:29:57 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:29:57 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:29:57 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:29:57 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:29:57 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:29:57 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 13:29:57 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:29:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:29:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:29:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:29:57 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 13:29:57 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:29:57 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:29:57 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=10164MB free_disk=26.119171142578125GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 13:29:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:29:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:29:57 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 13:29:57 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 13:29:57 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:29:57 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:29:57 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 13:29:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.134s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:30:57 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:30:57 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:30:58 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:30:58 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:30:58 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 13:30:58 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Rebuilding the list of instances to heal {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 13:30:58 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Didn't find any instances for network info cache update. {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 29 13:30:58 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:30:58 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:30:58 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:30:58 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 13:30:58 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:30:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:30:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:30:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:30:58 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 13:30:58 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:30:58 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:30:58 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=10123MB free_disk=26.1644287109375GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 13:30:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:30:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:30:58 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 13:30:58 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 13:30:58 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:30:58 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:30:58 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 13:30:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.104s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:30:59 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:30:59 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:31:58 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:31:58 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:31:58 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:31:58 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:31:58 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 13:31:59 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:31:59 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 13:31:59 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Rebuilding the list of instances to heal {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 13:31:59 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Didn't find any instances for network info cache update. {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 29 13:31:59 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:32:00 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:32:00 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:32:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:32:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:32:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:32:00 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 13:32:00 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:32:00 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:32:00 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=10140MB free_disk=25.938175201416016GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 13:32:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:32:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:32:00 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 13:32:00 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 13:32:00 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:32:00 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:32:00 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 13:32:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.175s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:32:01 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:32:58 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:32:58 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:32:58 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 13:32:59 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:32:59 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:32:59 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:33:00 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:33:00 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:33:00 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 13:33:00 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Rebuilding the list of instances to heal {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 13:33:00 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Didn't find any instances for network info cache update. {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 29 13:33:02 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:33:02 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:33:02 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:33:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:02 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 13:33:02 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:33:02 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:33:02 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=9382MB free_disk=25.960716247558594GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 13:33:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:02 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 13:33:02 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 13:33:02 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:33:02 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:33:02 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 13:33:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.162s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Acquiring lock "63fad324-aac2-4d60-b4ce-a32a5736657d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:11 user nova-compute[231753]: DEBUG nova.compute.manager [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:33:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:11 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:33:11 user nova-compute[231753]: INFO nova.compute.claims [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Claim successful on node user
Jul 29 13:33:11 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:33:11 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:33:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.391s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:11 user nova-compute[231753]: DEBUG nova.compute.manager [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:33:12 user nova-compute[231753]: DEBUG nova.compute.manager [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:33:12 user nova-compute[231753]: DEBUG nova.network.neutron [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:33:12 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:33:12 user nova-compute[231753]: DEBUG nova.compute.manager [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:33:12 user nova-compute[231753]: DEBUG nova.compute.manager [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:33:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:33:12 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Creating image(s)
Jul 29 13:33:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Acquiring lock "/opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "/opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "/opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "4475f276-acc4-44f1-a5fa-6a7fb2165493" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "4475f276-acc4-44f1-a5fa-6a7fb2165493" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:12 user nova-compute[231753]: DEBUG nova.compute.manager [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:33:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:12 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:33:12 user nova-compute[231753]: INFO nova.compute.claims [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Claim successful on node user
Jul 29 13:33:13 user nova-compute[231753]: DEBUG nova.policy [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7361505253f84cf28c8688caf4a0cd16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '74a8a3e0bcef4bbc979ef187e4ed48cc', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:33:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a.part --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:13 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:33:13 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:33:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a.part --force-share --output=json" returned: 0 in 0.128s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:13 user nova-compute[231753]: DEBUG nova.virt.images [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] e16ae177-482e-47d8-a71b-737a50412c32 was qcow2, converting to raw {{(pid=231753) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 29 13:33:13 user nova-compute[231753]: DEBUG nova.privsep.utils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=231753) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 29 13:33:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a.part /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a.converted {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.718s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:13 user nova-compute[231753]: DEBUG nova.compute.manager [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:33:14 user nova-compute[231753]: DEBUG nova.compute.manager [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:33:14 user nova-compute[231753]: DEBUG nova.network.neutron [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:33:14 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:33:14 user nova-compute[231753]: DEBUG nova.compute.manager [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:33:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a.part /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a.converted" returned: 0 in 0.640s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a.converted --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:14 user nova-compute[231753]: DEBUG nova.compute.manager [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:33:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:33:14 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Creating image(s)
Jul 29 13:33:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "/opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "/opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "/opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a.converted --force-share --output=json" returned: 0 in 0.150s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.085s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:14 user nova-compute[231753]: INFO oslo.privsep.daemon [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpu6mdeykp/privsep.sock']
Jul 29 13:33:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.049s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:14 user sudo[240897]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpu6mdeykp/privsep.sock
Jul 29 13:33:14 user sudo[240897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 29 13:33:14 user nova-compute[231753]: DEBUG nova.policy [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '932b5bd757f94be29d52035fd9f70293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ebbb5f2e440dfa0cf3950232b4853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:33:16 user sudo[240897]: pam_unix(sudo:session): session closed for user root
Jul 29 13:33:16 user nova-compute[231753]: INFO oslo.privsep.daemon [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Spawned new privsep daemon via rootwrap
Jul 29 13:33:16 user nova-compute[231753]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 29 13:33:16 user nova-compute[231753]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 29 13:33:16 user nova-compute[231753]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Jul 29 13:33:16 user nova-compute[231753]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 240907
Jul 29 13:33:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:16 user nova-compute[231753]: WARNING oslo_privsep.priv_context [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] privsep daemon already running
Jul 29 13:33:16 user nova-compute[231753]: DEBUG nova.compute.manager [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:33:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:16 user nova-compute[231753]: DEBUG nova.network.neutron [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Successfully created port: d219916c-23c3-4319-ad8e-9d04e9399ab7 {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:33:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:16 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:33:16 user nova-compute[231753]: INFO nova.compute.claims [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Claim successful on node user
Jul 29 13:33:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.147s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.175s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.162s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/disk 1073741824" returned: 0 in 0.048s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.173s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:16 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:33:16 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:33:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.144s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:16 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:33:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:16 user nova-compute[231753]: DEBUG nova.compute.manager [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:33:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.184s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk 1073741824" returned: 0 in 0.063s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.253s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG nova.compute.manager [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG nova.network.neutron [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Cannot resize image /opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG nova.objects.instance [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lazy-loading 'migration_context' on Instance uuid 4475f276-acc4-44f1-a5fa-6a7fb2165493 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Ensure instance console log exists: /opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:17 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:33:17 user nova-compute[231753]: DEBUG nova.compute.manager [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.151s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Checking if we can resize image /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Cannot resize image /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG nova.objects.instance [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lazy-loading 'migration_context' on Instance uuid 63fad324-aac2-4d60-b4ce-a32a5736657d {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Ensure instance console log exists: /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG nova.compute.manager [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:33:17 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Creating image(s)
Jul 29 13:33:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "/opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "/opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "/opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG nova.network.neutron [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Successfully created port: fadc1466-5336-4230-b0f1-4fe4053f216a {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.161s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG nova.policy [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '748938c3fbfb4244ab946dcfe4762435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afff9d3d250643c58da9bc5cf5756d1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.142s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk 1073741824" returned: 0 in 0.054s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.153s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:33:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:18 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Cannot resize image /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:33:18 user nova-compute[231753]: DEBUG nova.objects.instance [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lazy-loading 'migration_context' on Instance uuid 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:33:18 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:33:18 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Ensure instance console log exists: /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:33:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Acquiring lock "29b21191-c874-4ca8-bd4b-2df90a41ccab" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Lock "29b21191-c874-4ca8-bd4b-2df90a41ccab" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:18 user nova-compute[231753]: DEBUG nova.compute.manager [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:33:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:18 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:33:18 user nova-compute[231753]: INFO nova.compute.claims [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Claim successful on node user
Jul 29 13:33:19 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:33:19 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:33:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.273s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:19 user nova-compute[231753]: DEBUG nova.compute.manager [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:33:19 user nova-compute[231753]: DEBUG nova.compute.manager [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:33:19 user nova-compute[231753]: DEBUG nova.network.neutron [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:33:19 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:33:19 user nova-compute[231753]: DEBUG nova.compute.manager [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:33:19 user nova-compute[231753]: DEBUG nova.compute.manager [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:33:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:33:19 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Creating image(s)
Jul 29 13:33:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Acquiring lock "/opt/stack/data/nova/instances/29b21191-c874-4ca8-bd4b-2df90a41ccab/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Lock "/opt/stack/data/nova/instances/29b21191-c874-4ca8-bd4b-2df90a41ccab/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Lock "/opt/stack/data/nova/instances/29b21191-c874-4ca8-bd4b-2df90a41ccab/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.133s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:19 user nova-compute[231753]: DEBUG nova.policy [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3ccd0a728ae043b9b5448782692f56be', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce9dc2164ff54e37bb6ef76285c1a9ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:33:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.126s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/29b21191-c874-4ca8-bd4b-2df90a41ccab/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/29b21191-c874-4ca8-bd4b-2df90a41ccab/disk 1073741824" returned: 0 in 0.075s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:19 user nova-compute[231753]: DEBUG nova.network.neutron [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Successfully updated port: d219916c-23c3-4319-ad8e-9d04e9399ab7 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:33:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "refresh_cache-4475f276-acc4-44f1-a5fa-6a7fb2165493" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:33:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquired lock "refresh_cache-4475f276-acc4-44f1-a5fa-6a7fb2165493" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:33:19 user nova-compute[231753]: DEBUG nova.network.neutron [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:33:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.131s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:19 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Checking if we can resize image /opt/stack/data/nova/instances/29b21191-c874-4ca8-bd4b-2df90a41ccab/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:33:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b21191-c874-4ca8-bd4b-2df90a41ccab/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b21191-c874-4ca8-bd4b-2df90a41ccab/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:19 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Cannot resize image /opt/stack/data/nova/instances/29b21191-c874-4ca8-bd4b-2df90a41ccab/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:33:19 user nova-compute[231753]: DEBUG nova.objects.instance [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Lazy-loading 'migration_context' on Instance uuid 29b21191-c874-4ca8-bd4b-2df90a41ccab {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:33:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:33:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Ensure instance console log exists: /opt/stack/data/nova/instances/29b21191-c874-4ca8-bd4b-2df90a41ccab/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:33:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:20 user nova-compute[231753]: DEBUG nova.network.neutron [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:33:20 user nova-compute[231753]: DEBUG nova.compute.manager [req-ace9816c-7de8-4921-9bcc-f51b898912d8 req-c7ffa944-cdd8-44bb-a955-59696a017e8b service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Received event network-changed-d219916c-23c3-4319-ad8e-9d04e9399ab7 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:33:20 user nova-compute[231753]: DEBUG nova.compute.manager [req-ace9816c-7de8-4921-9bcc-f51b898912d8 req-c7ffa944-cdd8-44bb-a955-59696a017e8b service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Refreshing instance network info cache due to event network-changed-d219916c-23c3-4319-ad8e-9d04e9399ab7. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:33:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ace9816c-7de8-4921-9bcc-f51b898912d8 req-c7ffa944-cdd8-44bb-a955-59696a017e8b service nova] Acquiring lock "refresh_cache-4475f276-acc4-44f1-a5fa-6a7fb2165493" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:33:20 user nova-compute[231753]: DEBUG nova.network.neutron [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Successfully created port: 2a7981fb-647d-4610-9da2-3b162f366dfe {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:33:20 user nova-compute[231753]: DEBUG nova.network.neutron [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Successfully updated port: fadc1466-5336-4230-b0f1-4fe4053f216a {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:33:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Acquiring lock "refresh_cache-63fad324-aac2-4d60-b4ce-a32a5736657d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:33:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Acquired lock "refresh_cache-63fad324-aac2-4d60-b4ce-a32a5736657d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:33:20 user nova-compute[231753]: DEBUG nova.network.neutron [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:33:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Acquiring lock "b67b98f8-a7b3-499e-ba32-9520bbced960" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lock "b67b98f8-a7b3-499e-ba32-9520bbced960" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:20 user nova-compute[231753]: DEBUG nova.compute.manager [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:33:20 user nova-compute[231753]: DEBUG nova.network.neutron [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:33:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:20 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:33:20 user nova-compute[231753]: INFO nova.compute.claims [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Claim successful on node user
Jul 29 13:33:20 user nova-compute[231753]: DEBUG nova.compute.manager [req-5640c7a3-4316-4b20-8679-38c4d2cdfa3d req-3142c6ee-1629-4ba0-88f9-6962951ba6cb service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Received event network-changed-fadc1466-5336-4230-b0f1-4fe4053f216a {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:33:20 user nova-compute[231753]: DEBUG nova.compute.manager [req-5640c7a3-4316-4b20-8679-38c4d2cdfa3d req-3142c6ee-1629-4ba0-88f9-6962951ba6cb service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Refreshing instance network info cache due to event network-changed-fadc1466-5336-4230-b0f1-4fe4053f216a. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:33:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5640c7a3-4316-4b20-8679-38c4d2cdfa3d req-3142c6ee-1629-4ba0-88f9-6962951ba6cb service nova] Acquiring lock "refresh_cache-63fad324-aac2-4d60-b4ce-a32a5736657d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.network.neutron [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Updating instance_info_cache with network_info: [{"id": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "address": "fa:16:3e:52:5c:6f", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd219916c-23", "ovs_interfaceid": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Releasing lock "refresh_cache-4475f276-acc4-44f1-a5fa-6a7fb2165493" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.compute.manager [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Instance network_info: |[{"id": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "address": "fa:16:3e:52:5c:6f", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd219916c-23", "ovs_interfaceid": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ace9816c-7de8-4921-9bcc-f51b898912d8 req-c7ffa944-cdd8-44bb-a955-59696a017e8b service nova] Acquired lock "refresh_cache-4475f276-acc4-44f1-a5fa-6a7fb2165493" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.network.neutron [req-ace9816c-7de8-4921-9bcc-f51b898912d8 req-c7ffa944-cdd8-44bb-a955-59696a017e8b service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Refreshing network info cache for port d219916c-23c3-4319-ad8e-9d04e9399ab7 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Start _get_guest_xml network_info=[{"id": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "address": "fa:16:3e:52:5c:6f", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd219916c-23", "ovs_interfaceid": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:33:21 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:33:21 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.privsep.utils [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=231753) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1694184066',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1694184066',id=2,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYoEtzU6J31e2RMDk9uaA5VJrLaFlHisUcIiXf7P/keUQzM7WNyYfVc11sJPt9QSdUbn5KUqdeviscTZdrxZy5sAgJHvKAfcyE/2Hc8mSccY6dRh0JEfLln2dwNfX/9jw==',key_name='tempest-keypair-991697156',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d53ebbb5f2e440dfa0cf3950232b4853',ramdisk_id='',reservation_id='r-k5ymi4kt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-460717858',owner_user_name='tempest-AttachVolumeShelveTestJSON-460717858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:33:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='932b5bd757f94be29d52035fd9f70293',uuid=4475f276-acc4-44f1-a5fa-6a7fb2165493,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "address": "fa:16:3e:52:5c:6f", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd219916c-23", "ovs_interfaceid": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Converting VIF {"id": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "address": "fa:16:3e:52:5c:6f", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd219916c-23", "ovs_interfaceid": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:5c:6f,bridge_name='br-int',has_traffic_filtering=True,id=d219916c-23c3-4319-ad8e-9d04e9399ab7,network=Network(9be19067-cc29-4c67-95a0-cf37f95f9fc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd219916c-23') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.objects.instance [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lazy-loading 'pci_devices' on Instance uuid 4475f276-acc4-44f1-a5fa-6a7fb2165493 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:33:21 user nova-compute[231753]:   <uuid>4475f276-acc4-44f1-a5fa-6a7fb2165493</uuid>
Jul 29 13:33:21 user nova-compute[231753]:   <name>instance-00000002</name>
Jul 29 13:33:21 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:33:21 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:33:21 user nova-compute[231753]:   <metadata>
Jul 29 13:33:21 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:33:21 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:33:21 user nova-compute[231753]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1694184066</nova:name>
Jul 29 13:33:21 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:33:21</nova:creationTime>
Jul 29 13:33:21 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:33:21 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:33:21 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:33:21 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:33:21 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:33:21 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:33:21 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:33:21 user nova-compute[231753]:       <nova:owner>
Jul 29 13:33:21 user nova-compute[231753]:         <nova:user uuid="932b5bd757f94be29d52035fd9f70293">tempest-AttachVolumeShelveTestJSON-460717858-project-member</nova:user>
Jul 29 13:33:21 user nova-compute[231753]:         <nova:project uuid="d53ebbb5f2e440dfa0cf3950232b4853">tempest-AttachVolumeShelveTestJSON-460717858</nova:project>
Jul 29 13:33:21 user nova-compute[231753]:       </nova:owner>
Jul 29 13:33:21 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:33:21 user nova-compute[231753]:       <nova:ports>
Jul 29 13:33:21 user nova-compute[231753]:         <nova:port uuid="d219916c-23c3-4319-ad8e-9d04e9399ab7">
Jul 29 13:33:21 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 29 13:33:21 user nova-compute[231753]:         </nova:port>
Jul 29 13:33:21 user nova-compute[231753]:       </nova:ports>
Jul 29 13:33:21 user nova-compute[231753]:     </nova:instance>
Jul 29 13:33:21 user nova-compute[231753]:   </metadata>
Jul 29 13:33:21 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:33:21 user nova-compute[231753]:     <system>
Jul 29 13:33:21 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:33:21 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:33:21 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:33:21 user nova-compute[231753]:       <entry name="serial">4475f276-acc4-44f1-a5fa-6a7fb2165493</entry>
Jul 29 13:33:21 user nova-compute[231753]:       <entry name="uuid">4475f276-acc4-44f1-a5fa-6a7fb2165493</entry>
Jul 29 13:33:21 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:33:21 user nova-compute[231753]:     </system>
Jul 29 13:33:21 user nova-compute[231753]:   </sysinfo>
Jul 29 13:33:21 user nova-compute[231753]:   <os>
Jul 29 13:33:21 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:33:21 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:33:21 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:33:21 user nova-compute[231753]:   </os>
Jul 29 13:33:21 user nova-compute[231753]:   <features>
Jul 29 13:33:21 user nova-compute[231753]:     <acpi/>
Jul 29 13:33:21 user nova-compute[231753]:     <apic/>
Jul 29 13:33:21 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:33:21 user nova-compute[231753]:   </features>
Jul 29 13:33:21 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:33:21 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:33:21 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:33:21 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:33:21 user nova-compute[231753]:   </clock>
Jul 29 13:33:21 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:33:21 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:33:21 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:33:21 user nova-compute[231753]:   </cpu>
Jul 29 13:33:21 user nova-compute[231753]:   <devices>
Jul 29 13:33:21 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:33:21 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:33:21 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/disk"/>
Jul 29 13:33:21 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:33:21 user nova-compute[231753]:     </disk>
Jul 29 13:33:21 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:33:21 user nova-compute[231753]:       <mac address="fa:16:3e:52:5c:6f"/>
Jul 29 13:33:21 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:33:21 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:33:21 user nova-compute[231753]:       <target dev="tapd219916c-23"/>
Jul 29 13:33:21 user nova-compute[231753]:     </interface>
Jul 29 13:33:21 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:33:21 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/console.log" append="off"/>
Jul 29 13:33:21 user nova-compute[231753]:     </serial>
Jul 29 13:33:21 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:33:21 user nova-compute[231753]:     <video>
Jul 29 13:33:21 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:33:21 user nova-compute[231753]:     </video>
Jul 29 13:33:21 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:33:21 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:33:21 user nova-compute[231753]:     </rng>
Jul 29 13:33:21 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:33:21 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:33:21 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:33:21 user nova-compute[231753]:     </memballoon>
Jul 29 13:33:21 user nova-compute[231753]:   </devices>
Jul 29 13:33:21 user nova-compute[231753]: </domain>
Jul 29 13:33:21 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1694184066',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1694184066',id=2,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYoEtzU6J31e2RMDk9uaA5VJrLaFlHisUcIiXf7P/keUQzM7WNyYfVc11sJPt9QSdUbn5KUqdeviscTZdrxZy5sAgJHvKAfcyE/2Hc8mSccY6dRh0JEfLln2dwNfX/9jw==',key_name='tempest-keypair-991697156',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d53ebbb5f2e440dfa0cf3950232b4853',ramdisk_id='',reservation_id='r-k5ymi4kt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-460717858',owner_user_name='tempest-AttachVolumeShelveTestJSON-460717858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:33:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='932b5bd757f94be29d52035fd9f70293',uuid=4475f276-acc4-44f1-a5fa-6a7fb2165493,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "address": "fa:16:3e:52:5c:6f", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd219916c-23", "ovs_interfaceid": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Converting VIF {"id": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "address": "fa:16:3e:52:5c:6f", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd219916c-23", "ovs_interfaceid": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:5c:6f,bridge_name='br-int',has_traffic_filtering=True,id=d219916c-23c3-4319-ad8e-9d04e9399ab7,network=Network(9be19067-cc29-4c67-95a0-cf37f95f9fc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd219916c-23') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG os_vif [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:5c:6f,bridge_name='br-int',has_traffic_filtering=True,id=d219916c-23c3-4319-ad8e-9d04e9399ab7,network=Network(9be19067-cc29-4c67-95a0-cf37f95f9fc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd219916c-23') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Created schema index Interface.name {{(pid=231753) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Created schema index Port.name {{(pid=231753) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Created schema index Bridge.name {{(pid=231753) autocreate_indices /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [POLLOUT] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.452s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.compute.manager [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.compute.manager [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.network.neutron [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:33:21 user nova-compute[231753]: INFO oslo.privsep.daemon [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmp8iywcwvj/privsep.sock']
Jul 29 13:33:21 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.compute.manager [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:33:21 user sudo[240973]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmp8iywcwvj/privsep.sock
Jul 29 13:33:21 user sudo[240973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.compute.manager [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:33:21 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Creating image(s)
Jul 29 13:33:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Acquiring lock "/opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lock "/opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lock "/opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.network.neutron [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Successfully created port: 8a79ae49-c97d-4110-bc3c-2d166db71e50 {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG nova.policy [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f99f3a73b4e4831b25e63b2ef8362c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a6a49685124aaf93030ca59169dde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.146s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.133s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk 1073741824" returned: 0 in 0.048s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.186s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.147s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.network.neutron [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Updating instance_info_cache with network_info: [{"id": "fadc1466-5336-4230-b0f1-4fe4053f216a", "address": "fa:16:3e:df:12:9c", "network": {"id": "8897db8c-6e92-4b9e-b7ee-a69230eb07f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1596242231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a8a3e0bcef4bbc979ef187e4ed48cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc1466-53", "ovs_interfaceid": "fadc1466-5336-4230-b0f1-4fe4053f216a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Releasing lock "refresh_cache-63fad324-aac2-4d60-b4ce-a32a5736657d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.compute.manager [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Instance network_info: |[{"id": "fadc1466-5336-4230-b0f1-4fe4053f216a", "address": "fa:16:3e:df:12:9c", "network": {"id": "8897db8c-6e92-4b9e-b7ee-a69230eb07f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1596242231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a8a3e0bcef4bbc979ef187e4ed48cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc1466-53", "ovs_interfaceid": "fadc1466-5336-4230-b0f1-4fe4053f216a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5640c7a3-4316-4b20-8679-38c4d2cdfa3d req-3142c6ee-1629-4ba0-88f9-6962951ba6cb service nova] Acquired lock "refresh_cache-63fad324-aac2-4d60-b4ce-a32a5736657d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.network.neutron [req-5640c7a3-4316-4b20-8679-38c4d2cdfa3d req-3142c6ee-1629-4ba0-88f9-6962951ba6cb service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Refreshing network info cache for port fadc1466-5336-4230-b0f1-4fe4053f216a {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Start _get_guest_xml network_info=[{"id": "fadc1466-5336-4230-b0f1-4fe4053f216a", "address": "fa:16:3e:df:12:9c", "network": {"id": "8897db8c-6e92-4b9e-b7ee-a69230eb07f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1596242231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a8a3e0bcef4bbc979ef187e4ed48cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc1466-53", "ovs_interfaceid": "fadc1466-5336-4230-b0f1-4fe4053f216a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:33:22 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:33:22 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:33:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-800445599',display_name='tempest-ServerActionsTestOtherB-server-800445599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-800445599',id=1,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK3mwTAZBOJzlYUFtbhzSHDzTYFwqvVO3PSQcWrwJtS4OLSJuALDnCfY5kQP9dq+tAP99lu02YS+c2OW9ZUPQROMcosGuWuOlguzRCIeVSykNGGMYttb7ShY1vz/IoqmQ==',key_name='tempest-keypair-1690887276',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74a8a3e0bcef4bbc979ef187e4ed48cc',ramdisk_id='',reservation_id='r-zypim8f0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1624737976',owner_user_name='tempest-ServerActionsTestOtherB-1624737976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:33:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7361505253f84cf28c8688caf4a0cd16',uuid=63fad324-aac2-4d60-b4ce-a32a5736657d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fadc1466-5336-4230-b0f1-4fe4053f216a", "address": "fa:16:3e:df:12:9c", "network": {"id": "8897db8c-6e92-4b9e-b7ee-a69230eb07f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1596242231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a8a3e0bcef4bbc979ef187e4ed48cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc1466-53", "ovs_interfaceid": "fadc1466-5336-4230-b0f1-4fe4053f216a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Converting VIF {"id": "fadc1466-5336-4230-b0f1-4fe4053f216a", "address": "fa:16:3e:df:12:9c", "network": {"id": "8897db8c-6e92-4b9e-b7ee-a69230eb07f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1596242231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a8a3e0bcef4bbc979ef187e4ed48cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc1466-53", "ovs_interfaceid": "fadc1466-5336-4230-b0f1-4fe4053f216a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:12:9c,bridge_name='br-int',has_traffic_filtering=True,id=fadc1466-5336-4230-b0f1-4fe4053f216a,network=Network(8897db8c-6e92-4b9e-b7ee-a69230eb07f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfadc1466-53') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.objects.instance [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lazy-loading 'pci_devices' on Instance uuid 63fad324-aac2-4d60-b4ce-a32a5736657d {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Cannot resize image /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.objects.instance [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lazy-loading 'migration_context' on Instance uuid b67b98f8-a7b3-499e-ba32-9520bbced960 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Ensure instance console log exists: /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:33:22 user nova-compute[231753]:   <uuid>63fad324-aac2-4d60-b4ce-a32a5736657d</uuid>
Jul 29 13:33:22 user nova-compute[231753]:   <name>instance-00000001</name>
Jul 29 13:33:22 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:33:22 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:33:22 user nova-compute[231753]:   <metadata>
Jul 29 13:33:22 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:33:22 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:33:22 user nova-compute[231753]:       <nova:name>tempest-ServerActionsTestOtherB-server-800445599</nova:name>
Jul 29 13:33:22 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:33:22</nova:creationTime>
Jul 29 13:33:22 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:33:22 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:33:22 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:33:22 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:33:22 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:33:22 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:33:22 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:33:22 user nova-compute[231753]:       <nova:owner>
Jul 29 13:33:22 user nova-compute[231753]:         <nova:user uuid="7361505253f84cf28c8688caf4a0cd16">tempest-ServerActionsTestOtherB-1624737976-project-member</nova:user>
Jul 29 13:33:22 user nova-compute[231753]:         <nova:project uuid="74a8a3e0bcef4bbc979ef187e4ed48cc">tempest-ServerActionsTestOtherB-1624737976</nova:project>
Jul 29 13:33:22 user nova-compute[231753]:       </nova:owner>
Jul 29 13:33:22 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:33:22 user nova-compute[231753]:       <nova:ports>
Jul 29 13:33:22 user nova-compute[231753]:         <nova:port uuid="fadc1466-5336-4230-b0f1-4fe4053f216a">
Jul 29 13:33:22 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 29 13:33:22 user nova-compute[231753]:         </nova:port>
Jul 29 13:33:22 user nova-compute[231753]:       </nova:ports>
Jul 29 13:33:22 user nova-compute[231753]:     </nova:instance>
Jul 29 13:33:22 user nova-compute[231753]:   </metadata>
Jul 29 13:33:22 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:33:22 user nova-compute[231753]:     <system>
Jul 29 13:33:22 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:33:22 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:33:22 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:33:22 user nova-compute[231753]:       <entry name="serial">63fad324-aac2-4d60-b4ce-a32a5736657d</entry>
Jul 29 13:33:22 user nova-compute[231753]:       <entry name="uuid">63fad324-aac2-4d60-b4ce-a32a5736657d</entry>
Jul 29 13:33:22 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:33:22 user nova-compute[231753]:     </system>
Jul 29 13:33:22 user nova-compute[231753]:   </sysinfo>
Jul 29 13:33:22 user nova-compute[231753]:   <os>
Jul 29 13:33:22 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:33:22 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:33:22 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:33:22 user nova-compute[231753]:   </os>
Jul 29 13:33:22 user nova-compute[231753]:   <features>
Jul 29 13:33:22 user nova-compute[231753]:     <acpi/>
Jul 29 13:33:22 user nova-compute[231753]:     <apic/>
Jul 29 13:33:22 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:33:22 user nova-compute[231753]:   </features>
Jul 29 13:33:22 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:33:22 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:33:22 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:33:22 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:33:22 user nova-compute[231753]:   </clock>
Jul 29 13:33:22 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:33:22 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:33:22 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:33:22 user nova-compute[231753]:   </cpu>
Jul 29 13:33:22 user nova-compute[231753]:   <devices>
Jul 29 13:33:22 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:33:22 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:33:22 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk"/>
Jul 29 13:33:22 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:33:22 user nova-compute[231753]:     </disk>
Jul 29 13:33:22 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:33:22 user nova-compute[231753]:       <mac address="fa:16:3e:df:12:9c"/>
Jul 29 13:33:22 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:33:22 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:33:22 user nova-compute[231753]:       <target dev="tapfadc1466-53"/>
Jul 29 13:33:22 user nova-compute[231753]:     </interface>
Jul 29 13:33:22 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:33:22 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/console.log" append="off"/>
Jul 29 13:33:22 user nova-compute[231753]:     </serial>
Jul 29 13:33:22 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:33:22 user nova-compute[231753]:     <video>
Jul 29 13:33:22 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:33:22 user nova-compute[231753]:     </video>
Jul 29 13:33:22 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:33:22 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:33:22 user nova-compute[231753]:     </rng>
Jul 29 13:33:22 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:33:22 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:33:22 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:33:22 user nova-compute[231753]:     </memballoon>
Jul 29 13:33:22 user nova-compute[231753]:   </devices>
Jul 29 13:33:22 user nova-compute[231753]: </domain>
Jul 29 13:33:22 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:33:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-800445599',display_name='tempest-ServerActionsTestOtherB-server-800445599',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-800445599',id=1,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK3mwTAZBOJzlYUFtbhzSHDzTYFwqvVO3PSQcWrwJtS4OLSJuALDnCfY5kQP9dq+tAP99lu02YS+c2OW9ZUPQROMcosGuWuOlguzRCIeVSykNGGMYttb7ShY1vz/IoqmQ==',key_name='tempest-keypair-1690887276',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='74a8a3e0bcef4bbc979ef187e4ed48cc',ramdisk_id='',reservation_id='r-zypim8f0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-1624737976',owner_user_name='tempest-ServerActionsTestOtherB-1624737976-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:33:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7361505253f84cf28c8688caf4a0cd16',uuid=63fad324-aac2-4d60-b4ce-a32a5736657d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fadc1466-5336-4230-b0f1-4fe4053f216a", "address": "fa:16:3e:df:12:9c", "network": {"id": "8897db8c-6e92-4b9e-b7ee-a69230eb07f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1596242231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a8a3e0bcef4bbc979ef187e4ed48cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc1466-53", "ovs_interfaceid": "fadc1466-5336-4230-b0f1-4fe4053f216a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Converting VIF {"id": "fadc1466-5336-4230-b0f1-4fe4053f216a", "address": "fa:16:3e:df:12:9c", "network": {"id": "8897db8c-6e92-4b9e-b7ee-a69230eb07f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1596242231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a8a3e0bcef4bbc979ef187e4ed48cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc1466-53", "ovs_interfaceid": "fadc1466-5336-4230-b0f1-4fe4053f216a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:12:9c,bridge_name='br-int',has_traffic_filtering=True,id=fadc1466-5336-4230-b0f1-4fe4053f216a,network=Network(8897db8c-6e92-4b9e-b7ee-a69230eb07f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfadc1466-53') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG os_vif [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:12:9c,bridge_name='br-int',has_traffic_filtering=True,id=fadc1466-5336-4230-b0f1-4fe4053f216a,network=Network(8897db8c-6e92-4b9e-b7ee-a69230eb07f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfadc1466-53') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.network.neutron [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Successfully updated port: 2a7981fb-647d-4610-9da2-3b162f366dfe {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "refresh_cache-3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquired lock "refresh_cache-3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.network.neutron [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.network.neutron [req-ace9816c-7de8-4921-9bcc-f51b898912d8 req-c7ffa944-cdd8-44bb-a955-59696a017e8b service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Updated VIF entry in instance network info cache for port d219916c-23c3-4319-ad8e-9d04e9399ab7. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:33:22 user nova-compute[231753]: DEBUG nova.network.neutron [req-ace9816c-7de8-4921-9bcc-f51b898912d8 req-c7ffa944-cdd8-44bb-a955-59696a017e8b service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Updating instance_info_cache with network_info: [{"id": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "address": "fa:16:3e:52:5c:6f", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd219916c-23", "ovs_interfaceid": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ace9816c-7de8-4921-9bcc-f51b898912d8 req-c7ffa944-cdd8-44bb-a955-59696a017e8b service nova] Releasing lock "refresh_cache-4475f276-acc4-44f1-a5fa-6a7fb2165493" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:33:23 user sudo[240973]: pam_unix(sudo:session): session closed for user root
Jul 29 13:33:23 user nova-compute[231753]: INFO oslo.privsep.daemon [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Spawned new privsep daemon via rootwrap
Jul 29 13:33:23 user nova-compute[231753]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 29 13:33:23 user nova-compute[231753]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 29 13:33:23 user nova-compute[231753]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none
Jul 29 13:33:23 user nova-compute[231753]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 240992
Jul 29 13:33:23 user nova-compute[231753]: WARNING oslo_privsep.priv_context [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] privsep daemon already running
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.network.neutron [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.compute.manager [req-0f0c52a3-1b02-4358-a89f-0fd007fdcccc req-636327d7-7e27-486d-b4d6-1f5a06bd7a7f service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Received event network-changed-2a7981fb-647d-4610-9da2-3b162f366dfe {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.compute.manager [req-0f0c52a3-1b02-4358-a89f-0fd007fdcccc req-636327d7-7e27-486d-b4d6-1f5a06bd7a7f service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Refreshing instance network info cache due to event network-changed-2a7981fb-647d-4610-9da2-3b162f366dfe. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0f0c52a3-1b02-4358-a89f-0fd007fdcccc req-636327d7-7e27-486d-b4d6-1f5a06bd7a7f service nova] Acquiring lock "refresh_cache-3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd219916c-23, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd219916c-23, col_values=(('external_ids', {'iface-id': 'd219916c-23c3-4319-ad8e-9d04e9399ab7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:5c:6f', 'vm-uuid': '4475f276-acc4-44f1-a5fa-6a7fb2165493'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:23 user nova-compute[231753]: INFO os_vif [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:5c:6f,bridge_name='br-int',has_traffic_filtering=True,id=d219916c-23c3-4319-ad8e-9d04e9399ab7,network=Network(9be19067-cc29-4c67-95a0-cf37f95f9fc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd219916c-23')
Jul 29 13:33:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfadc1466-53, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfadc1466-53, col_values=(('external_ids', {'iface-id': 'fadc1466-5336-4230-b0f1-4fe4053f216a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:12:9c', 'vm-uuid': '63fad324-aac2-4d60-b4ce-a32a5736657d'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:33:23 user nova-compute[231753]: INFO os_vif [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:12:9c,bridge_name='br-int',has_traffic_filtering=True,id=fadc1466-5336-4230-b0f1-4fe4053f216a,network=Network(8897db8c-6e92-4b9e-b7ee-a69230eb07f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfadc1466-53')
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] No VIF found with MAC fa:16:3e:df:12:9c, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] No VIF found with MAC fa:16:3e:52:5c:6f, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.network.neutron [req-5640c7a3-4316-4b20-8679-38c4d2cdfa3d req-3142c6ee-1629-4ba0-88f9-6962951ba6cb service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Updated VIF entry in instance network info cache for port fadc1466-5336-4230-b0f1-4fe4053f216a. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.network.neutron [req-5640c7a3-4316-4b20-8679-38c4d2cdfa3d req-3142c6ee-1629-4ba0-88f9-6962951ba6cb service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Updating instance_info_cache with network_info: [{"id": "fadc1466-5336-4230-b0f1-4fe4053f216a", "address": "fa:16:3e:df:12:9c", "network": {"id": "8897db8c-6e92-4b9e-b7ee-a69230eb07f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1596242231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a8a3e0bcef4bbc979ef187e4ed48cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc1466-53", "ovs_interfaceid": "fadc1466-5336-4230-b0f1-4fe4053f216a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5640c7a3-4316-4b20-8679-38c4d2cdfa3d req-3142c6ee-1629-4ba0-88f9-6962951ba6cb service nova] Releasing lock "refresh_cache-63fad324-aac2-4d60-b4ce-a32a5736657d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.network.neutron [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Updating instance_info_cache with network_info: [{"id": "2a7981fb-647d-4610-9da2-3b162f366dfe", "address": "fa:16:3e:0c:e3:a3", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7981fb-64", "ovs_interfaceid": "2a7981fb-647d-4610-9da2-3b162f366dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Releasing lock "refresh_cache-3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Instance network_info: |[{"id": "2a7981fb-647d-4610-9da2-3b162f366dfe", "address": "fa:16:3e:0c:e3:a3", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7981fb-64", "ovs_interfaceid": "2a7981fb-647d-4610-9da2-3b162f366dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0f0c52a3-1b02-4358-a89f-0fd007fdcccc req-636327d7-7e27-486d-b4d6-1f5a06bd7a7f service nova] Acquired lock "refresh_cache-3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.network.neutron [req-0f0c52a3-1b02-4358-a89f-0fd007fdcccc req-636327d7-7e27-486d-b4d6-1f5a06bd7a7f service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Refreshing network info cache for port 2a7981fb-647d-4610-9da2-3b162f366dfe {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Start _get_guest_xml network_info=[{"id": "2a7981fb-647d-4610-9da2-3b162f366dfe", "address": "fa:16:3e:0c:e3:a3", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7981fb-64", "ovs_interfaceid": "2a7981fb-647d-4610-9da2-3b162f366dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:33:23 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:33:23 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:33:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1236712368',display_name='tempest-ServerActionsTestOtherA-server-1236712368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1236712368',id=3,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuWQgyAL1ZhtINiMb8bBadRX1/6ZehT6zfTT2DNFW6eh8iXvfW0Pq6raR1PDnzRXJlqkmjwTrVF+AwsdLN+yPf0k+X1yx9QfVmcJaO2ivlK/Orc5S8LFrDXUE7UuYGgdQ==',key_name='tempest-keypair-820646002',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='afff9d3d250643c58da9bc5cf5756d1e',ramdisk_id='',reservation_id='r-8q0q0qkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1666416634',owner_user_name='tempest-ServerActionsTestOtherA-1666416634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:33:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='748938c3fbfb4244ab946dcfe4762435',uuid=3b510aaa-49b1-43a9-aba4-fe1ee529b4fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a7981fb-647d-4610-9da2-3b162f366dfe", "address": "fa:16:3e:0c:e3:a3", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7981fb-64", "ovs_interfaceid": "2a7981fb-647d-4610-9da2-3b162f366dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Converting VIF {"id": "2a7981fb-647d-4610-9da2-3b162f366dfe", "address": "fa:16:3e:0c:e3:a3", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7981fb-64", "ovs_interfaceid": "2a7981fb-647d-4610-9da2-3b162f366dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:e3:a3,bridge_name='br-int',has_traffic_filtering=True,id=2a7981fb-647d-4610-9da2-3b162f366dfe,network=Network(f99d9e39-7a5f-481e-905f-4d5a4e920b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a7981fb-64') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.objects.instance [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:33:23 user nova-compute[231753]:   <uuid>3b510aaa-49b1-43a9-aba4-fe1ee529b4fb</uuid>
Jul 29 13:33:23 user nova-compute[231753]:   <name>instance-00000003</name>
Jul 29 13:33:23 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:33:23 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:33:23 user nova-compute[231753]:   <metadata>
Jul 29 13:33:23 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:33:23 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:33:23 user nova-compute[231753]:       <nova:name>tempest-ServerActionsTestOtherA-server-1236712368</nova:name>
Jul 29 13:33:23 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:33:23</nova:creationTime>
Jul 29 13:33:23 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:33:23 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:33:23 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:33:23 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:33:23 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:33:23 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:33:23 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:33:23 user nova-compute[231753]:       <nova:owner>
Jul 29 13:33:23 user nova-compute[231753]:         <nova:user uuid="748938c3fbfb4244ab946dcfe4762435">tempest-ServerActionsTestOtherA-1666416634-project-member</nova:user>
Jul 29 13:33:23 user nova-compute[231753]:         <nova:project uuid="afff9d3d250643c58da9bc5cf5756d1e">tempest-ServerActionsTestOtherA-1666416634</nova:project>
Jul 29 13:33:23 user nova-compute[231753]:       </nova:owner>
Jul 29 13:33:23 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:33:23 user nova-compute[231753]:       <nova:ports>
Jul 29 13:33:23 user nova-compute[231753]:         <nova:port uuid="2a7981fb-647d-4610-9da2-3b162f366dfe">
Jul 29 13:33:23 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 29 13:33:23 user nova-compute[231753]:         </nova:port>
Jul 29 13:33:23 user nova-compute[231753]:       </nova:ports>
Jul 29 13:33:23 user nova-compute[231753]:     </nova:instance>
Jul 29 13:33:23 user nova-compute[231753]:   </metadata>
Jul 29 13:33:23 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:33:23 user nova-compute[231753]:     <system>
Jul 29 13:33:23 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:33:23 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:33:23 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:33:23 user nova-compute[231753]:       <entry name="serial">3b510aaa-49b1-43a9-aba4-fe1ee529b4fb</entry>
Jul 29 13:33:23 user nova-compute[231753]:       <entry name="uuid">3b510aaa-49b1-43a9-aba4-fe1ee529b4fb</entry>
Jul 29 13:33:23 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:33:23 user nova-compute[231753]:     </system>
Jul 29 13:33:23 user nova-compute[231753]:   </sysinfo>
Jul 29 13:33:23 user nova-compute[231753]:   <os>
Jul 29 13:33:23 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:33:23 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:33:23 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:33:23 user nova-compute[231753]:   </os>
Jul 29 13:33:23 user nova-compute[231753]:   <features>
Jul 29 13:33:23 user nova-compute[231753]:     <acpi/>
Jul 29 13:33:23 user nova-compute[231753]:     <apic/>
Jul 29 13:33:23 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:33:23 user nova-compute[231753]:   </features>
Jul 29 13:33:23 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:33:23 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:33:23 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:33:23 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:33:23 user nova-compute[231753]:   </clock>
Jul 29 13:33:23 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:33:23 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:33:23 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:33:23 user nova-compute[231753]:   </cpu>
Jul 29 13:33:23 user nova-compute[231753]:   <devices>
Jul 29 13:33:23 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:33:23 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:33:23 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk"/>
Jul 29 13:33:23 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:33:23 user nova-compute[231753]:     </disk>
Jul 29 13:33:23 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:33:23 user nova-compute[231753]:       <mac address="fa:16:3e:0c:e3:a3"/>
Jul 29 13:33:23 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:33:23 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:33:23 user nova-compute[231753]:       <target dev="tap2a7981fb-64"/>
Jul 29 13:33:23 user nova-compute[231753]:     </interface>
Jul 29 13:33:23 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:33:23 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/console.log" append="off"/>
Jul 29 13:33:23 user nova-compute[231753]:     </serial>
Jul 29 13:33:23 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:33:23 user nova-compute[231753]:     <video>
Jul 29 13:33:23 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:33:23 user nova-compute[231753]:     </video>
Jul 29 13:33:23 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:33:23 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:33:23 user nova-compute[231753]:     </rng>
Jul 29 13:33:23 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:33:23 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:33:23 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:33:23 user nova-compute[231753]:     </memballoon>
Jul 29 13:33:23 user nova-compute[231753]:   </devices>
Jul 29 13:33:23 user nova-compute[231753]: </domain>
Jul 29 13:33:23 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:33:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1236712368',display_name='tempest-ServerActionsTestOtherA-server-1236712368',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1236712368',id=3,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuWQgyAL1ZhtINiMb8bBadRX1/6ZehT6zfTT2DNFW6eh8iXvfW0Pq6raR1PDnzRXJlqkmjwTrVF+AwsdLN+yPf0k+X1yx9QfVmcJaO2ivlK/Orc5S8LFrDXUE7UuYGgdQ==',key_name='tempest-keypair-820646002',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='afff9d3d250643c58da9bc5cf5756d1e',ramdisk_id='',reservation_id='r-8q0q0qkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1666416634',owner_user_name='tempest-ServerActionsTestOtherA-1666416634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:33:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='748938c3fbfb4244ab946dcfe4762435',uuid=3b510aaa-49b1-43a9-aba4-fe1ee529b4fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2a7981fb-647d-4610-9da2-3b162f366dfe", "address": "fa:16:3e:0c:e3:a3", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7981fb-64", "ovs_interfaceid": "2a7981fb-647d-4610-9da2-3b162f366dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Converting VIF {"id": "2a7981fb-647d-4610-9da2-3b162f366dfe", "address": "fa:16:3e:0c:e3:a3", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7981fb-64", "ovs_interfaceid": "2a7981fb-647d-4610-9da2-3b162f366dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0c:e3:a3,bridge_name='br-int',has_traffic_filtering=True,id=2a7981fb-647d-4610-9da2-3b162f366dfe,network=Network(f99d9e39-7a5f-481e-905f-4d5a4e920b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a7981fb-64') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG os_vif [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:e3:a3,bridge_name='br-int',has_traffic_filtering=True,id=2a7981fb-647d-4610-9da2-3b162f366dfe,network=Network(f99d9e39-7a5f-481e-905f-4d5a4e920b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a7981fb-64') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a7981fb-64, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2a7981fb-64, col_values=(('external_ids', {'iface-id': '2a7981fb-647d-4610-9da2-3b162f366dfe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:e3:a3', 'vm-uuid': '3b510aaa-49b1-43a9-aba4-fe1ee529b4fb'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:33:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:33:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:24 user nova-compute[231753]: INFO os_vif [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0c:e3:a3,bridge_name='br-int',has_traffic_filtering=True,id=2a7981fb-647d-4610-9da2-3b162f366dfe,network=Network(f99d9e39-7a5f-481e-905f-4d5a4e920b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a7981fb-64')
Jul 29 13:33:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:33:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] No VIF found with MAC fa:16:3e:0c:e3:a3, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:33:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:24 user nova-compute[231753]: DEBUG nova.network.neutron [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Successfully created port: a19600e4-052d-44b1-87b3-73605975e810 {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:33:25 user nova-compute[231753]: DEBUG nova.network.neutron [req-0f0c52a3-1b02-4358-a89f-0fd007fdcccc req-636327d7-7e27-486d-b4d6-1f5a06bd7a7f service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Updated VIF entry in instance network info cache for port 2a7981fb-647d-4610-9da2-3b162f366dfe. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:33:25 user nova-compute[231753]: DEBUG nova.network.neutron [req-0f0c52a3-1b02-4358-a89f-0fd007fdcccc req-636327d7-7e27-486d-b4d6-1f5a06bd7a7f service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Updating instance_info_cache with network_info: [{"id": "2a7981fb-647d-4610-9da2-3b162f366dfe", "address": "fa:16:3e:0c:e3:a3", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7981fb-64", "ovs_interfaceid": "2a7981fb-647d-4610-9da2-3b162f366dfe", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:33:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0f0c52a3-1b02-4358-a89f-0fd007fdcccc req-636327d7-7e27-486d-b4d6-1f5a06bd7a7f service nova] Releasing lock "refresh_cache-3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:33:25 user nova-compute[231753]: DEBUG nova.network.neutron [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Successfully updated port: 8a79ae49-c97d-4110-bc3c-2d166db71e50 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:33:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Acquiring lock "refresh_cache-29b21191-c874-4ca8-bd4b-2df90a41ccab" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:33:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Acquired lock "refresh_cache-29b21191-c874-4ca8-bd4b-2df90a41ccab" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:33:25 user nova-compute[231753]: DEBUG nova.network.neutron [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:33:25 user nova-compute[231753]: DEBUG nova.compute.manager [req-a6833325-3ec4-488b-9f32-9605af37cb99 req-5a2ac9a3-e392-49b7-aef3-672da1dd40c6 service nova] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Received event network-changed-8a79ae49-c97d-4110-bc3c-2d166db71e50 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:33:25 user nova-compute[231753]: DEBUG nova.compute.manager [req-a6833325-3ec4-488b-9f32-9605af37cb99 req-5a2ac9a3-e392-49b7-aef3-672da1dd40c6 service nova] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Refreshing instance network info cache due to event network-changed-8a79ae49-c97d-4110-bc3c-2d166db71e50. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:33:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a6833325-3ec4-488b-9f32-9605af37cb99 req-5a2ac9a3-e392-49b7-aef3-672da1dd40c6 service nova] Acquiring lock "refresh_cache-29b21191-c874-4ca8-bd4b-2df90a41ccab" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:33:25 user nova-compute[231753]: DEBUG nova.network.neutron [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.network.neutron [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Successfully updated port: a19600e4-052d-44b1-87b3-73605975e810 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Acquiring lock "refresh_cache-b67b98f8-a7b3-499e-ba32-9520bbced960" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Acquired lock "refresh_cache-b67b98f8-a7b3-499e-ba32-9520bbced960" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.network.neutron [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.compute.manager [req-6020e7b0-5e6d-4e95-afb2-6494de0d2328 req-b0b8ef68-8fa1-4717-bdec-ef38c1051890 service nova] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Received event network-changed-a19600e4-052d-44b1-87b3-73605975e810 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.compute.manager [req-6020e7b0-5e6d-4e95-afb2-6494de0d2328 req-b0b8ef68-8fa1-4717-bdec-ef38c1051890 service nova] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Refreshing instance network info cache due to event network-changed-a19600e4-052d-44b1-87b3-73605975e810. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6020e7b0-5e6d-4e95-afb2-6494de0d2328 req-b0b8ef68-8fa1-4717-bdec-ef38c1051890 service nova] Acquiring lock "refresh_cache-b67b98f8-a7b3-499e-ba32-9520bbced960" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.network.neutron [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.network.neutron [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Updating instance_info_cache with network_info: [{"id": "8a79ae49-c97d-4110-bc3c-2d166db71e50", "address": "fa:16:3e:64:b7:b5", "network": {"id": "de8c8e4e-6e79-4561-9e46-e50c218bcea7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-145029142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce9dc2164ff54e37bb6ef76285c1a9ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a79ae49-c9", "ovs_interfaceid": "8a79ae49-c97d-4110-bc3c-2d166db71e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Releasing lock "refresh_cache-29b21191-c874-4ca8-bd4b-2df90a41ccab" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.compute.manager [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Instance network_info: |[{"id": "8a79ae49-c97d-4110-bc3c-2d166db71e50", "address": "fa:16:3e:64:b7:b5", "network": {"id": "de8c8e4e-6e79-4561-9e46-e50c218bcea7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-145029142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce9dc2164ff54e37bb6ef76285c1a9ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a79ae49-c9", "ovs_interfaceid": "8a79ae49-c97d-4110-bc3c-2d166db71e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a6833325-3ec4-488b-9f32-9605af37cb99 req-5a2ac9a3-e392-49b7-aef3-672da1dd40c6 service nova] Acquired lock "refresh_cache-29b21191-c874-4ca8-bd4b-2df90a41ccab" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.network.neutron [req-a6833325-3ec4-488b-9f32-9605af37cb99 req-5a2ac9a3-e392-49b7-aef3-672da1dd40c6 service nova] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Refreshing network info cache for port 8a79ae49-c97d-4110-bc3c-2d166db71e50 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Start _get_guest_xml network_info=[{"id": "8a79ae49-c97d-4110-bc3c-2d166db71e50", "address": "fa:16:3e:64:b7:b5", "network": {"id": "de8c8e4e-6e79-4561-9e46-e50c218bcea7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-145029142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce9dc2164ff54e37bb6ef76285c1a9ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a79ae49-c9", "ovs_interfaceid": "8a79ae49-c97d-4110-bc3c-2d166db71e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:33:26 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:33:26 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:33:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-69582102',display_name='tempest-DeleteServersTestJSON-server-69582102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-69582102',id=4,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce9dc2164ff54e37bb6ef76285c1a9ae',ramdisk_id='',reservation_id='r-o0moj0fr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1837865141',owner_user_name='tempest-DeleteServersTestJSON-1837865141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:33:19Z,user_data=None,user_id='3ccd0a728ae043b9b5448782692f56be',uuid=29b21191-c874-4ca8-bd4b-2df90a41ccab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a79ae49-c97d-4110-bc3c-2d166db71e50", "address": "fa:16:3e:64:b7:b5", "network": {"id": "de8c8e4e-6e79-4561-9e46-e50c218bcea7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-145029142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce9dc2164ff54e37bb6ef76285c1a9ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a79ae49-c9", "ovs_interfaceid": "8a79ae49-c97d-4110-bc3c-2d166db71e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Converting VIF {"id": "8a79ae49-c97d-4110-bc3c-2d166db71e50", "address": "fa:16:3e:64:b7:b5", "network": {"id": "de8c8e4e-6e79-4561-9e46-e50c218bcea7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-145029142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce9dc2164ff54e37bb6ef76285c1a9ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a79ae49-c9", "ovs_interfaceid": "8a79ae49-c97d-4110-bc3c-2d166db71e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:b7:b5,bridge_name='br-int',has_traffic_filtering=True,id=8a79ae49-c97d-4110-bc3c-2d166db71e50,network=Network(de8c8e4e-6e79-4561-9e46-e50c218bcea7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a79ae49-c9') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.objects.instance [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Lazy-loading 'pci_devices' on Instance uuid 29b21191-c874-4ca8-bd4b-2df90a41ccab {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:33:26 user nova-compute[231753]:   <uuid>29b21191-c874-4ca8-bd4b-2df90a41ccab</uuid>
Jul 29 13:33:26 user nova-compute[231753]:   <name>instance-00000004</name>
Jul 29 13:33:26 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:33:26 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:33:26 user nova-compute[231753]:   <metadata>
Jul 29 13:33:26 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:33:26 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:33:26 user nova-compute[231753]:       <nova:name>tempest-DeleteServersTestJSON-server-69582102</nova:name>
Jul 29 13:33:26 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:33:26</nova:creationTime>
Jul 29 13:33:26 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:33:26 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:33:26 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:33:26 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:33:26 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:33:26 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:33:26 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:33:26 user nova-compute[231753]:       <nova:owner>
Jul 29 13:33:26 user nova-compute[231753]:         <nova:user uuid="3ccd0a728ae043b9b5448782692f56be">tempest-DeleteServersTestJSON-1837865141-project-member</nova:user>
Jul 29 13:33:26 user nova-compute[231753]:         <nova:project uuid="ce9dc2164ff54e37bb6ef76285c1a9ae">tempest-DeleteServersTestJSON-1837865141</nova:project>
Jul 29 13:33:26 user nova-compute[231753]:       </nova:owner>
Jul 29 13:33:26 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:33:26 user nova-compute[231753]:       <nova:ports>
Jul 29 13:33:26 user nova-compute[231753]:         <nova:port uuid="8a79ae49-c97d-4110-bc3c-2d166db71e50">
Jul 29 13:33:26 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 29 13:33:26 user nova-compute[231753]:         </nova:port>
Jul 29 13:33:26 user nova-compute[231753]:       </nova:ports>
Jul 29 13:33:26 user nova-compute[231753]:     </nova:instance>
Jul 29 13:33:26 user nova-compute[231753]:   </metadata>
Jul 29 13:33:26 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:33:26 user nova-compute[231753]:     <system>
Jul 29 13:33:26 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:33:26 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:33:26 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:33:26 user nova-compute[231753]:       <entry name="serial">29b21191-c874-4ca8-bd4b-2df90a41ccab</entry>
Jul 29 13:33:26 user nova-compute[231753]:       <entry name="uuid">29b21191-c874-4ca8-bd4b-2df90a41ccab</entry>
Jul 29 13:33:26 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:33:26 user nova-compute[231753]:     </system>
Jul 29 13:33:26 user nova-compute[231753]:   </sysinfo>
Jul 29 13:33:26 user nova-compute[231753]:   <os>
Jul 29 13:33:26 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:33:26 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:33:26 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:33:26 user nova-compute[231753]:   </os>
Jul 29 13:33:26 user nova-compute[231753]:   <features>
Jul 29 13:33:26 user nova-compute[231753]:     <acpi/>
Jul 29 13:33:26 user nova-compute[231753]:     <apic/>
Jul 29 13:33:26 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:33:26 user nova-compute[231753]:   </features>
Jul 29 13:33:26 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:33:26 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:33:26 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:33:26 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:33:26 user nova-compute[231753]:   </clock>
Jul 29 13:33:26 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:33:26 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:33:26 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:33:26 user nova-compute[231753]:   </cpu>
Jul 29 13:33:26 user nova-compute[231753]:   <devices>
Jul 29 13:33:26 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:33:26 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:33:26 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/29b21191-c874-4ca8-bd4b-2df90a41ccab/disk"/>
Jul 29 13:33:26 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:33:26 user nova-compute[231753]:     </disk>
Jul 29 13:33:26 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:33:26 user nova-compute[231753]:       <mac address="fa:16:3e:64:b7:b5"/>
Jul 29 13:33:26 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:33:26 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:33:26 user nova-compute[231753]:       <target dev="tap8a79ae49-c9"/>
Jul 29 13:33:26 user nova-compute[231753]:     </interface>
Jul 29 13:33:26 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:33:26 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/29b21191-c874-4ca8-bd4b-2df90a41ccab/console.log" append="off"/>
Jul 29 13:33:26 user nova-compute[231753]:     </serial>
Jul 29 13:33:26 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:33:26 user nova-compute[231753]:     <video>
Jul 29 13:33:26 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:33:26 user nova-compute[231753]:     </video>
Jul 29 13:33:26 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:33:26 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:33:26 user nova-compute[231753]:     </rng>
Jul 29 13:33:26 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:33:26 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:33:26 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:33:26 user nova-compute[231753]:     </memballoon>
Jul 29 13:33:26 user nova-compute[231753]:   </devices>
Jul 29 13:33:26 user nova-compute[231753]: </domain>
Jul 29 13:33:26 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:33:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-69582102',display_name='tempest-DeleteServersTestJSON-server-69582102',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-69582102',id=4,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ce9dc2164ff54e37bb6ef76285c1a9ae',ramdisk_id='',reservation_id='r-o0moj0fr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-1837865141',owner_user_name='tempest-DeleteServersTestJSON-1837865141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:33:19Z,user_data=None,user_id='3ccd0a728ae043b9b5448782692f56be',uuid=29b21191-c874-4ca8-bd4b-2df90a41ccab,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8a79ae49-c97d-4110-bc3c-2d166db71e50", "address": "fa:16:3e:64:b7:b5", "network": {"id": "de8c8e4e-6e79-4561-9e46-e50c218bcea7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-145029142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce9dc2164ff54e37bb6ef76285c1a9ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a79ae49-c9", "ovs_interfaceid": "8a79ae49-c97d-4110-bc3c-2d166db71e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Converting VIF {"id": "8a79ae49-c97d-4110-bc3c-2d166db71e50", "address": "fa:16:3e:64:b7:b5", "network": {"id": "de8c8e4e-6e79-4561-9e46-e50c218bcea7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-145029142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce9dc2164ff54e37bb6ef76285c1a9ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a79ae49-c9", "ovs_interfaceid": "8a79ae49-c97d-4110-bc3c-2d166db71e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:b7:b5,bridge_name='br-int',has_traffic_filtering=True,id=8a79ae49-c97d-4110-bc3c-2d166db71e50,network=Network(de8c8e4e-6e79-4561-9e46-e50c218bcea7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a79ae49-c9') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG os_vif [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:b7:b5,bridge_name='br-int',has_traffic_filtering=True,id=8a79ae49-c97d-4110-bc3c-2d166db71e50,network=Network(de8c8e4e-6e79-4561-9e46-e50c218bcea7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a79ae49-c9') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8a79ae49-c9, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8a79ae49-c9, col_values=(('external_ids', {'iface-id': '8a79ae49-c97d-4110-bc3c-2d166db71e50', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:64:b7:b5', 'vm-uuid': '29b21191-c874-4ca8-bd4b-2df90a41ccab'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:26 user nova-compute[231753]: INFO os_vif [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:b7:b5,bridge_name='br-int',has_traffic_filtering=True,id=8a79ae49-c97d-4110-bc3c-2d166db71e50,network=Network(de8c8e4e-6e79-4561-9e46-e50c218bcea7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a79ae49-c9')
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] No VIF found with MAC fa:16:3e:64:b7:b5, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.network.neutron [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Updating instance_info_cache with network_info: [{"id": "a19600e4-052d-44b1-87b3-73605975e810", "address": "fa:16:3e:7a:6e:42", "network": {"id": "092d27a5-871f-4865-ac97-fbb701a5c807", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-907499567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a6a49685124aaf93030ca59169dde5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa19600e4-05", "ovs_interfaceid": "a19600e4-052d-44b1-87b3-73605975e810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Releasing lock "refresh_cache-b67b98f8-a7b3-499e-ba32-9520bbced960" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.compute.manager [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Instance network_info: |[{"id": "a19600e4-052d-44b1-87b3-73605975e810", "address": "fa:16:3e:7a:6e:42", "network": {"id": "092d27a5-871f-4865-ac97-fbb701a5c807", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-907499567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a6a49685124aaf93030ca59169dde5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa19600e4-05", "ovs_interfaceid": "a19600e4-052d-44b1-87b3-73605975e810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6020e7b0-5e6d-4e95-afb2-6494de0d2328 req-b0b8ef68-8fa1-4717-bdec-ef38c1051890 service nova] Acquired lock "refresh_cache-b67b98f8-a7b3-499e-ba32-9520bbced960" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.network.neutron [req-6020e7b0-5e6d-4e95-afb2-6494de0d2328 req-b0b8ef68-8fa1-4717-bdec-ef38c1051890 service nova] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Refreshing network info cache for port a19600e4-052d-44b1-87b3-73605975e810 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Start _get_guest_xml network_info=[{"id": "a19600e4-052d-44b1-87b3-73605975e810", "address": "fa:16:3e:7a:6e:42", "network": {"id": "092d27a5-871f-4865-ac97-fbb701a5c807", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-907499567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a6a49685124aaf93030ca59169dde5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa19600e4-05", "ovs_interfaceid": "a19600e4-052d-44b1-87b3-73605975e810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:33:26 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:33:26 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:33:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1305715448',display_name='tempest-ServersNegativeTestJSON-server-1305715448',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1305715448',id=5,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35a6a49685124aaf93030ca59169dde5',ramdisk_id='',reservation_id='r-k1vh7jit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1215130688',owner_user_name='tempest-ServersNegativeTestJSON-1215130688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:33:22Z,user_data=None,user_id='0f99f3a73b4e4831b25e63b2ef8362c9',uuid=b67b98f8-a7b3-499e-ba32-9520bbced960,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a19600e4-052d-44b1-87b3-73605975e810", "address": "fa:16:3e:7a:6e:42", "network": {"id": "092d27a5-871f-4865-ac97-fbb701a5c807", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-907499567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a6a49685124aaf93030ca59169dde5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa19600e4-05", "ovs_interfaceid": "a19600e4-052d-44b1-87b3-73605975e810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Converting VIF {"id": "a19600e4-052d-44b1-87b3-73605975e810", "address": "fa:16:3e:7a:6e:42", "network": {"id": "092d27a5-871f-4865-ac97-fbb701a5c807", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-907499567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a6a49685124aaf93030ca59169dde5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa19600e4-05", "ovs_interfaceid": "a19600e4-052d-44b1-87b3-73605975e810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:6e:42,bridge_name='br-int',has_traffic_filtering=True,id=a19600e4-052d-44b1-87b3-73605975e810,network=Network(092d27a5-871f-4865-ac97-fbb701a5c807),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa19600e4-05') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.objects.instance [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lazy-loading 'pci_devices' on Instance uuid b67b98f8-a7b3-499e-ba32-9520bbced960 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:33:26 user nova-compute[231753]:   <uuid>b67b98f8-a7b3-499e-ba32-9520bbced960</uuid>
Jul 29 13:33:26 user nova-compute[231753]:   <name>instance-00000005</name>
Jul 29 13:33:26 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:33:26 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:33:26 user nova-compute[231753]:   <metadata>
Jul 29 13:33:26 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:33:26 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:33:26 user nova-compute[231753]:       <nova:name>tempest-ServersNegativeTestJSON-server-1305715448</nova:name>
Jul 29 13:33:26 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:33:26</nova:creationTime>
Jul 29 13:33:26 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:33:26 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:33:26 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:33:26 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:33:26 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:33:26 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:33:26 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:33:26 user nova-compute[231753]:       <nova:owner>
Jul 29 13:33:26 user nova-compute[231753]:         <nova:user uuid="0f99f3a73b4e4831b25e63b2ef8362c9">tempest-ServersNegativeTestJSON-1215130688-project-member</nova:user>
Jul 29 13:33:26 user nova-compute[231753]:         <nova:project uuid="35a6a49685124aaf93030ca59169dde5">tempest-ServersNegativeTestJSON-1215130688</nova:project>
Jul 29 13:33:26 user nova-compute[231753]:       </nova:owner>
Jul 29 13:33:26 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:33:26 user nova-compute[231753]:       <nova:ports>
Jul 29 13:33:26 user nova-compute[231753]:         <nova:port uuid="a19600e4-052d-44b1-87b3-73605975e810">
Jul 29 13:33:26 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 29 13:33:26 user nova-compute[231753]:         </nova:port>
Jul 29 13:33:26 user nova-compute[231753]:       </nova:ports>
Jul 29 13:33:26 user nova-compute[231753]:     </nova:instance>
Jul 29 13:33:26 user nova-compute[231753]:   </metadata>
Jul 29 13:33:26 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:33:26 user nova-compute[231753]:     <system>
Jul 29 13:33:26 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:33:26 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:33:26 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:33:26 user nova-compute[231753]:       <entry name="serial">b67b98f8-a7b3-499e-ba32-9520bbced960</entry>
Jul 29 13:33:26 user nova-compute[231753]:       <entry name="uuid">b67b98f8-a7b3-499e-ba32-9520bbced960</entry>
Jul 29 13:33:26 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:33:26 user nova-compute[231753]:     </system>
Jul 29 13:33:26 user nova-compute[231753]:   </sysinfo>
Jul 29 13:33:26 user nova-compute[231753]:   <os>
Jul 29 13:33:26 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:33:26 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:33:26 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:33:26 user nova-compute[231753]:   </os>
Jul 29 13:33:26 user nova-compute[231753]:   <features>
Jul 29 13:33:26 user nova-compute[231753]:     <acpi/>
Jul 29 13:33:26 user nova-compute[231753]:     <apic/>
Jul 29 13:33:26 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:33:26 user nova-compute[231753]:   </features>
Jul 29 13:33:26 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:33:26 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:33:26 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:33:26 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:33:26 user nova-compute[231753]:   </clock>
Jul 29 13:33:26 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:33:26 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:33:26 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:33:26 user nova-compute[231753]:   </cpu>
Jul 29 13:33:26 user nova-compute[231753]:   <devices>
Jul 29 13:33:26 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:33:26 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:33:26 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk"/>
Jul 29 13:33:26 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:33:26 user nova-compute[231753]:     </disk>
Jul 29 13:33:26 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:33:26 user nova-compute[231753]:       <mac address="fa:16:3e:7a:6e:42"/>
Jul 29 13:33:26 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:33:26 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:33:26 user nova-compute[231753]:       <target dev="tapa19600e4-05"/>
Jul 29 13:33:26 user nova-compute[231753]:     </interface>
Jul 29 13:33:26 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:33:26 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/console.log" append="off"/>
Jul 29 13:33:26 user nova-compute[231753]:     </serial>
Jul 29 13:33:26 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:33:26 user nova-compute[231753]:     <video>
Jul 29 13:33:26 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:33:26 user nova-compute[231753]:     </video>
Jul 29 13:33:26 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:33:26 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:33:26 user nova-compute[231753]:     </rng>
Jul 29 13:33:26 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:33:26 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:33:26 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:33:26 user nova-compute[231753]:     </memballoon>
Jul 29 13:33:26 user nova-compute[231753]:   </devices>
Jul 29 13:33:26 user nova-compute[231753]: </domain>
Jul 29 13:33:26 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:33:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1305715448',display_name='tempest-ServersNegativeTestJSON-server-1305715448',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1305715448',id=5,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35a6a49685124aaf93030ca59169dde5',ramdisk_id='',reservation_id='r-k1vh7jit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1215130688',owner_user_name='tempest-ServersNegativeTestJSON-1215130688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:33:22Z,user_data=None,user_id='0f99f3a73b4e4831b25e63b2ef8362c9',uuid=b67b98f8-a7b3-499e-ba32-9520bbced960,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a19600e4-052d-44b1-87b3-73605975e810", "address": "fa:16:3e:7a:6e:42", "network": {"id": "092d27a5-871f-4865-ac97-fbb701a5c807", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-907499567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a6a49685124aaf93030ca59169dde5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa19600e4-05", "ovs_interfaceid": "a19600e4-052d-44b1-87b3-73605975e810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Converting VIF {"id": "a19600e4-052d-44b1-87b3-73605975e810", "address": "fa:16:3e:7a:6e:42", "network": {"id": "092d27a5-871f-4865-ac97-fbb701a5c807", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-907499567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a6a49685124aaf93030ca59169dde5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa19600e4-05", "ovs_interfaceid": "a19600e4-052d-44b1-87b3-73605975e810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:7a:6e:42,bridge_name='br-int',has_traffic_filtering=True,id=a19600e4-052d-44b1-87b3-73605975e810,network=Network(092d27a5-871f-4865-ac97-fbb701a5c807),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa19600e4-05') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG os_vif [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:6e:42,bridge_name='br-int',has_traffic_filtering=True,id=a19600e4-052d-44b1-87b3-73605975e810,network=Network(092d27a5-871f-4865-ac97-fbb701a5c807),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa19600e4-05') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa19600e4-05, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa19600e4-05, col_values=(('external_ids', {'iface-id': 'a19600e4-052d-44b1-87b3-73605975e810', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:7a:6e:42', 'vm-uuid': 'b67b98f8-a7b3-499e-ba32-9520bbced960'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:26 user nova-compute[231753]: INFO os_vif [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:7a:6e:42,bridge_name='br-int',has_traffic_filtering=True,id=a19600e4-052d-44b1-87b3-73605975e810,network=Network(092d27a5-871f-4865-ac97-fbb701a5c807),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa19600e4-05')
Jul 29 13:33:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:33:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] No VIF found with MAC fa:16:3e:7a:6e:42, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:33:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:27 user nova-compute[231753]: DEBUG nova.network.neutron [req-6020e7b0-5e6d-4e95-afb2-6494de0d2328 req-b0b8ef68-8fa1-4717-bdec-ef38c1051890 service nova] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Updated VIF entry in instance network info cache for port a19600e4-052d-44b1-87b3-73605975e810. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:33:27 user nova-compute[231753]: DEBUG nova.network.neutron [req-6020e7b0-5e6d-4e95-afb2-6494de0d2328 req-b0b8ef68-8fa1-4717-bdec-ef38c1051890 service nova] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Updating instance_info_cache with network_info: [{"id": "a19600e4-052d-44b1-87b3-73605975e810", "address": "fa:16:3e:7a:6e:42", "network": {"id": "092d27a5-871f-4865-ac97-fbb701a5c807", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-907499567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a6a49685124aaf93030ca59169dde5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa19600e4-05", "ovs_interfaceid": "a19600e4-052d-44b1-87b3-73605975e810", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:33:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6020e7b0-5e6d-4e95-afb2-6494de0d2328 req-b0b8ef68-8fa1-4717-bdec-ef38c1051890 service nova] Releasing lock "refresh_cache-b67b98f8-a7b3-499e-ba32-9520bbced960" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:33:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Acquiring lock "299b7f21-b198-437b-9d5c-1269d5e9b7c8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "299b7f21-b198-437b-9d5c-1269d5e9b7c8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:27 user nova-compute[231753]: DEBUG nova.compute.manager [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:33:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:28 user nova-compute[231753]: DEBUG nova.compute.manager [req-1b027194-c564-4c6c-be7d-112f721f9111 req-ad810c8b-dc11-405f-b11e-f6750d67d58b service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Received event network-vif-plugged-d219916c-23c3-4319-ad8e-9d04e9399ab7 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:33:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-1b027194-c564-4c6c-be7d-112f721f9111 req-ad810c8b-dc11-405f-b11e-f6750d67d58b service nova] Acquiring lock "4475f276-acc4-44f1-a5fa-6a7fb2165493-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-1b027194-c564-4c6c-be7d-112f721f9111 req-ad810c8b-dc11-405f-b11e-f6750d67d58b service nova] Lock "4475f276-acc4-44f1-a5fa-6a7fb2165493-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-1b027194-c564-4c6c-be7d-112f721f9111 req-ad810c8b-dc11-405f-b11e-f6750d67d58b service nova] Lock "4475f276-acc4-44f1-a5fa-6a7fb2165493-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:28 user nova-compute[231753]: DEBUG nova.compute.manager [req-1b027194-c564-4c6c-be7d-112f721f9111 req-ad810c8b-dc11-405f-b11e-f6750d67d58b service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] No waiting events found dispatching network-vif-plugged-d219916c-23c3-4319-ad8e-9d04e9399ab7 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:33:28 user nova-compute[231753]: WARNING nova.compute.manager [req-1b027194-c564-4c6c-be7d-112f721f9111 req-ad810c8b-dc11-405f-b11e-f6750d67d58b service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Received unexpected event network-vif-plugged-d219916c-23c3-4319-ad8e-9d04e9399ab7 for instance with vm_state building and task_state spawning.
Jul 29 13:33:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:28 user nova-compute[231753]: DEBUG nova.compute.manager [req-9f713bba-f4b1-4d13-9b24-99491d719cfe req-61d813c6-6a86-4723-8c9d-b376d70b22b7 service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Received event network-vif-plugged-2a7981fb-647d-4610-9da2-3b162f366dfe {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:33:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9f713bba-f4b1-4d13-9b24-99491d719cfe req-61d813c6-6a86-4723-8c9d-b376d70b22b7 service nova] Acquiring lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9f713bba-f4b1-4d13-9b24-99491d719cfe req-61d813c6-6a86-4723-8c9d-b376d70b22b7 service nova] Lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9f713bba-f4b1-4d13-9b24-99491d719cfe req-61d813c6-6a86-4723-8c9d-b376d70b22b7 service nova] Lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:28 user nova-compute[231753]: DEBUG nova.compute.manager [req-9f713bba-f4b1-4d13-9b24-99491d719cfe req-61d813c6-6a86-4723-8c9d-b376d70b22b7 service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] No waiting events found dispatching network-vif-plugged-2a7981fb-647d-4610-9da2-3b162f366dfe {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:33:28 user nova-compute[231753]: WARNING nova.compute.manager [req-9f713bba-f4b1-4d13-9b24-99491d719cfe req-61d813c6-6a86-4723-8c9d-b376d70b22b7 service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Received unexpected event network-vif-plugged-2a7981fb-647d-4610-9da2-3b162f366dfe for instance with vm_state building and task_state spawning.
Jul 29 13:33:28 user nova-compute[231753]: DEBUG nova.network.neutron [req-a6833325-3ec4-488b-9f32-9605af37cb99 req-5a2ac9a3-e392-49b7-aef3-672da1dd40c6 service nova] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Updated VIF entry in instance network info cache for port 8a79ae49-c97d-4110-bc3c-2d166db71e50. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:33:28 user nova-compute[231753]: DEBUG nova.network.neutron [req-a6833325-3ec4-488b-9f32-9605af37cb99 req-5a2ac9a3-e392-49b7-aef3-672da1dd40c6 service nova] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Updating instance_info_cache with network_info: [{"id": "8a79ae49-c97d-4110-bc3c-2d166db71e50", "address": "fa:16:3e:64:b7:b5", "network": {"id": "de8c8e4e-6e79-4561-9e46-e50c218bcea7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-145029142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce9dc2164ff54e37bb6ef76285c1a9ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a79ae49-c9", "ovs_interfaceid": "8a79ae49-c97d-4110-bc3c-2d166db71e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:33:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a6833325-3ec4-488b-9f32-9605af37cb99 req-5a2ac9a3-e392-49b7-aef3-672da1dd40c6 service nova] Releasing lock "refresh_cache-29b21191-c874-4ca8-bd4b-2df90a41ccab" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:33:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:30 user nova-compute[231753]: DEBUG nova.compute.manager [req-2ea9941f-3901-4006-818f-6043ae2bb13a req-b08faa25-3afe-4deb-a957-8dd4fde74a87 service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Received event network-vif-plugged-d219916c-23c3-4319-ad8e-9d04e9399ab7 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:33:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-2ea9941f-3901-4006-818f-6043ae2bb13a req-b08faa25-3afe-4deb-a957-8dd4fde74a87 service nova] Acquiring lock "4475f276-acc4-44f1-a5fa-6a7fb2165493-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-2ea9941f-3901-4006-818f-6043ae2bb13a req-b08faa25-3afe-4deb-a957-8dd4fde74a87 service nova] Lock "4475f276-acc4-44f1-a5fa-6a7fb2165493-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-2ea9941f-3901-4006-818f-6043ae2bb13a req-b08faa25-3afe-4deb-a957-8dd4fde74a87 service nova] Lock "4475f276-acc4-44f1-a5fa-6a7fb2165493-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:30 user nova-compute[231753]: DEBUG nova.compute.manager [req-2ea9941f-3901-4006-818f-6043ae2bb13a req-b08faa25-3afe-4deb-a957-8dd4fde74a87 service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] No waiting events found dispatching network-vif-plugged-d219916c-23c3-4319-ad8e-9d04e9399ab7 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:33:30 user nova-compute[231753]: WARNING nova.compute.manager [req-2ea9941f-3901-4006-818f-6043ae2bb13a req-b08faa25-3afe-4deb-a957-8dd4fde74a87 service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Received unexpected event network-vif-plugged-d219916c-23c3-4319-ad8e-9d04e9399ab7 for instance with vm_state building and task_state spawning.
Jul 29 13:33:30 user nova-compute[231753]: DEBUG nova.compute.manager [req-2ea9941f-3901-4006-818f-6043ae2bb13a req-b08faa25-3afe-4deb-a957-8dd4fde74a87 service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Received event network-vif-plugged-fadc1466-5336-4230-b0f1-4fe4053f216a {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:33:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-2ea9941f-3901-4006-818f-6043ae2bb13a req-b08faa25-3afe-4deb-a957-8dd4fde74a87 service nova] Acquiring lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-2ea9941f-3901-4006-818f-6043ae2bb13a req-b08faa25-3afe-4deb-a957-8dd4fde74a87 service nova] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-2ea9941f-3901-4006-818f-6043ae2bb13a req-b08faa25-3afe-4deb-a957-8dd4fde74a87 service nova] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:30 user nova-compute[231753]: DEBUG nova.compute.manager [req-2ea9941f-3901-4006-818f-6043ae2bb13a req-b08faa25-3afe-4deb-a957-8dd4fde74a87 service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] No waiting events found dispatching network-vif-plugged-fadc1466-5336-4230-b0f1-4fe4053f216a {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:33:30 user nova-compute[231753]: WARNING nova.compute.manager [req-2ea9941f-3901-4006-818f-6043ae2bb13a req-b08faa25-3afe-4deb-a957-8dd4fde74a87 service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Received unexpected event network-vif-plugged-fadc1466-5336-4230-b0f1-4fe4053f216a for instance with vm_state building and task_state spawning.
Jul 29 13:33:30 user nova-compute[231753]: DEBUG nova.compute.manager [req-2ea9941f-3901-4006-818f-6043ae2bb13a req-b08faa25-3afe-4deb-a957-8dd4fde74a87 service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Received event network-vif-plugged-fadc1466-5336-4230-b0f1-4fe4053f216a {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:33:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-2ea9941f-3901-4006-818f-6043ae2bb13a req-b08faa25-3afe-4deb-a957-8dd4fde74a87 service nova] Acquiring lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-2ea9941f-3901-4006-818f-6043ae2bb13a req-b08faa25-3afe-4deb-a957-8dd4fde74a87 service nova] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-2ea9941f-3901-4006-818f-6043ae2bb13a req-b08faa25-3afe-4deb-a957-8dd4fde74a87 service nova] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:30 user nova-compute[231753]: DEBUG nova.compute.manager [req-2ea9941f-3901-4006-818f-6043ae2bb13a req-b08faa25-3afe-4deb-a957-8dd4fde74a87 service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] No waiting events found dispatching network-vif-plugged-fadc1466-5336-4230-b0f1-4fe4053f216a {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:33:30 user nova-compute[231753]: WARNING nova.compute.manager [req-2ea9941f-3901-4006-818f-6043ae2bb13a req-b08faa25-3afe-4deb-a957-8dd4fde74a87 service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Received unexpected event network-vif-plugged-fadc1466-5336-4230-b0f1-4fe4053f216a for instance with vm_state building and task_state spawning.
Jul 29 13:33:30 user nova-compute[231753]: DEBUG nova.compute.manager [req-33ddca23-a9de-425e-be59-37815fb1f7a1 req-bbf5c844-694f-43d0-bded-bc409fd72726 service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Received event network-vif-plugged-2a7981fb-647d-4610-9da2-3b162f366dfe {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:33:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-33ddca23-a9de-425e-be59-37815fb1f7a1 req-bbf5c844-694f-43d0-bded-bc409fd72726 service nova] Acquiring lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-33ddca23-a9de-425e-be59-37815fb1f7a1 req-bbf5c844-694f-43d0-bded-bc409fd72726 service nova] Lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-33ddca23-a9de-425e-be59-37815fb1f7a1 req-bbf5c844-694f-43d0-bded-bc409fd72726 service nova] Lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:30 user nova-compute[231753]: DEBUG nova.compute.manager [req-33ddca23-a9de-425e-be59-37815fb1f7a1 req-bbf5c844-694f-43d0-bded-bc409fd72726 service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] No waiting events found dispatching network-vif-plugged-2a7981fb-647d-4610-9da2-3b162f366dfe {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:33:30 user nova-compute[231753]: WARNING nova.compute.manager [req-33ddca23-a9de-425e-be59-37815fb1f7a1 req-bbf5c844-694f-43d0-bded-bc409fd72726 service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Received unexpected event network-vif-plugged-2a7981fb-647d-4610-9da2-3b162f366dfe for instance with vm_state building and task_state spawning.
Jul 29 13:33:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:31 user nova-compute[231753]: DEBUG nova.compute.manager [req-e07af8c2-2e7c-477a-a15f-40514a00a0f1 req-aa18dfe1-3610-4fa8-9b48-891712ef9edb service nova] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Received event network-vif-plugged-8a79ae49-c97d-4110-bc3c-2d166db71e50 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:33:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e07af8c2-2e7c-477a-a15f-40514a00a0f1 req-aa18dfe1-3610-4fa8-9b48-891712ef9edb service nova] Acquiring lock "29b21191-c874-4ca8-bd4b-2df90a41ccab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e07af8c2-2e7c-477a-a15f-40514a00a0f1 req-aa18dfe1-3610-4fa8-9b48-891712ef9edb service nova] Lock "29b21191-c874-4ca8-bd4b-2df90a41ccab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e07af8c2-2e7c-477a-a15f-40514a00a0f1 req-aa18dfe1-3610-4fa8-9b48-891712ef9edb service nova] Lock "29b21191-c874-4ca8-bd4b-2df90a41ccab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:31 user nova-compute[231753]: DEBUG nova.compute.manager [req-e07af8c2-2e7c-477a-a15f-40514a00a0f1 req-aa18dfe1-3610-4fa8-9b48-891712ef9edb service nova] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] No waiting events found dispatching network-vif-plugged-8a79ae49-c97d-4110-bc3c-2d166db71e50 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:33:31 user nova-compute[231753]: WARNING nova.compute.manager [req-e07af8c2-2e7c-477a-a15f-40514a00a0f1 req-aa18dfe1-3610-4fa8-9b48-891712ef9edb service nova] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Received unexpected event network-vif-plugged-8a79ae49-c97d-4110-bc3c-2d166db71e50 for instance with vm_state building and task_state spawning.
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637612.079618, 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:33:32 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] VM Resumed (Lifecycle Event)
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.compute.manager [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:33:32 user nova-compute[231753]: INFO nova.compute.claims [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Claim successful on node user
Jul 29 13:33:32 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Instance spawned successfully.
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:33:32 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637612.0856955, 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:33:32 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] VM Started (Lifecycle Event)
Jul 29 13:33:32 user nova-compute[231753]: INFO nova.compute.manager [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Took 15.02 seconds to spawn the instance on the hypervisor.
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.compute.manager [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:33:32 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.compute.manager [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637612.4956148, 63fad324-aac2-4d60-b4ce-a32a5736657d => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:33:32 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] VM Resumed (Lifecycle Event)
Jul 29 13:33:32 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Instance spawned successfully.
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:33:32 user nova-compute[231753]: INFO nova.compute.manager [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Took 16.15 seconds to build instance.
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c61302cc-cedc-4d4f-92e7-60b9760af41a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.361s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:33:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:32 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637612.5010686, 63fad324-aac2-4d60-b4ce-a32a5736657d => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:33:32 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] VM Started (Lifecycle Event)
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:33:32 user nova-compute[231753]: INFO nova.compute.manager [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Took 20.42 seconds to spawn the instance on the hypervisor.
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.compute.manager [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:33:32 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:33:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 4.965s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.compute.manager [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.compute.manager [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:33:32 user nova-compute[231753]: DEBUG nova.network.neutron [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:33:33 user nova-compute[231753]: INFO nova.compute.manager [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Took 21.52 seconds to build instance.
Jul 29 13:33:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0bd3f992-d236-475d-a1f7-e638a8169f14 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.786s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:33 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:33:33 user nova-compute[231753]: DEBUG nova.compute.manager [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:33:33 user nova-compute[231753]: DEBUG nova.compute.manager [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:33:33 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:33:33 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Creating image(s)
Jul 29 13:33:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Acquiring lock "/opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "/opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "/opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.212s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:33 user nova-compute[231753]: DEBUG nova.policy [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82c6eeb939f94fa5953a349127247021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44867a8743214d32a94bca3506295e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:33:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.199s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8/disk 1073741824" returned: 0 in 0.139s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.343s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:34 user nova-compute[231753]: DEBUG nova.compute.manager [req-b084040f-2e95-4653-b1c8-235eed3db845 req-fa0beae7-f2c5-4db6-87f6-e0b18939f737 service nova] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Received event network-vif-plugged-8a79ae49-c97d-4110-bc3c-2d166db71e50 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:33:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b084040f-2e95-4653-b1c8-235eed3db845 req-fa0beae7-f2c5-4db6-87f6-e0b18939f737 service nova] Acquiring lock "29b21191-c874-4ca8-bd4b-2df90a41ccab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b084040f-2e95-4653-b1c8-235eed3db845 req-fa0beae7-f2c5-4db6-87f6-e0b18939f737 service nova] Lock "29b21191-c874-4ca8-bd4b-2df90a41ccab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b084040f-2e95-4653-b1c8-235eed3db845 req-fa0beae7-f2c5-4db6-87f6-e0b18939f737 service nova] Lock "29b21191-c874-4ca8-bd4b-2df90a41ccab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:34 user nova-compute[231753]: DEBUG nova.compute.manager [req-b084040f-2e95-4653-b1c8-235eed3db845 req-fa0beae7-f2c5-4db6-87f6-e0b18939f737 service nova] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] No waiting events found dispatching network-vif-plugged-8a79ae49-c97d-4110-bc3c-2d166db71e50 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:33:34 user nova-compute[231753]: WARNING nova.compute.manager [req-b084040f-2e95-4653-b1c8-235eed3db845 req-fa0beae7-f2c5-4db6-87f6-e0b18939f737 service nova] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Received unexpected event network-vif-plugged-8a79ae49-c97d-4110-bc3c-2d166db71e50 for instance with vm_state building and task_state spawning.
Jul 29 13:33:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.214s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:34 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Checking if we can resize image /opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:33:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8/disk --force-share --output=json" returned: 0 in 0.207s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:34 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Cannot resize image /opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:33:34 user nova-compute[231753]: DEBUG nova.objects.instance [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lazy-loading 'migration_context' on Instance uuid 299b7f21-b198-437b-9d5c-1269d5e9b7c8 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:33:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:33:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Ensure instance console log exists: /opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:33:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:34 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637614.656019, 4475f276-acc4-44f1-a5fa-6a7fb2165493 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:33:34 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] VM Resumed (Lifecycle Event)
Jul 29 13:33:34 user nova-compute[231753]: DEBUG nova.compute.manager [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:33:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:33:34 user nova-compute[231753]: DEBUG nova.compute.manager [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:33:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:33:34 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:33:34 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Instance spawned successfully.
Jul 29 13:33:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:33:34 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Instance spawned successfully.
Jul 29 13:33:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:33:34 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:33:34 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:33:34 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637614.679367, 4475f276-acc4-44f1-a5fa-6a7fb2165493 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:33:34 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] VM Started (Lifecycle Event)
Jul 29 13:33:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:34 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:33:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:35 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:35 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:35 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:33:35 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:33:35 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637614.6794846, 29b21191-c874-4ca8-bd4b-2df90a41ccab => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:33:35 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] VM Resumed (Lifecycle Event)
Jul 29 13:33:35 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:33:35 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:33:35 user nova-compute[231753]: INFO nova.compute.manager [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Took 15.87 seconds to spawn the instance on the hypervisor.
Jul 29 13:33:35 user nova-compute[231753]: DEBUG nova.compute.manager [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:33:35 user nova-compute[231753]: INFO nova.compute.manager [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Took 20.91 seconds to spawn the instance on the hypervisor.
Jul 29 13:33:35 user nova-compute[231753]: DEBUG nova.compute.manager [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:33:35 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:33:35 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637614.6795378, 29b21191-c874-4ca8-bd4b-2df90a41ccab => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:33:35 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] VM Started (Lifecycle Event)
Jul 29 13:33:35 user nova-compute[231753]: DEBUG nova.compute.manager [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:33:35 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:33:35 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:33:35 user nova-compute[231753]: INFO nova.compute.manager [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Took 16.62 seconds to build instance.
Jul 29 13:33:35 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Instance spawned successfully.
Jul 29 13:33:35 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:33:35 user nova-compute[231753]: INFO nova.compute.manager [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Took 22.55 seconds to build instance.
Jul 29 13:33:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-916ab6ea-5d9b-42b4-8b82-38092009469e tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Lock "29b21191-c874-4ca8-bd4b-2df90a41ccab" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 16.760s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:35 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:33:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c8b98041-087d-40cc-80a8-e47f222f45db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "4475f276-acc4-44f1-a5fa-6a7fb2165493" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 22.708s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:35 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:35 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:35 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:35 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:35 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:35 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:35 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637615.373177, b67b98f8-a7b3-499e-ba32-9520bbced960 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:33:35 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] VM Resumed (Lifecycle Event)
Jul 29 13:33:35 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:33:35 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:33:35 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:33:35 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637615.4254627, b67b98f8-a7b3-499e-ba32-9520bbced960 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:33:35 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] VM Started (Lifecycle Event)
Jul 29 13:33:35 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:33:35 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:33:35 user nova-compute[231753]: INFO nova.compute.manager [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Took 13.97 seconds to spawn the instance on the hypervisor.
Jul 29 13:33:35 user nova-compute[231753]: DEBUG nova.compute.manager [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:33:35 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:33:35 user nova-compute[231753]: INFO nova.compute.manager [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Took 15.02 seconds to build instance.
Jul 29 13:33:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6ee3e36e-5eff-4735-b952-d48f7a09a8ed tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lock "b67b98f8-a7b3-499e-ba32-9520bbced960" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.143s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:35 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:35 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:36 user nova-compute[231753]: DEBUG nova.compute.manager [req-e3f9bf56-fd87-45fe-a31d-3188529bdc99 req-5681a40e-cd99-46ec-b481-5f9da8a36770 service nova] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Received event network-vif-plugged-a19600e4-052d-44b1-87b3-73605975e810 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:33:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e3f9bf56-fd87-45fe-a31d-3188529bdc99 req-5681a40e-cd99-46ec-b481-5f9da8a36770 service nova] Acquiring lock "b67b98f8-a7b3-499e-ba32-9520bbced960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e3f9bf56-fd87-45fe-a31d-3188529bdc99 req-5681a40e-cd99-46ec-b481-5f9da8a36770 service nova] Lock "b67b98f8-a7b3-499e-ba32-9520bbced960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e3f9bf56-fd87-45fe-a31d-3188529bdc99 req-5681a40e-cd99-46ec-b481-5f9da8a36770 service nova] Lock "b67b98f8-a7b3-499e-ba32-9520bbced960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:36 user nova-compute[231753]: DEBUG nova.compute.manager [req-e3f9bf56-fd87-45fe-a31d-3188529bdc99 req-5681a40e-cd99-46ec-b481-5f9da8a36770 service nova] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] No waiting events found dispatching network-vif-plugged-a19600e4-052d-44b1-87b3-73605975e810 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:33:36 user nova-compute[231753]: WARNING nova.compute.manager [req-e3f9bf56-fd87-45fe-a31d-3188529bdc99 req-5681a40e-cd99-46ec-b481-5f9da8a36770 service nova] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Received unexpected event network-vif-plugged-a19600e4-052d-44b1-87b3-73605975e810 for instance with vm_state active and task_state None.
Jul 29 13:33:36 user nova-compute[231753]: DEBUG nova.compute.manager [req-e3f9bf56-fd87-45fe-a31d-3188529bdc99 req-5681a40e-cd99-46ec-b481-5f9da8a36770 service nova] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Received event network-vif-plugged-a19600e4-052d-44b1-87b3-73605975e810 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:33:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e3f9bf56-fd87-45fe-a31d-3188529bdc99 req-5681a40e-cd99-46ec-b481-5f9da8a36770 service nova] Acquiring lock "b67b98f8-a7b3-499e-ba32-9520bbced960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e3f9bf56-fd87-45fe-a31d-3188529bdc99 req-5681a40e-cd99-46ec-b481-5f9da8a36770 service nova] Lock "b67b98f8-a7b3-499e-ba32-9520bbced960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e3f9bf56-fd87-45fe-a31d-3188529bdc99 req-5681a40e-cd99-46ec-b481-5f9da8a36770 service nova] Lock "b67b98f8-a7b3-499e-ba32-9520bbced960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:36 user nova-compute[231753]: DEBUG nova.compute.manager [req-e3f9bf56-fd87-45fe-a31d-3188529bdc99 req-5681a40e-cd99-46ec-b481-5f9da8a36770 service nova] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] No waiting events found dispatching network-vif-plugged-a19600e4-052d-44b1-87b3-73605975e810 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:33:36 user nova-compute[231753]: WARNING nova.compute.manager [req-e3f9bf56-fd87-45fe-a31d-3188529bdc99 req-5681a40e-cd99-46ec-b481-5f9da8a36770 service nova] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Received unexpected event network-vif-plugged-a19600e4-052d-44b1-87b3-73605975e810 for instance with vm_state active and task_state None.
Jul 29 13:33:36 user nova-compute[231753]: DEBUG nova.network.neutron [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Successfully created port: b66269be-ef4d-460f-9782-df3fc08e5450 {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:33:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:39 user nova-compute[231753]: DEBUG nova.network.neutron [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Successfully updated port: b66269be-ef4d-460f-9782-df3fc08e5450 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:33:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Acquiring lock "refresh_cache-299b7f21-b198-437b-9d5c-1269d5e9b7c8" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:33:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Acquired lock "refresh_cache-299b7f21-b198-437b-9d5c-1269d5e9b7c8" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:33:39 user nova-compute[231753]: DEBUG nova.network.neutron [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:33:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:39 user nova-compute[231753]: DEBUG nova.compute.manager [req-fc1fac98-39ed-4cf4-a4ad-c7b3b57261e1 req-40a0de3d-bb62-493b-8494-d99c2a83c04a service nova] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Received event network-changed-b66269be-ef4d-460f-9782-df3fc08e5450 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:33:39 user nova-compute[231753]: DEBUG nova.compute.manager [req-fc1fac98-39ed-4cf4-a4ad-c7b3b57261e1 req-40a0de3d-bb62-493b-8494-d99c2a83c04a service nova] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Refreshing instance network info cache due to event network-changed-b66269be-ef4d-460f-9782-df3fc08e5450. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:33:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-fc1fac98-39ed-4cf4-a4ad-c7b3b57261e1 req-40a0de3d-bb62-493b-8494-d99c2a83c04a service nova] Acquiring lock "refresh_cache-299b7f21-b198-437b-9d5c-1269d5e9b7c8" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:33:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:39 user nova-compute[231753]: DEBUG nova.network.neutron [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:33:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:39 user nova-compute[231753]: DEBUG nova.network.neutron [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Updating instance_info_cache with network_info: [{"id": "b66269be-ef4d-460f-9782-df3fc08e5450", "address": "fa:16:3e:1f:36:42", "network": {"id": "2e7ef980-929c-4ea5-86b7-d69bcfa4a209", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1403711156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44867a8743214d32a94bca3506295e92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb66269be-ef", "ovs_interfaceid": "b66269be-ef4d-460f-9782-df3fc08e5450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:33:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Releasing lock "refresh_cache-299b7f21-b198-437b-9d5c-1269d5e9b7c8" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:33:39 user nova-compute[231753]: DEBUG nova.compute.manager [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Instance network_info: |[{"id": "b66269be-ef4d-460f-9782-df3fc08e5450", "address": "fa:16:3e:1f:36:42", "network": {"id": "2e7ef980-929c-4ea5-86b7-d69bcfa4a209", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1403711156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44867a8743214d32a94bca3506295e92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb66269be-ef", "ovs_interfaceid": "b66269be-ef4d-460f-9782-df3fc08e5450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:33:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-fc1fac98-39ed-4cf4-a4ad-c7b3b57261e1 req-40a0de3d-bb62-493b-8494-d99c2a83c04a service nova] Acquired lock "refresh_cache-299b7f21-b198-437b-9d5c-1269d5e9b7c8" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:33:39 user nova-compute[231753]: DEBUG nova.network.neutron [req-fc1fac98-39ed-4cf4-a4ad-c7b3b57261e1 req-40a0de3d-bb62-493b-8494-d99c2a83c04a service nova] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Refreshing network info cache for port b66269be-ef4d-460f-9782-df3fc08e5450 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:33:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Start _get_guest_xml network_info=[{"id": "b66269be-ef4d-460f-9782-df3fc08e5450", "address": "fa:16:3e:1f:36:42", "network": {"id": "2e7ef980-929c-4ea5-86b7-d69bcfa4a209", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1403711156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44867a8743214d32a94bca3506295e92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb66269be-ef", "ovs_interfaceid": "b66269be-ef4d-460f-9782-df3fc08e5450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:33:39 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:33:39 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:33:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:33:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:33:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:33:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:33:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:33:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:33:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:33:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:33:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:33:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:33:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:33:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:33:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:33:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:33:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:33:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:33:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:33:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2102921189',display_name='tempest-VolumesAdminNegativeTest-server-2102921189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2102921189',id=6,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2ROmBb681QKMjCKDdNYqVMwfdet8CVBJR4XP62RNY3AHbUmI/X3FEyWNcStt+ESjLuIiWh2ONQ7LTXzqvDt6fGK7d9i5UUC2FOc/pd5EMU7UHEwPPGKPy9909RHPO26Q==',key_name='tempest-keypair-880643537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44867a8743214d32a94bca3506295e92',ramdisk_id='',reservation_id='r-280fs2c9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-193285786',owner_user_name='tempest-VolumesAdminNegativeTest-193285786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:33:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82c6eeb939f94fa5953a349127247021',uuid=299b7f21-b198-437b-9d5c-1269d5e9b7c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b66269be-ef4d-460f-9782-df3fc08e5450", "address": "fa:16:3e:1f:36:42", "network": {"id": "2e7ef980-929c-4ea5-86b7-d69bcfa4a209", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1403711156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44867a8743214d32a94bca3506295e92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb66269be-ef", "ovs_interfaceid": "b66269be-ef4d-460f-9782-df3fc08e5450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:33:40 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Converting VIF {"id": "b66269be-ef4d-460f-9782-df3fc08e5450", "address": "fa:16:3e:1f:36:42", "network": {"id": "2e7ef980-929c-4ea5-86b7-d69bcfa4a209", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1403711156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44867a8743214d32a94bca3506295e92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb66269be-ef", "ovs_interfaceid": "b66269be-ef4d-460f-9782-df3fc08e5450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:33:40 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:36:42,bridge_name='br-int',has_traffic_filtering=True,id=b66269be-ef4d-460f-9782-df3fc08e5450,network=Network(2e7ef980-929c-4ea5-86b7-d69bcfa4a209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb66269be-ef') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:33:40 user nova-compute[231753]: DEBUG nova.objects.instance [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lazy-loading 'pci_devices' on Instance uuid 299b7f21-b198-437b-9d5c-1269d5e9b7c8 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:33:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:33:40 user nova-compute[231753]:   <uuid>299b7f21-b198-437b-9d5c-1269d5e9b7c8</uuid>
Jul 29 13:33:40 user nova-compute[231753]:   <name>instance-00000006</name>
Jul 29 13:33:40 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:33:40 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:33:40 user nova-compute[231753]:   <metadata>
Jul 29 13:33:40 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:33:40 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:33:40 user nova-compute[231753]:       <nova:name>tempest-VolumesAdminNegativeTest-server-2102921189</nova:name>
Jul 29 13:33:40 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:33:39</nova:creationTime>
Jul 29 13:33:40 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:33:40 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:33:40 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:33:40 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:33:40 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:33:40 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:33:40 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:33:40 user nova-compute[231753]:       <nova:owner>
Jul 29 13:33:40 user nova-compute[231753]:         <nova:user uuid="82c6eeb939f94fa5953a349127247021">tempest-VolumesAdminNegativeTest-193285786-project-member</nova:user>
Jul 29 13:33:40 user nova-compute[231753]:         <nova:project uuid="44867a8743214d32a94bca3506295e92">tempest-VolumesAdminNegativeTest-193285786</nova:project>
Jul 29 13:33:40 user nova-compute[231753]:       </nova:owner>
Jul 29 13:33:40 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:33:40 user nova-compute[231753]:       <nova:ports>
Jul 29 13:33:40 user nova-compute[231753]:         <nova:port uuid="b66269be-ef4d-460f-9782-df3fc08e5450">
Jul 29 13:33:40 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 29 13:33:40 user nova-compute[231753]:         </nova:port>
Jul 29 13:33:40 user nova-compute[231753]:       </nova:ports>
Jul 29 13:33:40 user nova-compute[231753]:     </nova:instance>
Jul 29 13:33:40 user nova-compute[231753]:   </metadata>
Jul 29 13:33:40 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:33:40 user nova-compute[231753]:     <system>
Jul 29 13:33:40 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:33:40 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:33:40 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:33:40 user nova-compute[231753]:       <entry name="serial">299b7f21-b198-437b-9d5c-1269d5e9b7c8</entry>
Jul 29 13:33:40 user nova-compute[231753]:       <entry name="uuid">299b7f21-b198-437b-9d5c-1269d5e9b7c8</entry>
Jul 29 13:33:40 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:33:40 user nova-compute[231753]:     </system>
Jul 29 13:33:40 user nova-compute[231753]:   </sysinfo>
Jul 29 13:33:40 user nova-compute[231753]:   <os>
Jul 29 13:33:40 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:33:40 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:33:40 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:33:40 user nova-compute[231753]:   </os>
Jul 29 13:33:40 user nova-compute[231753]:   <features>
Jul 29 13:33:40 user nova-compute[231753]:     <acpi/>
Jul 29 13:33:40 user nova-compute[231753]:     <apic/>
Jul 29 13:33:40 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:33:40 user nova-compute[231753]:   </features>
Jul 29 13:33:40 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:33:40 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:33:40 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:33:40 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:33:40 user nova-compute[231753]:   </clock>
Jul 29 13:33:40 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:33:40 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:33:40 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:33:40 user nova-compute[231753]:   </cpu>
Jul 29 13:33:40 user nova-compute[231753]:   <devices>
Jul 29 13:33:40 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:33:40 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:33:40 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8/disk"/>
Jul 29 13:33:40 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:33:40 user nova-compute[231753]:     </disk>
Jul 29 13:33:40 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:33:40 user nova-compute[231753]:       <mac address="fa:16:3e:1f:36:42"/>
Jul 29 13:33:40 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:33:40 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:33:40 user nova-compute[231753]:       <target dev="tapb66269be-ef"/>
Jul 29 13:33:40 user nova-compute[231753]:     </interface>
Jul 29 13:33:40 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:33:40 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8/console.log" append="off"/>
Jul 29 13:33:40 user nova-compute[231753]:     </serial>
Jul 29 13:33:40 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:33:40 user nova-compute[231753]:     <video>
Jul 29 13:33:40 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:33:40 user nova-compute[231753]:     </video>
Jul 29 13:33:40 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:33:40 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:33:40 user nova-compute[231753]:     </rng>
Jul 29 13:33:40 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:33:40 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:33:40 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:33:40 user nova-compute[231753]:     </memballoon>
Jul 29 13:33:40 user nova-compute[231753]:   </devices>
Jul 29 13:33:40 user nova-compute[231753]: </domain>
Jul 29 13:33:40 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:33:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:33:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2102921189',display_name='tempest-VolumesAdminNegativeTest-server-2102921189',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2102921189',id=6,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2ROmBb681QKMjCKDdNYqVMwfdet8CVBJR4XP62RNY3AHbUmI/X3FEyWNcStt+ESjLuIiWh2ONQ7LTXzqvDt6fGK7d9i5UUC2FOc/pd5EMU7UHEwPPGKPy9909RHPO26Q==',key_name='tempest-keypair-880643537',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44867a8743214d32a94bca3506295e92',ramdisk_id='',reservation_id='r-280fs2c9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-193285786',owner_user_name='tempest-VolumesAdminNegativeTest-193285786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:33:33Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82c6eeb939f94fa5953a349127247021',uuid=299b7f21-b198-437b-9d5c-1269d5e9b7c8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b66269be-ef4d-460f-9782-df3fc08e5450", "address": "fa:16:3e:1f:36:42", "network": {"id": "2e7ef980-929c-4ea5-86b7-d69bcfa4a209", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1403711156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44867a8743214d32a94bca3506295e92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb66269be-ef", "ovs_interfaceid": "b66269be-ef4d-460f-9782-df3fc08e5450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:33:40 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Converting VIF {"id": "b66269be-ef4d-460f-9782-df3fc08e5450", "address": "fa:16:3e:1f:36:42", "network": {"id": "2e7ef980-929c-4ea5-86b7-d69bcfa4a209", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1403711156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44867a8743214d32a94bca3506295e92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb66269be-ef", "ovs_interfaceid": "b66269be-ef4d-460f-9782-df3fc08e5450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:33:40 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1f:36:42,bridge_name='br-int',has_traffic_filtering=True,id=b66269be-ef4d-460f-9782-df3fc08e5450,network=Network(2e7ef980-929c-4ea5-86b7-d69bcfa4a209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb66269be-ef') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:33:40 user nova-compute[231753]: DEBUG os_vif [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:36:42,bridge_name='br-int',has_traffic_filtering=True,id=b66269be-ef4d-460f-9782-df3fc08e5450,network=Network(2e7ef980-929c-4ea5-86b7-d69bcfa4a209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb66269be-ef') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:33:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:33:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:33:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb66269be-ef, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:33:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb66269be-ef, col_values=(('external_ids', {'iface-id': 'b66269be-ef4d-460f-9782-df3fc08e5450', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1f:36:42', 'vm-uuid': '299b7f21-b198-437b-9d5c-1269d5e9b7c8'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:33:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:33:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:40 user nova-compute[231753]: INFO os_vif [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1f:36:42,bridge_name='br-int',has_traffic_filtering=True,id=b66269be-ef4d-460f-9782-df3fc08e5450,network=Network(2e7ef980-929c-4ea5-86b7-d69bcfa4a209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb66269be-ef')
Jul 29 13:33:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:33:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] No VIF found with MAC fa:16:3e:1f:36:42, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:33:40 user nova-compute[231753]: DEBUG nova.network.neutron [req-fc1fac98-39ed-4cf4-a4ad-c7b3b57261e1 req-40a0de3d-bb62-493b-8494-d99c2a83c04a service nova] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Updated VIF entry in instance network info cache for port b66269be-ef4d-460f-9782-df3fc08e5450. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:33:40 user nova-compute[231753]: DEBUG nova.network.neutron [req-fc1fac98-39ed-4cf4-a4ad-c7b3b57261e1 req-40a0de3d-bb62-493b-8494-d99c2a83c04a service nova] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Updating instance_info_cache with network_info: [{"id": "b66269be-ef4d-460f-9782-df3fc08e5450", "address": "fa:16:3e:1f:36:42", "network": {"id": "2e7ef980-929c-4ea5-86b7-d69bcfa4a209", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1403711156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44867a8743214d32a94bca3506295e92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb66269be-ef", "ovs_interfaceid": "b66269be-ef4d-460f-9782-df3fc08e5450", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:33:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-fc1fac98-39ed-4cf4-a4ad-c7b3b57261e1 req-40a0de3d-bb62-493b-8494-d99c2a83c04a service nova] Releasing lock "refresh_cache-299b7f21-b198-437b-9d5c-1269d5e9b7c8" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:33:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:42 user nova-compute[231753]: DEBUG nova.compute.manager [req-210ccc00-2d65-4fc4-9059-355ccf24dd4d req-51c352d8-4c71-45d2-a1a3-c72bff2e0d48 service nova] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Received event network-vif-plugged-b66269be-ef4d-460f-9782-df3fc08e5450 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:33:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-210ccc00-2d65-4fc4-9059-355ccf24dd4d req-51c352d8-4c71-45d2-a1a3-c72bff2e0d48 service nova] Acquiring lock "299b7f21-b198-437b-9d5c-1269d5e9b7c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-210ccc00-2d65-4fc4-9059-355ccf24dd4d req-51c352d8-4c71-45d2-a1a3-c72bff2e0d48 service nova] Lock "299b7f21-b198-437b-9d5c-1269d5e9b7c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-210ccc00-2d65-4fc4-9059-355ccf24dd4d req-51c352d8-4c71-45d2-a1a3-c72bff2e0d48 service nova] Lock "299b7f21-b198-437b-9d5c-1269d5e9b7c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:42 user nova-compute[231753]: DEBUG nova.compute.manager [req-210ccc00-2d65-4fc4-9059-355ccf24dd4d req-51c352d8-4c71-45d2-a1a3-c72bff2e0d48 service nova] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] No waiting events found dispatching network-vif-plugged-b66269be-ef4d-460f-9782-df3fc08e5450 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:33:42 user nova-compute[231753]: WARNING nova.compute.manager [req-210ccc00-2d65-4fc4-9059-355ccf24dd4d req-51c352d8-4c71-45d2-a1a3-c72bff2e0d48 service nova] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Received unexpected event network-vif-plugged-b66269be-ef4d-460f-9782-df3fc08e5450 for instance with vm_state building and task_state spawning.
Jul 29 13:33:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Acquiring lock "8822efe3-e17a-4511-b75f-37f6a83616aa" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lock "8822efe3-e17a-4511-b75f-37f6a83616aa" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:43 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:33:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:43 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:33:43 user nova-compute[231753]: INFO nova.compute.claims [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Claim successful on node user
Jul 29 13:33:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-72010aa7-ac32-46af-a8d5-0c526ba3ad00 req-c19ee70d-e95b-4cbb-9939-74d1780f5904 service nova] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Received event network-vif-plugged-b66269be-ef4d-460f-9782-df3fc08e5450 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:33:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-72010aa7-ac32-46af-a8d5-0c526ba3ad00 req-c19ee70d-e95b-4cbb-9939-74d1780f5904 service nova] Acquiring lock "299b7f21-b198-437b-9d5c-1269d5e9b7c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-72010aa7-ac32-46af-a8d5-0c526ba3ad00 req-c19ee70d-e95b-4cbb-9939-74d1780f5904 service nova] Lock "299b7f21-b198-437b-9d5c-1269d5e9b7c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-72010aa7-ac32-46af-a8d5-0c526ba3ad00 req-c19ee70d-e95b-4cbb-9939-74d1780f5904 service nova] Lock "299b7f21-b198-437b-9d5c-1269d5e9b7c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-72010aa7-ac32-46af-a8d5-0c526ba3ad00 req-c19ee70d-e95b-4cbb-9939-74d1780f5904 service nova] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] No waiting events found dispatching network-vif-plugged-b66269be-ef4d-460f-9782-df3fc08e5450 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:33:44 user nova-compute[231753]: WARNING nova.compute.manager [req-72010aa7-ac32-46af-a8d5-0c526ba3ad00 req-c19ee70d-e95b-4cbb-9939-74d1780f5904 service nova] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Received unexpected event network-vif-plugged-b66269be-ef4d-460f-9782-df3fc08e5450 for instance with vm_state building and task_state spawning.
Jul 29 13:33:44 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:33:44 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:33:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.740s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:44 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:33:44 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:33:44 user nova-compute[231753]: DEBUG nova.network.neutron [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:33:44 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:33:44 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:33:44 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637624.9033732, 299b7f21-b198-437b-9d5c-1269d5e9b7c8 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:33:44 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] VM Resumed (Lifecycle Event)
Jul 29 13:33:44 user nova-compute[231753]: DEBUG nova.compute.manager [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:33:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:33:44 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Instance spawned successfully.
Jul 29 13:33:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:33:44 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:33:45 user nova-compute[231753]: DEBUG nova.policy [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8de5c966bbb948499c560ea5ab63a960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ab44f715024188b10545aac4cbb675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:33:45 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:33:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:45 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:33:45 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637624.9183092, 299b7f21-b198-437b-9d5c-1269d5e9b7c8 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:33:45 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] VM Started (Lifecycle Event)
Jul 29 13:33:45 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:45 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:33:45 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:33:45 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:33:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:33:45 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Creating image(s)
Jul 29 13:33:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Acquiring lock "/opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lock "/opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lock "/opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:45 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:45 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:33:45 user nova-compute[231753]: INFO nova.compute.manager [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Took 11.97 seconds to spawn the instance on the hypervisor.
Jul 29 13:33:45 user nova-compute[231753]: DEBUG nova.compute.manager [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:33:45 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.229s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:45 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:45 user nova-compute[231753]: INFO nova.compute.manager [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Took 17.60 seconds to build instance.
Jul 29 13:33:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-870158b9-4c3b-404e-9323-945cc44d705c tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "299b7f21-b198-437b-9d5c-1269d5e9b7c8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.732s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:45 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.237s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:45 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:45 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa/disk 1073741824" returned: 0 in 0.156s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.399s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:45 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:45 user nova-compute[231753]: DEBUG nova.network.neutron [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Successfully created port: 7881fb42-caac-4254-a8ef-16b49c754bf9 {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:33:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.196s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:46 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:33:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa/disk --force-share --output=json" returned: 0 in 0.423s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:46 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Cannot resize image /opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:33:46 user nova-compute[231753]: DEBUG nova.objects.instance [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lazy-loading 'migration_context' on Instance uuid 8822efe3-e17a-4511-b75f-37f6a83616aa {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:33:46 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:33:46 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Ensure instance console log exists: /opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:33:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:47 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:47 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:47 user nova-compute[231753]: DEBUG nova.network.neutron [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Successfully updated port: 7881fb42-caac-4254-a8ef-16b49c754bf9 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:33:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Acquiring lock "refresh_cache-8822efe3-e17a-4511-b75f-37f6a83616aa" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:33:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Acquired lock "refresh_cache-8822efe3-e17a-4511-b75f-37f6a83616aa" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:33:47 user nova-compute[231753]: DEBUG nova.network.neutron [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:33:48 user nova-compute[231753]: DEBUG nova.compute.manager [req-cb8c5806-cc6d-4fe1-a12f-636125a26baf req-5ac148bb-ff54-4459-825a-edd306afdff6 service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Received event network-changed-7881fb42-caac-4254-a8ef-16b49c754bf9 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:33:48 user nova-compute[231753]: DEBUG nova.compute.manager [req-cb8c5806-cc6d-4fe1-a12f-636125a26baf req-5ac148bb-ff54-4459-825a-edd306afdff6 service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Refreshing instance network info cache due to event network-changed-7881fb42-caac-4254-a8ef-16b49c754bf9. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:33:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-cb8c5806-cc6d-4fe1-a12f-636125a26baf req-5ac148bb-ff54-4459-825a-edd306afdff6 service nova] Acquiring lock "refresh_cache-8822efe3-e17a-4511-b75f-37f6a83616aa" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:33:48 user nova-compute[231753]: DEBUG nova.network.neutron [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:33:48 user nova-compute[231753]: DEBUG nova.network.neutron [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Updating instance_info_cache with network_info: [{"id": "7881fb42-caac-4254-a8ef-16b49c754bf9", "address": "fa:16:3e:3b:15:58", "network": {"id": "12eb887a-c8b0-4fa9-ad24-8dbd6632aa5b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1203369018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19ab44f715024188b10545aac4cbb675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7881fb42-ca", "ovs_interfaceid": "7881fb42-caac-4254-a8ef-16b49c754bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:33:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Releasing lock "refresh_cache-8822efe3-e17a-4511-b75f-37f6a83616aa" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:33:48 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Instance network_info: |[{"id": "7881fb42-caac-4254-a8ef-16b49c754bf9", "address": "fa:16:3e:3b:15:58", "network": {"id": "12eb887a-c8b0-4fa9-ad24-8dbd6632aa5b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1203369018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19ab44f715024188b10545aac4cbb675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7881fb42-ca", "ovs_interfaceid": "7881fb42-caac-4254-a8ef-16b49c754bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:33:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-cb8c5806-cc6d-4fe1-a12f-636125a26baf req-5ac148bb-ff54-4459-825a-edd306afdff6 service nova] Acquired lock "refresh_cache-8822efe3-e17a-4511-b75f-37f6a83616aa" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:33:48 user nova-compute[231753]: DEBUG nova.network.neutron [req-cb8c5806-cc6d-4fe1-a12f-636125a26baf req-5ac148bb-ff54-4459-825a-edd306afdff6 service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Refreshing network info cache for port 7881fb42-caac-4254-a8ef-16b49c754bf9 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:33:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Start _get_guest_xml network_info=[{"id": "7881fb42-caac-4254-a8ef-16b49c754bf9", "address": "fa:16:3e:3b:15:58", "network": {"id": "12eb887a-c8b0-4fa9-ad24-8dbd6632aa5b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1203369018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19ab44f715024188b10545aac4cbb675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7881fb42-ca", "ovs_interfaceid": "7881fb42-caac-4254-a8ef-16b49c754bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:33:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Acquiring lock "b02ec16d-24a3-450d-858d-3ad302086ac3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Lock "b02ec16d-24a3-450d-858d-3ad302086ac3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:48 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:33:48 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:33:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:33:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:33:48 user nova-compute[231753]: DEBUG nova.compute.manager [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:33:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:33:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:33:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:33:48 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:33:48 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:33:48 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:33:48 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:33:48 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:33:48 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:33:48 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:33:48 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:33:48 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:33:48 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:33:48 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:33:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:33:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1148074335',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1148074335',id=7,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0HnOcJSL5x0Tr4fe2VLkk8m+fQM2IcJ8g4N204I22r+/diZGGnEBXWHFX48Vhdy9jagxGQAFJRzYCdQHRK29zwqPTQRGmMCigLgYVfxtAv5zkyNXnhJGzjicINXHWlNA==',key_name='tempest-keypair-833006828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19ab44f715024188b10545aac4cbb675',ramdisk_id='',reservation_id='r-z1bc9xqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1208246720',owner_user_name='tempest-TaggedAttachmentsTest-1208246720-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:33:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8de5c966bbb948499c560ea5ab63a960',uuid=8822efe3-e17a-4511-b75f-37f6a83616aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7881fb42-caac-4254-a8ef-16b49c754bf9", "address": "fa:16:3e:3b:15:58", "network": {"id": "12eb887a-c8b0-4fa9-ad24-8dbd6632aa5b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1203369018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19ab44f715024188b10545aac4cbb675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7881fb42-ca", "ovs_interfaceid": "7881fb42-caac-4254-a8ef-16b49c754bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:33:48 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Converting VIF {"id": "7881fb42-caac-4254-a8ef-16b49c754bf9", "address": "fa:16:3e:3b:15:58", "network": {"id": "12eb887a-c8b0-4fa9-ad24-8dbd6632aa5b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1203369018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19ab44f715024188b10545aac4cbb675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7881fb42-ca", "ovs_interfaceid": "7881fb42-caac-4254-a8ef-16b49c754bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:33:48 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:15:58,bridge_name='br-int',has_traffic_filtering=True,id=7881fb42-caac-4254-a8ef-16b49c754bf9,network=Network(12eb887a-c8b0-4fa9-ad24-8dbd6632aa5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7881fb42-ca') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:33:48 user nova-compute[231753]: DEBUG nova.objects.instance [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lazy-loading 'pci_devices' on Instance uuid 8822efe3-e17a-4511-b75f-37f6a83616aa {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:33:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:33:48 user nova-compute[231753]:   <uuid>8822efe3-e17a-4511-b75f-37f6a83616aa</uuid>
Jul 29 13:33:48 user nova-compute[231753]:   <name>instance-00000007</name>
Jul 29 13:33:48 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:33:48 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:33:48 user nova-compute[231753]:   <metadata>
Jul 29 13:33:48 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:33:48 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:33:48 user nova-compute[231753]:       <nova:name>tempest-device-tagging-server-1148074335</nova:name>
Jul 29 13:33:48 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:33:48</nova:creationTime>
Jul 29 13:33:48 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:33:48 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:33:48 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:33:48 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:33:48 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:33:48 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:33:48 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:33:48 user nova-compute[231753]:       <nova:owner>
Jul 29 13:33:48 user nova-compute[231753]:         <nova:user uuid="8de5c966bbb948499c560ea5ab63a960">tempest-TaggedAttachmentsTest-1208246720-project-member</nova:user>
Jul 29 13:33:48 user nova-compute[231753]:         <nova:project uuid="19ab44f715024188b10545aac4cbb675">tempest-TaggedAttachmentsTest-1208246720</nova:project>
Jul 29 13:33:48 user nova-compute[231753]:       </nova:owner>
Jul 29 13:33:48 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:33:48 user nova-compute[231753]:       <nova:ports>
Jul 29 13:33:48 user nova-compute[231753]:         <nova:port uuid="7881fb42-caac-4254-a8ef-16b49c754bf9">
Jul 29 13:33:48 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 29 13:33:48 user nova-compute[231753]:         </nova:port>
Jul 29 13:33:48 user nova-compute[231753]:       </nova:ports>
Jul 29 13:33:48 user nova-compute[231753]:     </nova:instance>
Jul 29 13:33:48 user nova-compute[231753]:   </metadata>
Jul 29 13:33:48 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:33:48 user nova-compute[231753]:     <system>
Jul 29 13:33:48 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:33:48 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:33:48 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:33:48 user nova-compute[231753]:       <entry name="serial">8822efe3-e17a-4511-b75f-37f6a83616aa</entry>
Jul 29 13:33:48 user nova-compute[231753]:       <entry name="uuid">8822efe3-e17a-4511-b75f-37f6a83616aa</entry>
Jul 29 13:33:48 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:33:48 user nova-compute[231753]:     </system>
Jul 29 13:33:48 user nova-compute[231753]:   </sysinfo>
Jul 29 13:33:48 user nova-compute[231753]:   <os>
Jul 29 13:33:48 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:33:48 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:33:48 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:33:48 user nova-compute[231753]:   </os>
Jul 29 13:33:48 user nova-compute[231753]:   <features>
Jul 29 13:33:48 user nova-compute[231753]:     <acpi/>
Jul 29 13:33:48 user nova-compute[231753]:     <apic/>
Jul 29 13:33:48 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:33:48 user nova-compute[231753]:   </features>
Jul 29 13:33:48 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:33:48 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:33:48 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:33:48 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:33:48 user nova-compute[231753]:   </clock>
Jul 29 13:33:48 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:33:48 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:33:48 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:33:48 user nova-compute[231753]:   </cpu>
Jul 29 13:33:48 user nova-compute[231753]:   <devices>
Jul 29 13:33:48 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:33:48 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:33:48 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa/disk"/>
Jul 29 13:33:48 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:33:48 user nova-compute[231753]:     </disk>
Jul 29 13:33:48 user nova-compute[231753]:     <disk type="file" device="cdrom">
Jul 29 13:33:48 user nova-compute[231753]:       <driver name="qemu" type="raw" cache="none"/>
Jul 29 13:33:48 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa/disk.config"/>
Jul 29 13:33:48 user nova-compute[231753]:       <target dev="hda" bus="ide"/>
Jul 29 13:33:48 user nova-compute[231753]:     </disk>
Jul 29 13:33:48 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:33:48 user nova-compute[231753]:       <mac address="fa:16:3e:3b:15:58"/>
Jul 29 13:33:48 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:33:48 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:33:48 user nova-compute[231753]:       <target dev="tap7881fb42-ca"/>
Jul 29 13:33:48 user nova-compute[231753]:     </interface>
Jul 29 13:33:48 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:33:48 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa/console.log" append="off"/>
Jul 29 13:33:48 user nova-compute[231753]:     </serial>
Jul 29 13:33:48 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:33:48 user nova-compute[231753]:     <video>
Jul 29 13:33:48 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:33:48 user nova-compute[231753]:     </video>
Jul 29 13:33:48 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:33:48 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:33:48 user nova-compute[231753]:     </rng>
Jul 29 13:33:48 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:33:48 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:33:48 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:33:48 user nova-compute[231753]:     </memballoon>
Jul 29 13:33:48 user nova-compute[231753]:   </devices>
Jul 29 13:33:48 user nova-compute[231753]: </domain>
Jul 29 13:33:48 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:33:49 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:33:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1148074335',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1148074335',id=7,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0HnOcJSL5x0Tr4fe2VLkk8m+fQM2IcJ8g4N204I22r+/diZGGnEBXWHFX48Vhdy9jagxGQAFJRzYCdQHRK29zwqPTQRGmMCigLgYVfxtAv5zkyNXnhJGzjicINXHWlNA==',key_name='tempest-keypair-833006828',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='19ab44f715024188b10545aac4cbb675',ramdisk_id='',reservation_id='r-z1bc9xqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1208246720',owner_user_name='tempest-TaggedAttachmentsTest-1208246720-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:33:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8de5c966bbb948499c560ea5ab63a960',uuid=8822efe3-e17a-4511-b75f-37f6a83616aa,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7881fb42-caac-4254-a8ef-16b49c754bf9", "address": "fa:16:3e:3b:15:58", "network": {"id": "12eb887a-c8b0-4fa9-ad24-8dbd6632aa5b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1203369018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19ab44f715024188b10545aac4cbb675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7881fb42-ca", "ovs_interfaceid": "7881fb42-caac-4254-a8ef-16b49c754bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:33:49 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Converting VIF {"id": "7881fb42-caac-4254-a8ef-16b49c754bf9", "address": "fa:16:3e:3b:15:58", "network": {"id": "12eb887a-c8b0-4fa9-ad24-8dbd6632aa5b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1203369018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19ab44f715024188b10545aac4cbb675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7881fb42-ca", "ovs_interfaceid": "7881fb42-caac-4254-a8ef-16b49c754bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:33:49 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3b:15:58,bridge_name='br-int',has_traffic_filtering=True,id=7881fb42-caac-4254-a8ef-16b49c754bf9,network=Network(12eb887a-c8b0-4fa9-ad24-8dbd6632aa5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7881fb42-ca') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:33:49 user nova-compute[231753]: DEBUG os_vif [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:15:58,bridge_name='br-int',has_traffic_filtering=True,id=7881fb42-caac-4254-a8ef-16b49c754bf9,network=Network(12eb887a-c8b0-4fa9-ad24-8dbd6632aa5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7881fb42-ca') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:33:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:33:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:33:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7881fb42-ca, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:33:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7881fb42-ca, col_values=(('external_ids', {'iface-id': '7881fb42-caac-4254-a8ef-16b49c754bf9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3b:15:58', 'vm-uuid': '8822efe3-e17a-4511-b75f-37f6a83616aa'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:33:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:33:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:49 user nova-compute[231753]: INFO os_vif [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3b:15:58,bridge_name='br-int',has_traffic_filtering=True,id=7881fb42-caac-4254-a8ef-16b49c754bf9,network=Network(12eb887a-c8b0-4fa9-ad24-8dbd6632aa5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7881fb42-ca')
Jul 29 13:33:49 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:33:49 user nova-compute[231753]: INFO nova.compute.claims [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Claim successful on node user
Jul 29 13:33:49 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:33:49 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] No BDM found with device name hda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:33:49 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] No VIF found with MAC fa:16:3e:3b:15:58, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:33:49 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Using config drive
Jul 29 13:33:49 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Creating config drive at /opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa/disk.config
Jul 29 13:33:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpo8antade {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:49 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:33:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpo8antade" returned: 0 in 0.084s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:49 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:33:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.875s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:49 user nova-compute[231753]: DEBUG nova.compute.manager [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:33:50 user nova-compute[231753]: DEBUG nova.compute.manager [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:33:50 user nova-compute[231753]: DEBUG nova.network.neutron [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:33:50 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:33:50 user nova-compute[231753]: DEBUG nova.network.neutron [req-cb8c5806-cc6d-4fe1-a12f-636125a26baf req-5ac148bb-ff54-4459-825a-edd306afdff6 service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Updated VIF entry in instance network info cache for port 7881fb42-caac-4254-a8ef-16b49c754bf9. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:33:50 user nova-compute[231753]: DEBUG nova.network.neutron [req-cb8c5806-cc6d-4fe1-a12f-636125a26baf req-5ac148bb-ff54-4459-825a-edd306afdff6 service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Updating instance_info_cache with network_info: [{"id": "7881fb42-caac-4254-a8ef-16b49c754bf9", "address": "fa:16:3e:3b:15:58", "network": {"id": "12eb887a-c8b0-4fa9-ad24-8dbd6632aa5b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1203369018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19ab44f715024188b10545aac4cbb675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7881fb42-ca", "ovs_interfaceid": "7881fb42-caac-4254-a8ef-16b49c754bf9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:33:50 user nova-compute[231753]: DEBUG nova.compute.manager [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:33:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-cb8c5806-cc6d-4fe1-a12f-636125a26baf req-5ac148bb-ff54-4459-825a-edd306afdff6 service nova] Releasing lock "refresh_cache-8822efe3-e17a-4511-b75f-37f6a83616aa" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:33:50 user nova-compute[231753]: DEBUG nova.policy [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c6e954b6a3a14f5b973e98b1d4d81910', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cd8ee7b983944e2abe660fffe40b274c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:33:50 user nova-compute[231753]: DEBUG nova.compute.manager [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:33:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:33:50 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Creating image(s)
Jul 29 13:33:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Acquiring lock "/opt/stack/data/nova/instances/b02ec16d-24a3-450d-858d-3ad302086ac3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Lock "/opt/stack/data/nova/instances/b02ec16d-24a3-450d-858d-3ad302086ac3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Lock "/opt/stack/data/nova/instances/b02ec16d-24a3-450d-858d-3ad302086ac3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.032s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.418s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.222s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/b02ec16d-24a3-450d-858d-3ad302086ac3/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/b02ec16d-24a3-450d-858d-3ad302086ac3/disk 1073741824" returned: 0 in 0.182s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:51 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.439s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.230s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:51 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b02ec16d-24a3-450d-858d-3ad302086ac3/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:33:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02ec16d-24a3-450d-858d-3ad302086ac3/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:51 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Acquiring lock "1be12e63-8803-4ffa-82e1-2fe38f6b5d2d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:51 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Lock "1be12e63-8803-4ffa-82e1-2fe38f6b5d2d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.013s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02ec16d-24a3-450d-858d-3ad302086ac3/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:51 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Cannot resize image /opt/stack/data/nova/instances/b02ec16d-24a3-450d-858d-3ad302086ac3/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:33:51 user nova-compute[231753]: DEBUG nova.objects.instance [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Lazy-loading 'migration_context' on Instance uuid b02ec16d-24a3-450d-858d-3ad302086ac3 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:33:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:33:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Ensure instance console log exists: /opt/stack/data/nova/instances/b02ec16d-24a3-450d-858d-3ad302086ac3/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:33:51 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:51 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:51 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:51 user nova-compute[231753]: DEBUG nova.compute.manager [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:33:52 user nova-compute[231753]: DEBUG nova.network.neutron [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Successfully created port: c6299ccb-7770-4eaf-8e2e-ecea8da9f324 {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:33:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:52 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:52 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:52 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:33:52 user nova-compute[231753]: INFO nova.compute.claims [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Claim successful on node user
Jul 29 13:33:52 user nova-compute[231753]: DEBUG nova.compute.manager [req-783010b2-93ea-4f69-8cf2-05345845ee30 req-0efd4bca-e471-40e6-b961-26356812e96a service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Received event network-vif-plugged-7881fb42-caac-4254-a8ef-16b49c754bf9 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:33:52 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-783010b2-93ea-4f69-8cf2-05345845ee30 req-0efd4bca-e471-40e6-b961-26356812e96a service nova] Acquiring lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:52 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-783010b2-93ea-4f69-8cf2-05345845ee30 req-0efd4bca-e471-40e6-b961-26356812e96a service nova] Lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:52 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-783010b2-93ea-4f69-8cf2-05345845ee30 req-0efd4bca-e471-40e6-b961-26356812e96a service nova] Lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:52 user nova-compute[231753]: DEBUG nova.compute.manager [req-783010b2-93ea-4f69-8cf2-05345845ee30 req-0efd4bca-e471-40e6-b961-26356812e96a service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] No waiting events found dispatching network-vif-plugged-7881fb42-caac-4254-a8ef-16b49c754bf9 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:33:52 user nova-compute[231753]: WARNING nova.compute.manager [req-783010b2-93ea-4f69-8cf2-05345845ee30 req-0efd4bca-e471-40e6-b961-26356812e96a service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Received unexpected event network-vif-plugged-7881fb42-caac-4254-a8ef-16b49c754bf9 for instance with vm_state building and task_state spawning.
Jul 29 13:33:53 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:33:53 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:33:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 1.270s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:53 user nova-compute[231753]: DEBUG nova.compute.manager [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:33:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:54 user nova-compute[231753]: DEBUG nova.compute.manager [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:33:54 user nova-compute[231753]: DEBUG nova.network.neutron [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:33:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:54 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names
Jul 29 13:33:54 user nova-compute[231753]: DEBUG nova.compute.manager [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:33:54 user nova-compute[231753]: DEBUG nova.policy [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'b6a2294e0c674f2d83dcbbfbc208964a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '98859b41061e45e1a920f57c36b4479f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:33:54 user nova-compute[231753]: DEBUG nova.compute.manager [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:33:54 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:33:54 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Creating image(s)
Jul 29 13:33:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Acquiring lock "/opt/stack/data/nova/instances/1be12e63-8803-4ffa-82e1-2fe38f6b5d2d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Lock "/opt/stack/data/nova/instances/1be12e63-8803-4ffa-82e1-2fe38f6b5d2d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Lock "/opt/stack/data/nova/instances/1be12e63-8803-4ffa-82e1-2fe38f6b5d2d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.083s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Acquiring lock "8faddd70d585a2347f68dfb9329aa971a062fc1e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Lock "8faddd70d585a2347f68dfb9329aa971a062fc1e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:54 user nova-compute[231753]: DEBUG nova.network.neutron [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Successfully updated port: c6299ccb-7770-4eaf-8e2e-ecea8da9f324 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:33:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Acquiring lock "refresh_cache-b02ec16d-24a3-450d-858d-3ad302086ac3" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:33:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Acquired lock "refresh_cache-b02ec16d-24a3-450d-858d-3ad302086ac3" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:33:54 user nova-compute[231753]: DEBUG nova.network.neutron [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:33:54 user nova-compute[231753]: DEBUG nova.compute.manager [req-5f025ba8-4131-4078-853a-ababfa1352ea req-631c7a94-b688-463d-b6b1-70fa8f28dcd4 service nova] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Received event network-changed-c6299ccb-7770-4eaf-8e2e-ecea8da9f324 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:33:54 user nova-compute[231753]: DEBUG nova.compute.manager [req-5f025ba8-4131-4078-853a-ababfa1352ea req-631c7a94-b688-463d-b6b1-70fa8f28dcd4 service nova] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Refreshing instance network info cache due to event network-changed-c6299ccb-7770-4eaf-8e2e-ecea8da9f324. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:33:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5f025ba8-4131-4078-853a-ababfa1352ea req-631c7a94-b688-463d-b6b1-70fa8f28dcd4 service nova] Acquiring lock "refresh_cache-b02ec16d-24a3-450d-858d-3ad302086ac3" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:33:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8faddd70d585a2347f68dfb9329aa971a062fc1e.part --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:55 user nova-compute[231753]: DEBUG nova.network.neutron [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:33:55 user nova-compute[231753]: DEBUG nova.compute.manager [req-3c57f69e-eae8-493a-b122-91ba6eb796d3 req-f8db6687-3ea7-4d4b-b06d-3d9b91c7342e service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Received event network-vif-plugged-7881fb42-caac-4254-a8ef-16b49c754bf9 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:33:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3c57f69e-eae8-493a-b122-91ba6eb796d3 req-f8db6687-3ea7-4d4b-b06d-3d9b91c7342e service nova] Acquiring lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3c57f69e-eae8-493a-b122-91ba6eb796d3 req-f8db6687-3ea7-4d4b-b06d-3d9b91c7342e service nova] Lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3c57f69e-eae8-493a-b122-91ba6eb796d3 req-f8db6687-3ea7-4d4b-b06d-3d9b91c7342e service nova] Lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:55 user nova-compute[231753]: DEBUG nova.compute.manager [req-3c57f69e-eae8-493a-b122-91ba6eb796d3 req-f8db6687-3ea7-4d4b-b06d-3d9b91c7342e service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] No waiting events found dispatching network-vif-plugged-7881fb42-caac-4254-a8ef-16b49c754bf9 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:33:55 user nova-compute[231753]: WARNING nova.compute.manager [req-3c57f69e-eae8-493a-b122-91ba6eb796d3 req-f8db6687-3ea7-4d4b-b06d-3d9b91c7342e service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Received unexpected event network-vif-plugged-7881fb42-caac-4254-a8ef-16b49c754bf9 for instance with vm_state building and task_state spawning.
Jul 29 13:33:55 user nova-compute[231753]: DEBUG nova.network.neutron [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Successfully created port: 123e72ae-5ed8-4181-bef2-28713da2545a {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8faddd70d585a2347f68dfb9329aa971a062fc1e.part --force-share --output=json" returned: 0 in 0.603s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG nova.virt.images [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] ca3d141d-365c-43bb-be22-68278e6218f0 was qcow2, converting to raw {{(pid=231753) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG nova.privsep.utils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=231753) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8faddd70d585a2347f68dfb9329aa971a062fc1e.part /opt/stack/data/nova/instances/_base/8faddd70d585a2347f68dfb9329aa971a062fc1e.converted {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG nova.network.neutron [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Updating instance_info_cache with network_info: [{"id": "c6299ccb-7770-4eaf-8e2e-ecea8da9f324", "address": "fa:16:3e:8d:e7:c6", "network": {"id": "b41abe8c-4b7a-43eb-be54-286ef7161f43", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1689635352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8ee7b983944e2abe660fffe40b274c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6299ccb-77", "ovs_interfaceid": "c6299ccb-7770-4eaf-8e2e-ecea8da9f324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Releasing lock "refresh_cache-b02ec16d-24a3-450d-858d-3ad302086ac3" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG nova.compute.manager [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Instance network_info: |[{"id": "c6299ccb-7770-4eaf-8e2e-ecea8da9f324", "address": "fa:16:3e:8d:e7:c6", "network": {"id": "b41abe8c-4b7a-43eb-be54-286ef7161f43", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1689635352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8ee7b983944e2abe660fffe40b274c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6299ccb-77", "ovs_interfaceid": "c6299ccb-7770-4eaf-8e2e-ecea8da9f324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5f025ba8-4131-4078-853a-ababfa1352ea req-631c7a94-b688-463d-b6b1-70fa8f28dcd4 service nova] Acquired lock "refresh_cache-b02ec16d-24a3-450d-858d-3ad302086ac3" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG nova.network.neutron [req-5f025ba8-4131-4078-853a-ababfa1352ea req-631c7a94-b688-463d-b6b1-70fa8f28dcd4 service nova] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Refreshing network info cache for port c6299ccb-7770-4eaf-8e2e-ecea8da9f324 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Start _get_guest_xml network_info=[{"id": "c6299ccb-7770-4eaf-8e2e-ecea8da9f324", "address": "fa:16:3e:8d:e7:c6", "network": {"id": "b41abe8c-4b7a-43eb-be54-286ef7161f43", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1689635352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8ee7b983944e2abe660fffe40b274c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6299ccb-77", "ovs_interfaceid": "c6299ccb-7770-4eaf-8e2e-ecea8da9f324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:33:56 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:33:56 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:33:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:33:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-612828864',display_name='tempest-TestVolumeSwap-server-612828864',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-612828864',id=8,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRF2WDBYR/Cv7wHxMyVxmUVVl1gYUYS9XuEQkxdyPZYUD95wRBa2/uQ6hwvoeX5p/jJ0QbopdJOYkaOK1NA5P7ZGDyWvVQnewPm7tpEOgc4r75LqokbY0c9dcx2rbPVhw==',key_name='tempest-keypair-873333226',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd8ee7b983944e2abe660fffe40b274c',ramdisk_id='',reservation_id='r-ktg9g089',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2006247747',owner_user_name='tempest-TestVolumeSwap-2006247747-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:33:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6e954b6a3a14f5b973e98b1d4d81910',uuid=b02ec16d-24a3-450d-858d-3ad302086ac3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6299ccb-7770-4eaf-8e2e-ecea8da9f324", "address": "fa:16:3e:8d:e7:c6", "network": {"id": "b41abe8c-4b7a-43eb-be54-286ef7161f43", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1689635352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8ee7b983944e2abe660fffe40b274c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6299ccb-77", "ovs_interfaceid": "c6299ccb-7770-4eaf-8e2e-ecea8da9f324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Converting VIF {"id": "c6299ccb-7770-4eaf-8e2e-ecea8da9f324", "address": "fa:16:3e:8d:e7:c6", "network": {"id": "b41abe8c-4b7a-43eb-be54-286ef7161f43", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1689635352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8ee7b983944e2abe660fffe40b274c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6299ccb-77", "ovs_interfaceid": "c6299ccb-7770-4eaf-8e2e-ecea8da9f324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:e7:c6,bridge_name='br-int',has_traffic_filtering=True,id=c6299ccb-7770-4eaf-8e2e-ecea8da9f324,network=Network(b41abe8c-4b7a-43eb-be54-286ef7161f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6299ccb-77') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG nova.objects.instance [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Lazy-loading 'pci_devices' on Instance uuid b02ec16d-24a3-450d-858d-3ad302086ac3 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/8faddd70d585a2347f68dfb9329aa971a062fc1e.part /opt/stack/data/nova/instances/_base/8faddd70d585a2347f68dfb9329aa971a062fc1e.converted" returned: 0 in 0.389s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8faddd70d585a2347f68dfb9329aa971a062fc1e.converted --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:33:56 user nova-compute[231753]:   <uuid>b02ec16d-24a3-450d-858d-3ad302086ac3</uuid>
Jul 29 13:33:56 user nova-compute[231753]:   <name>instance-00000008</name>
Jul 29 13:33:56 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:33:56 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:33:56 user nova-compute[231753]:   <metadata>
Jul 29 13:33:56 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:33:56 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:33:56 user nova-compute[231753]:       <nova:name>tempest-TestVolumeSwap-server-612828864</nova:name>
Jul 29 13:33:56 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:33:56</nova:creationTime>
Jul 29 13:33:56 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:33:56 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:33:56 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:33:56 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:33:56 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:33:56 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:33:56 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:33:56 user nova-compute[231753]:       <nova:owner>
Jul 29 13:33:56 user nova-compute[231753]:         <nova:user uuid="c6e954b6a3a14f5b973e98b1d4d81910">tempest-TestVolumeSwap-2006247747-project-member</nova:user>
Jul 29 13:33:56 user nova-compute[231753]:         <nova:project uuid="cd8ee7b983944e2abe660fffe40b274c">tempest-TestVolumeSwap-2006247747</nova:project>
Jul 29 13:33:56 user nova-compute[231753]:       </nova:owner>
Jul 29 13:33:56 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:33:56 user nova-compute[231753]:       <nova:ports>
Jul 29 13:33:56 user nova-compute[231753]:         <nova:port uuid="c6299ccb-7770-4eaf-8e2e-ecea8da9f324">
Jul 29 13:33:56 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 29 13:33:56 user nova-compute[231753]:         </nova:port>
Jul 29 13:33:56 user nova-compute[231753]:       </nova:ports>
Jul 29 13:33:56 user nova-compute[231753]:     </nova:instance>
Jul 29 13:33:56 user nova-compute[231753]:   </metadata>
Jul 29 13:33:56 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:33:56 user nova-compute[231753]:     <system>
Jul 29 13:33:56 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:33:56 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:33:56 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:33:56 user nova-compute[231753]:       <entry name="serial">b02ec16d-24a3-450d-858d-3ad302086ac3</entry>
Jul 29 13:33:56 user nova-compute[231753]:       <entry name="uuid">b02ec16d-24a3-450d-858d-3ad302086ac3</entry>
Jul 29 13:33:56 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:33:56 user nova-compute[231753]:     </system>
Jul 29 13:33:56 user nova-compute[231753]:   </sysinfo>
Jul 29 13:33:56 user nova-compute[231753]:   <os>
Jul 29 13:33:56 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:33:56 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:33:56 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:33:56 user nova-compute[231753]:   </os>
Jul 29 13:33:56 user nova-compute[231753]:   <features>
Jul 29 13:33:56 user nova-compute[231753]:     <acpi/>
Jul 29 13:33:56 user nova-compute[231753]:     <apic/>
Jul 29 13:33:56 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:33:56 user nova-compute[231753]:   </features>
Jul 29 13:33:56 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:33:56 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:33:56 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:33:56 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:33:56 user nova-compute[231753]:   </clock>
Jul 29 13:33:56 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:33:56 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:33:56 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:33:56 user nova-compute[231753]:   </cpu>
Jul 29 13:33:56 user nova-compute[231753]:   <devices>
Jul 29 13:33:56 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:33:56 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:33:56 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/b02ec16d-24a3-450d-858d-3ad302086ac3/disk"/>
Jul 29 13:33:56 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:33:56 user nova-compute[231753]:     </disk>
Jul 29 13:33:56 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:33:56 user nova-compute[231753]:       <mac address="fa:16:3e:8d:e7:c6"/>
Jul 29 13:33:56 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:33:56 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:33:56 user nova-compute[231753]:       <target dev="tapc6299ccb-77"/>
Jul 29 13:33:56 user nova-compute[231753]:     </interface>
Jul 29 13:33:56 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:33:56 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/b02ec16d-24a3-450d-858d-3ad302086ac3/console.log" append="off"/>
Jul 29 13:33:56 user nova-compute[231753]:     </serial>
Jul 29 13:33:56 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:33:56 user nova-compute[231753]:     <video>
Jul 29 13:33:56 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:33:56 user nova-compute[231753]:     </video>
Jul 29 13:33:56 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:33:56 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:33:56 user nova-compute[231753]:     </rng>
Jul 29 13:33:56 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:33:56 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:33:56 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:33:56 user nova-compute[231753]:     </memballoon>
Jul 29 13:33:56 user nova-compute[231753]:   </devices>
Jul 29 13:33:56 user nova-compute[231753]: </domain>
Jul 29 13:33:56 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:33:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-612828864',display_name='tempest-TestVolumeSwap-server-612828864',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-612828864',id=8,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRF2WDBYR/Cv7wHxMyVxmUVVl1gYUYS9XuEQkxdyPZYUD95wRBa2/uQ6hwvoeX5p/jJ0QbopdJOYkaOK1NA5P7ZGDyWvVQnewPm7tpEOgc4r75LqokbY0c9dcx2rbPVhw==',key_name='tempest-keypair-873333226',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cd8ee7b983944e2abe660fffe40b274c',ramdisk_id='',reservation_id='r-ktg9g089',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeSwap-2006247747',owner_user_name='tempest-TestVolumeSwap-2006247747-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:33:50Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6e954b6a3a14f5b973e98b1d4d81910',uuid=b02ec16d-24a3-450d-858d-3ad302086ac3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c6299ccb-7770-4eaf-8e2e-ecea8da9f324", "address": "fa:16:3e:8d:e7:c6", "network": {"id": "b41abe8c-4b7a-43eb-be54-286ef7161f43", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1689635352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8ee7b983944e2abe660fffe40b274c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6299ccb-77", "ovs_interfaceid": "c6299ccb-7770-4eaf-8e2e-ecea8da9f324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Converting VIF {"id": "c6299ccb-7770-4eaf-8e2e-ecea8da9f324", "address": "fa:16:3e:8d:e7:c6", "network": {"id": "b41abe8c-4b7a-43eb-be54-286ef7161f43", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1689635352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8ee7b983944e2abe660fffe40b274c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6299ccb-77", "ovs_interfaceid": "c6299ccb-7770-4eaf-8e2e-ecea8da9f324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8d:e7:c6,bridge_name='br-int',has_traffic_filtering=True,id=c6299ccb-7770-4eaf-8e2e-ecea8da9f324,network=Network(b41abe8c-4b7a-43eb-be54-286ef7161f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6299ccb-77') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG os_vif [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:e7:c6,bridge_name='br-int',has_traffic_filtering=True,id=c6299ccb-7770-4eaf-8e2e-ecea8da9f324,network=Network(b41abe8c-4b7a-43eb-be54-286ef7161f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6299ccb-77') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc6299ccb-77, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc6299ccb-77, col_values=(('external_ids', {'iface-id': 'c6299ccb-7770-4eaf-8e2e-ecea8da9f324', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8d:e7:c6', 'vm-uuid': 'b02ec16d-24a3-450d-858d-3ad302086ac3'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:56 user nova-compute[231753]: INFO os_vif [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8d:e7:c6,bridge_name='br-int',has_traffic_filtering=True,id=c6299ccb-7770-4eaf-8e2e-ecea8da9f324,network=Network(b41abe8c-4b7a-43eb-be54-286ef7161f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6299ccb-77')
Jul 29 13:33:56 user nova-compute[231753]: DEBUG nova.network.neutron [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Successfully updated port: 123e72ae-5ed8-4181-bef2-28713da2545a {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Acquiring lock "refresh_cache-1be12e63-8803-4ffa-82e1-2fe38f6b5d2d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Acquired lock "refresh_cache-1be12e63-8803-4ffa-82e1-2fe38f6b5d2d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG nova.network.neutron [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8faddd70d585a2347f68dfb9329aa971a062fc1e.converted --force-share --output=json" returned: 0 in 0.171s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Lock "8faddd70d585a2347f68dfb9329aa971a062fc1e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.388s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8faddd70d585a2347f68dfb9329aa971a062fc1e --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG nova.network.neutron [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] No VIF found with MAC fa:16:3e:8d:e7:c6, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8faddd70d585a2347f68dfb9329aa971a062fc1e --force-share --output=json" returned: 0 in 0.148s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Acquiring lock "8faddd70d585a2347f68dfb9329aa971a062fc1e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Lock "8faddd70d585a2347f68dfb9329aa971a062fc1e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8faddd70d585a2347f68dfb9329aa971a062fc1e --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637637.0535417, 8822efe3-e17a-4511-b75f-37f6a83616aa => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:33:57 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] VM Resumed (Lifecycle Event)
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:33:57 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Instance spawned successfully.
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:33:57 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637637.067742, 8822efe3-e17a-4511-b75f-37f6a83616aa => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:33:57 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] VM Started (Lifecycle Event)
Jul 29 13:33:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8faddd70d585a2347f68dfb9329aa971a062fc1e --force-share --output=json" returned: 0 in 0.163s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8faddd70d585a2347f68dfb9329aa971a062fc1e,backing_fmt=raw /opt/stack/data/nova/instances/1be12e63-8803-4ffa-82e1-2fe38f6b5d2d/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.network.neutron [req-5f025ba8-4131-4078-853a-ababfa1352ea req-631c7a94-b688-463d-b6b1-70fa8f28dcd4 service nova] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Updated VIF entry in instance network info cache for port c6299ccb-7770-4eaf-8e2e-ecea8da9f324. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.network.neutron [req-5f025ba8-4131-4078-853a-ababfa1352ea req-631c7a94-b688-463d-b6b1-70fa8f28dcd4 service nova] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Updating instance_info_cache with network_info: [{"id": "c6299ccb-7770-4eaf-8e2e-ecea8da9f324", "address": "fa:16:3e:8d:e7:c6", "network": {"id": "b41abe8c-4b7a-43eb-be54-286ef7161f43", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1689635352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8ee7b983944e2abe660fffe40b274c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6299ccb-77", "ovs_interfaceid": "c6299ccb-7770-4eaf-8e2e-ecea8da9f324", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:33:57 user nova-compute[231753]: INFO nova.compute.manager [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Took 12.08 seconds to spawn the instance on the hypervisor.
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5f025ba8-4131-4078-853a-ababfa1352ea req-631c7a94-b688-463d-b6b1-70fa8f28dcd4 service nova] Releasing lock "refresh_cache-b02ec16d-24a3-450d-858d-3ad302086ac3" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/8faddd70d585a2347f68dfb9329aa971a062fc1e,backing_fmt=raw /opt/stack/data/nova/instances/1be12e63-8803-4ffa-82e1-2fe38f6b5d2d/disk 1073741824" returned: 0 in 0.080s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Lock "8faddd70d585a2347f68dfb9329aa971a062fc1e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8faddd70d585a2347f68dfb9329aa971a062fc1e --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Cleaning up deleted instances {{(pid=231753) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 29 13:33:57 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.compute.manager [req-2ec4d886-9dd4-4280-a52b-adaa31aa0f39 req-367972fc-d0a8-4db8-8af8-42b9a293c1aa service nova] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Received event network-changed-123e72ae-5ed8-4181-bef2-28713da2545a {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.compute.manager [req-2ec4d886-9dd4-4280-a52b-adaa31aa0f39 req-367972fc-d0a8-4db8-8af8-42b9a293c1aa service nova] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Refreshing instance network info cache due to event network-changed-123e72ae-5ed8-4181-bef2-28713da2545a. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-2ec4d886-9dd4-4280-a52b-adaa31aa0f39 req-367972fc-d0a8-4db8-8af8-42b9a293c1aa service nova] Acquiring lock "refresh_cache-1be12e63-8803-4ffa-82e1-2fe38f6b5d2d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.network.neutron [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Updating instance_info_cache with network_info: [{"id": "123e72ae-5ed8-4181-bef2-28713da2545a", "address": "fa:16:3e:bc:36:c7", "network": {"id": "be6b68b0-c543-441a-a338-deabdf4d97f6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1540506582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98859b41061e45e1a920f57c36b4479f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123e72ae-5e", "ovs_interfaceid": "123e72ae-5ed8-4181-bef2-28713da2545a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] There are 0 instances to clean {{(pid=231753) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Cleaning up deleted instances with incomplete migration  {{(pid=231753) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Releasing lock "refresh_cache-1be12e63-8803-4ffa-82e1-2fe38f6b5d2d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.compute.manager [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Instance network_info: |[{"id": "123e72ae-5ed8-4181-bef2-28713da2545a", "address": "fa:16:3e:bc:36:c7", "network": {"id": "be6b68b0-c543-441a-a338-deabdf4d97f6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1540506582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98859b41061e45e1a920f57c36b4479f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123e72ae-5e", "ovs_interfaceid": "123e72ae-5ed8-4181-bef2-28713da2545a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-2ec4d886-9dd4-4280-a52b-adaa31aa0f39 req-367972fc-d0a8-4db8-8af8-42b9a293c1aa service nova] Acquired lock "refresh_cache-1be12e63-8803-4ffa-82e1-2fe38f6b5d2d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.network.neutron [req-2ec4d886-9dd4-4280-a52b-adaa31aa0f39 req-367972fc-d0a8-4db8-8af8-42b9a293c1aa service nova] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Refreshing network info cache for port 123e72ae-5ed8-4181-bef2-28713da2545a {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/8faddd70d585a2347f68dfb9329aa971a062fc1e --force-share --output=json" returned: 0 in 0.167s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Checking if we can resize image /opt/stack/data/nova/instances/1be12e63-8803-4ffa-82e1-2fe38f6b5d2d/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be12e63-8803-4ffa-82e1-2fe38f6b5d2d/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:57 user nova-compute[231753]: INFO nova.compute.manager [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Took 13.59 seconds to build instance.
Jul 29 13:33:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ca47537a-c03f-463f-9562-7cde17d77682 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lock "8822efe3-e17a-4511-b75f-37f6a83616aa" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.723s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be12e63-8803-4ffa-82e1-2fe38f6b5d2d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Cannot resize image /opt/stack/data/nova/instances/1be12e63-8803-4ffa-82e1-2fe38f6b5d2d/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.objects.instance [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Lazy-loading 'migration_context' on Instance uuid 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Ensure instance console log exists: /opt/stack/data/nova/instances/1be12e63-8803-4ffa-82e1-2fe38f6b5d2d/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Start _get_guest_xml network_info=[{"id": "123e72ae-5ed8-4181-bef2-28713da2545a", "address": "fa:16:3e:bc:36:c7", "network": {"id": "be6b68b0-c543-441a-a338-deabdf4d97f6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1540506582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98859b41061e45e1a920f57c36b4479f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123e72ae-5e", "ovs_interfaceid": "123e72ae-5ed8-4181-bef2-28713da2545a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:33:42Z,direct_url=<?>,disk_format='qcow2',id=ca3d141d-365c-43bb-be22-68278e6218f0,min_disk=0,min_ram=0,name='',owner='6282826ece84433487c77ab41d17cc73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:33:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/sda', 'encryption_secret_uuid': None, 'disk_bus': 'scsi', 'boot_index': 0, 'image_id': 'ca3d141d-365c-43bb-be22-68278e6218f0'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:33:57 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:33:57 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:33:42Z,direct_url=<?>,disk_format='qcow2',id=ca3d141d-365c-43bb-be22-68278e6218f0,min_disk=0,min_ram=0,name='',owner='6282826ece84433487c77ab41d17cc73',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:33:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:33:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-390597877',display_name='tempest-AttachSCSIVolumeTestJSON-server-390597877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-390597877',id=9,image_ref='ca3d141d-365c-43bb-be22-68278e6218f0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItVTl19j+M7mYQMrxcBhRQHJF1v1vD+/v5ngMDQaPt0tKmniO5U24VkZNpAw5j5yXAQh88t9PCCvHOm6I44Jbe0n4KhUwuVD2V05FAaEfph4uZ3b5soZeQ/N+qvNr64EA==',key_name='tempest-keypair-1894886950',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98859b41061e45e1a920f57c36b4479f',ramdisk_id='',reservation_id='r-ulg7fbel',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca3d141d-365c-43bb-be22-68278e6218f0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-316015273',owner_user_name='tempest-AttachSCSIVolumeTestJSON-316015273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:33:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6a2294e0c674f2d83dcbbfbc208964a',uuid=1be12e63-8803-4ffa-82e1-2fe38f6b5d2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "123e72ae-5ed8-4181-bef2-28713da2545a", "address": "fa:16:3e:bc:36:c7", "network": {"id": "be6b68b0-c543-441a-a338-deabdf4d97f6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1540506582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98859b41061e45e1a920f57c36b4479f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123e72ae-5e", "ovs_interfaceid": "123e72ae-5ed8-4181-bef2-28713da2545a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Converting VIF {"id": "123e72ae-5ed8-4181-bef2-28713da2545a", "address": "fa:16:3e:bc:36:c7", "network": {"id": "be6b68b0-c543-441a-a338-deabdf4d97f6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1540506582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98859b41061e45e1a920f57c36b4479f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123e72ae-5e", "ovs_interfaceid": "123e72ae-5ed8-4181-bef2-28713da2545a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:36:c7,bridge_name='br-int',has_traffic_filtering=True,id=123e72ae-5ed8-4181-bef2-28713da2545a,network=Network(be6b68b0-c543-441a-a338-deabdf4d97f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap123e72ae-5e') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.objects.instance [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Lazy-loading 'pci_devices' on Instance uuid 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:33:57 user nova-compute[231753]:   <uuid>1be12e63-8803-4ffa-82e1-2fe38f6b5d2d</uuid>
Jul 29 13:33:57 user nova-compute[231753]:   <name>instance-00000009</name>
Jul 29 13:33:57 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:33:57 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:33:57 user nova-compute[231753]:   <metadata>
Jul 29 13:33:57 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:33:57 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:33:57 user nova-compute[231753]:       <nova:name>tempest-AttachSCSIVolumeTestJSON-server-390597877</nova:name>
Jul 29 13:33:57 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:33:57</nova:creationTime>
Jul 29 13:33:57 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:33:57 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:33:57 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:33:57 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:33:57 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:33:57 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:33:57 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:33:57 user nova-compute[231753]:       <nova:owner>
Jul 29 13:33:57 user nova-compute[231753]:         <nova:user uuid="b6a2294e0c674f2d83dcbbfbc208964a">tempest-AttachSCSIVolumeTestJSON-316015273-project-member</nova:user>
Jul 29 13:33:57 user nova-compute[231753]:         <nova:project uuid="98859b41061e45e1a920f57c36b4479f">tempest-AttachSCSIVolumeTestJSON-316015273</nova:project>
Jul 29 13:33:57 user nova-compute[231753]:       </nova:owner>
Jul 29 13:33:57 user nova-compute[231753]:       <nova:root type="image" uuid="ca3d141d-365c-43bb-be22-68278e6218f0"/>
Jul 29 13:33:57 user nova-compute[231753]:       <nova:ports>
Jul 29 13:33:57 user nova-compute[231753]:         <nova:port uuid="123e72ae-5ed8-4181-bef2-28713da2545a">
Jul 29 13:33:57 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 29 13:33:57 user nova-compute[231753]:         </nova:port>
Jul 29 13:33:57 user nova-compute[231753]:       </nova:ports>
Jul 29 13:33:57 user nova-compute[231753]:     </nova:instance>
Jul 29 13:33:57 user nova-compute[231753]:   </metadata>
Jul 29 13:33:57 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:33:57 user nova-compute[231753]:     <system>
Jul 29 13:33:57 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:33:57 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:33:57 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:33:57 user nova-compute[231753]:       <entry name="serial">1be12e63-8803-4ffa-82e1-2fe38f6b5d2d</entry>
Jul 29 13:33:57 user nova-compute[231753]:       <entry name="uuid">1be12e63-8803-4ffa-82e1-2fe38f6b5d2d</entry>
Jul 29 13:33:57 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:33:57 user nova-compute[231753]:     </system>
Jul 29 13:33:57 user nova-compute[231753]:   </sysinfo>
Jul 29 13:33:57 user nova-compute[231753]:   <os>
Jul 29 13:33:57 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:33:57 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:33:57 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:33:57 user nova-compute[231753]:   </os>
Jul 29 13:33:57 user nova-compute[231753]:   <features>
Jul 29 13:33:57 user nova-compute[231753]:     <acpi/>
Jul 29 13:33:57 user nova-compute[231753]:     <apic/>
Jul 29 13:33:57 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:33:57 user nova-compute[231753]:   </features>
Jul 29 13:33:57 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:33:57 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:33:57 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:33:57 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:33:57 user nova-compute[231753]:   </clock>
Jul 29 13:33:57 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:33:57 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:33:57 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:33:57 user nova-compute[231753]:   </cpu>
Jul 29 13:33:57 user nova-compute[231753]:   <devices>
Jul 29 13:33:57 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:33:57 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:33:57 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/1be12e63-8803-4ffa-82e1-2fe38f6b5d2d/disk"/>
Jul 29 13:33:57 user nova-compute[231753]:       <target dev="sda" bus="scsi"/>
Jul 29 13:33:57 user nova-compute[231753]:       <address type="drive" controller="0" unit="0"/>
Jul 29 13:33:57 user nova-compute[231753]:     </disk>
Jul 29 13:33:57 user nova-compute[231753]:     <disk type="file" device="cdrom">
Jul 29 13:33:57 user nova-compute[231753]:       <driver name="qemu" type="raw" cache="none"/>
Jul 29 13:33:57 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/1be12e63-8803-4ffa-82e1-2fe38f6b5d2d/disk.config"/>
Jul 29 13:33:57 user nova-compute[231753]:       <target dev="sdb" bus="scsi"/>
Jul 29 13:33:57 user nova-compute[231753]:       <address type="drive" controller="0" unit="1"/>
Jul 29 13:33:57 user nova-compute[231753]:     </disk>
Jul 29 13:33:57 user nova-compute[231753]:     <controller type="scsi" index="0" model="virtio-scsi"/>
Jul 29 13:33:57 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:33:57 user nova-compute[231753]:       <mac address="fa:16:3e:bc:36:c7"/>
Jul 29 13:33:57 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:33:57 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:33:57 user nova-compute[231753]:       <target dev="tap123e72ae-5e"/>
Jul 29 13:33:57 user nova-compute[231753]:     </interface>
Jul 29 13:33:57 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:33:57 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/1be12e63-8803-4ffa-82e1-2fe38f6b5d2d/console.log" append="off"/>
Jul 29 13:33:57 user nova-compute[231753]:     </serial>
Jul 29 13:33:57 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:33:57 user nova-compute[231753]:     <video>
Jul 29 13:33:57 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:33:57 user nova-compute[231753]:     </video>
Jul 29 13:33:57 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:33:57 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:33:57 user nova-compute[231753]:     </rng>
Jul 29 13:33:57 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:33:57 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:33:57 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:33:57 user nova-compute[231753]:     </memballoon>
Jul 29 13:33:57 user nova-compute[231753]:   </devices>
Jul 29 13:33:57 user nova-compute[231753]: </domain>
Jul 29 13:33:57 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:33:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-390597877',display_name='tempest-AttachSCSIVolumeTestJSON-server-390597877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-390597877',id=9,image_ref='ca3d141d-365c-43bb-be22-68278e6218f0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItVTl19j+M7mYQMrxcBhRQHJF1v1vD+/v5ngMDQaPt0tKmniO5U24VkZNpAw5j5yXAQh88t9PCCvHOm6I44Jbe0n4KhUwuVD2V05FAaEfph4uZ3b5soZeQ/N+qvNr64EA==',key_name='tempest-keypair-1894886950',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='98859b41061e45e1a920f57c36b4479f',ramdisk_id='',reservation_id='r-ulg7fbel',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca3d141d-365c-43bb-be22-68278e6218f0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-316015273',owner_user_name='tempest-AttachSCSIVolumeTestJSON-316015273-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:33:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6a2294e0c674f2d83dcbbfbc208964a',uuid=1be12e63-8803-4ffa-82e1-2fe38f6b5d2d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "123e72ae-5ed8-4181-bef2-28713da2545a", "address": "fa:16:3e:bc:36:c7", "network": {"id": "be6b68b0-c543-441a-a338-deabdf4d97f6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1540506582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98859b41061e45e1a920f57c36b4479f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123e72ae-5e", "ovs_interfaceid": "123e72ae-5ed8-4181-bef2-28713da2545a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Converting VIF {"id": "123e72ae-5ed8-4181-bef2-28713da2545a", "address": "fa:16:3e:bc:36:c7", "network": {"id": "be6b68b0-c543-441a-a338-deabdf4d97f6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1540506582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98859b41061e45e1a920f57c36b4479f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123e72ae-5e", "ovs_interfaceid": "123e72ae-5ed8-4181-bef2-28713da2545a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:bc:36:c7,bridge_name='br-int',has_traffic_filtering=True,id=123e72ae-5ed8-4181-bef2-28713da2545a,network=Network(be6b68b0-c543-441a-a338-deabdf4d97f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap123e72ae-5e') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG os_vif [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:36:c7,bridge_name='br-int',has_traffic_filtering=True,id=123e72ae-5ed8-4181-bef2-28713da2545a,network=Network(be6b68b0-c543-441a-a338-deabdf4d97f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap123e72ae-5e') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap123e72ae-5e, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap123e72ae-5e, col_values=(('external_ids', {'iface-id': '123e72ae-5ed8-4181-bef2-28713da2545a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:bc:36:c7', 'vm-uuid': '1be12e63-8803-4ffa-82e1-2fe38f6b5d2d'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:57 user nova-compute[231753]: INFO os_vif [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:bc:36:c7,bridge_name='br-int',has_traffic_filtering=True,id=123e72ae-5ed8-4181-bef2-28713da2545a,network=Network(be6b68b0-c543-441a-a338-deabdf4d97f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap123e72ae-5e')
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] No BDM found with device name sda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] No BDM found with device name sdb, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:33:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] No VIF found with MAC fa:16:3e:bc:36:c7, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:33:57 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Using config drive
Jul 29 13:33:58 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Creating config drive at /opt/stack/data/nova/instances/1be12e63-8803-4ffa-82e1-2fe38f6b5d2d/disk.config
Jul 29 13:33:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/1be12e63-8803-4ffa-82e1-2fe38f6b5d2d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpemv21zuu {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:33:58 user nova-compute[231753]: DEBUG nova.network.neutron [req-2ec4d886-9dd4-4280-a52b-adaa31aa0f39 req-367972fc-d0a8-4db8-8af8-42b9a293c1aa service nova] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Updated VIF entry in instance network info cache for port 123e72ae-5ed8-4181-bef2-28713da2545a. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:33:58 user nova-compute[231753]: DEBUG nova.network.neutron [req-2ec4d886-9dd4-4280-a52b-adaa31aa0f39 req-367972fc-d0a8-4db8-8af8-42b9a293c1aa service nova] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Updating instance_info_cache with network_info: [{"id": "123e72ae-5ed8-4181-bef2-28713da2545a", "address": "fa:16:3e:bc:36:c7", "network": {"id": "be6b68b0-c543-441a-a338-deabdf4d97f6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1540506582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98859b41061e45e1a920f57c36b4479f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123e72ae-5e", "ovs_interfaceid": "123e72ae-5ed8-4181-bef2-28713da2545a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:33:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-2ec4d886-9dd4-4280-a52b-adaa31aa0f39 req-367972fc-d0a8-4db8-8af8-42b9a293c1aa service nova] Releasing lock "refresh_cache-1be12e63-8803-4ffa-82e1-2fe38f6b5d2d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:33:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/1be12e63-8803-4ffa-82e1-2fe38f6b5d2d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpemv21zuu" returned: 0 in 0.073s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:33:58 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:33:58 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 13:33:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:59 user nova-compute[231753]: DEBUG nova.compute.manager [req-13596af2-7158-4f07-9111-b993fad5c0be req-00091516-f084-47e6-959a-de4ebf7d279d service nova] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Received event network-vif-plugged-c6299ccb-7770-4eaf-8e2e-ecea8da9f324 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:33:59 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-13596af2-7158-4f07-9111-b993fad5c0be req-00091516-f084-47e6-959a-de4ebf7d279d service nova] Acquiring lock "b02ec16d-24a3-450d-858d-3ad302086ac3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:33:59 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-13596af2-7158-4f07-9111-b993fad5c0be req-00091516-f084-47e6-959a-de4ebf7d279d service nova] Lock "b02ec16d-24a3-450d-858d-3ad302086ac3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:33:59 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-13596af2-7158-4f07-9111-b993fad5c0be req-00091516-f084-47e6-959a-de4ebf7d279d service nova] Lock "b02ec16d-24a3-450d-858d-3ad302086ac3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:33:59 user nova-compute[231753]: DEBUG nova.compute.manager [req-13596af2-7158-4f07-9111-b993fad5c0be req-00091516-f084-47e6-959a-de4ebf7d279d service nova] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] No waiting events found dispatching network-vif-plugged-c6299ccb-7770-4eaf-8e2e-ecea8da9f324 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:33:59 user nova-compute[231753]: WARNING nova.compute.manager [req-13596af2-7158-4f07-9111-b993fad5c0be req-00091516-f084-47e6-959a-de4ebf7d279d service nova] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Received unexpected event network-vif-plugged-c6299ccb-7770-4eaf-8e2e-ecea8da9f324 for instance with vm_state building and task_state spawning.
Jul 29 13:33:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:33:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:00 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:34:00 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:34:00 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:34:00 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:01 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:01 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:01 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:34:01 user nova-compute[231753]: DEBUG nova.compute.manager [req-be6eab6d-baf8-4f5a-898e-7cb47fbc52f4 req-1acc18d6-ae1b-466e-9cd8-867faa27deaf service nova] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Received event network-vif-plugged-c6299ccb-7770-4eaf-8e2e-ecea8da9f324 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:34:01 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-be6eab6d-baf8-4f5a-898e-7cb47fbc52f4 req-1acc18d6-ae1b-466e-9cd8-867faa27deaf service nova] Acquiring lock "b02ec16d-24a3-450d-858d-3ad302086ac3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:34:01 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-be6eab6d-baf8-4f5a-898e-7cb47fbc52f4 req-1acc18d6-ae1b-466e-9cd8-867faa27deaf service nova] Lock "b02ec16d-24a3-450d-858d-3ad302086ac3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:34:01 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-be6eab6d-baf8-4f5a-898e-7cb47fbc52f4 req-1acc18d6-ae1b-466e-9cd8-867faa27deaf service nova] Lock "b02ec16d-24a3-450d-858d-3ad302086ac3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:34:01 user nova-compute[231753]: DEBUG nova.compute.manager [req-be6eab6d-baf8-4f5a-898e-7cb47fbc52f4 req-1acc18d6-ae1b-466e-9cd8-867faa27deaf service nova] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] No waiting events found dispatching network-vif-plugged-c6299ccb-7770-4eaf-8e2e-ecea8da9f324 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:34:01 user nova-compute[231753]: WARNING nova.compute.manager [req-be6eab6d-baf8-4f5a-898e-7cb47fbc52f4 req-1acc18d6-ae1b-466e-9cd8-867faa27deaf service nova] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Received unexpected event network-vif-plugged-c6299ccb-7770-4eaf-8e2e-ecea8da9f324 for instance with vm_state building and task_state spawning.
Jul 29 13:34:01 user nova-compute[231753]: DEBUG nova.compute.manager [req-eff3a412-e107-419c-8fc1-ad5516c8e1db req-bae3e6ca-30f2-4dd4-b971-87d6ec1895e7 service nova] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Received event network-vif-plugged-123e72ae-5ed8-4181-bef2-28713da2545a {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:34:01 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-eff3a412-e107-419c-8fc1-ad5516c8e1db req-bae3e6ca-30f2-4dd4-b971-87d6ec1895e7 service nova] Acquiring lock "1be12e63-8803-4ffa-82e1-2fe38f6b5d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:34:01 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-eff3a412-e107-419c-8fc1-ad5516c8e1db req-bae3e6ca-30f2-4dd4-b971-87d6ec1895e7 service nova] Lock "1be12e63-8803-4ffa-82e1-2fe38f6b5d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:34:01 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-eff3a412-e107-419c-8fc1-ad5516c8e1db req-bae3e6ca-30f2-4dd4-b971-87d6ec1895e7 service nova] Lock "1be12e63-8803-4ffa-82e1-2fe38f6b5d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:34:01 user nova-compute[231753]: DEBUG nova.compute.manager [req-eff3a412-e107-419c-8fc1-ad5516c8e1db req-bae3e6ca-30f2-4dd4-b971-87d6ec1895e7 service nova] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] No waiting events found dispatching network-vif-plugged-123e72ae-5ed8-4181-bef2-28713da2545a {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:34:01 user nova-compute[231753]: WARNING nova.compute.manager [req-eff3a412-e107-419c-8fc1-ad5516c8e1db req-bae3e6ca-30f2-4dd4-b971-87d6ec1895e7 service nova] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Received unexpected event network-vif-plugged-123e72ae-5ed8-4181-bef2-28713da2545a for instance with vm_state building and task_state spawning.
Jul 29 13:34:01 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:01 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:02 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:34:02 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 13:34:02 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Rebuilding the list of instances to heal {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 13:34:02 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Skipping network cache update for instance because it is Building. {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Jul 29 13:34:02 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Skipping network cache update for instance because it is Building. {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Jul 29 13:34:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "refresh_cache-63fad324-aac2-4d60-b4ce-a32a5736657d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:34:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquired lock "refresh_cache-63fad324-aac2-4d60-b4ce-a32a5736657d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:34:02 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Forcefully refreshing network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 13:34:02 user nova-compute[231753]: DEBUG nova.objects.instance [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lazy-loading 'info_cache' on Instance uuid 63fad324-aac2-4d60-b4ce-a32a5736657d {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:34:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:03 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Updating instance_info_cache with network_info: [{"id": "fadc1466-5336-4230-b0f1-4fe4053f216a", "address": "fa:16:3e:df:12:9c", "network": {"id": "8897db8c-6e92-4b9e-b7ee-a69230eb07f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1596242231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a8a3e0bcef4bbc979ef187e4ed48cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc1466-53", "ovs_interfaceid": "fadc1466-5336-4230-b0f1-4fe4053f216a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:34:03 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Releasing lock "refresh_cache-63fad324-aac2-4d60-b4ce-a32a5736657d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:34:03 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Updated the network info_cache for instance {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 13:34:03 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:34:03 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:34:03 user nova-compute[231753]: DEBUG nova.compute.manager [req-524c5099-d5ea-473a-9a61-8e0102ed1cea req-ef4b4aaa-6c20-412d-9c6c-8154a72e1f50 service nova] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Received event network-vif-plugged-123e72ae-5ed8-4181-bef2-28713da2545a {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:34:03 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-524c5099-d5ea-473a-9a61-8e0102ed1cea req-ef4b4aaa-6c20-412d-9c6c-8154a72e1f50 service nova] Acquiring lock "1be12e63-8803-4ffa-82e1-2fe38f6b5d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:34:03 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-524c5099-d5ea-473a-9a61-8e0102ed1cea req-ef4b4aaa-6c20-412d-9c6c-8154a72e1f50 service nova] Lock "1be12e63-8803-4ffa-82e1-2fe38f6b5d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:34:03 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-524c5099-d5ea-473a-9a61-8e0102ed1cea req-ef4b4aaa-6c20-412d-9c6c-8154a72e1f50 service nova] Lock "1be12e63-8803-4ffa-82e1-2fe38f6b5d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:34:03 user nova-compute[231753]: DEBUG nova.compute.manager [req-524c5099-d5ea-473a-9a61-8e0102ed1cea req-ef4b4aaa-6c20-412d-9c6c-8154a72e1f50 service nova] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] No waiting events found dispatching network-vif-plugged-123e72ae-5ed8-4181-bef2-28713da2545a {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:34:03 user nova-compute[231753]: WARNING nova.compute.manager [req-524c5099-d5ea-473a-9a61-8e0102ed1cea req-ef4b4aaa-6c20-412d-9c6c-8154a72e1f50 service nova] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Received unexpected event network-vif-plugged-123e72ae-5ed8-4181-bef2-28713da2545a for instance with vm_state building and task_state spawning.
Jul 29 13:34:03 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637643.8049579, b02ec16d-24a3-450d-858d-3ad302086ac3 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:34:03 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] VM Resumed (Lifecycle Event)
Jul 29 13:34:03 user nova-compute[231753]: DEBUG nova.compute.manager [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:34:03 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:34:03 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Instance spawned successfully.
Jul 29 13:34:03 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:34:03 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:34:03 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:34:03 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:34:03 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:34:03 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:34:03 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:34:03 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:34:03 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:34:03 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:34:03 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637643.8065126, b02ec16d-24a3-450d-858d-3ad302086ac3 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:34:03 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] VM Started (Lifecycle Event)
Jul 29 13:34:03 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:34:03 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:34:03 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:34:04 user nova-compute[231753]: INFO nova.compute.manager [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Took 13.55 seconds to spawn the instance on the hypervisor.
Jul 29 13:34:04 user nova-compute[231753]: DEBUG nova.compute.manager [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:34:04 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637644.0829675, 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:34:04 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] VM Resumed (Lifecycle Event)
Jul 29 13:34:04 user nova-compute[231753]: DEBUG nova.compute.manager [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:34:04 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:34:04 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:34:04 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Instance spawned successfully.
Jul 29 13:34:04 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:34:04 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:34:04 user nova-compute[231753]: INFO nova.compute.manager [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Took 15.20 seconds to build instance.
Jul 29 13:34:04 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:34:04 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637644.0962086, 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:34:04 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] VM Started (Lifecycle Event)
Jul 29 13:34:04 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:34:04 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:34:04 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:34:04 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:34:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-fd13deaa-226e-4970-8dd5-d37522d7dd61 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Lock "b02ec16d-24a3-450d-858d-3ad302086ac3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.442s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:34:04 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:34:04 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:34:04 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:34:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:34:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:34:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:34:04 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 13:34:04 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:34:04 user nova-compute[231753]: INFO nova.compute.manager [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Took 10.26 seconds to spawn the instance on the hypervisor.
Jul 29 13:34:04 user nova-compute[231753]: DEBUG nova.compute.manager [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:34:04 user nova-compute[231753]: INFO nova.compute.manager [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Took 12.58 seconds to build instance.
Jul 29 13:34:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8405b248-e4e3-4a6d-9f4a-52b43e0781f1 tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Lock "1be12e63-8803-4ffa-82e1-2fe38f6b5d2d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.033s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:34:04 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk --force-share --output=json" returned: 0 in 0.293s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk --force-share --output=json" returned: 0 in 0.241s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json" returned: 0 in 0.210s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02ec16d-24a3-450d-858d-3ad302086ac3/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02ec16d-24a3-450d-858d-3ad302086ac3/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02ec16d-24a3-450d-858d-3ad302086ac3/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02ec16d-24a3-450d-858d-3ad302086ac3/disk --force-share --output=json" returned: 0 in 0.325s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be12e63-8803-4ffa-82e1-2fe38f6b5d2d/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be12e63-8803-4ffa-82e1-2fe38f6b5d2d/disk --force-share --output=json" returned: 0 in 0.260s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be12e63-8803-4ffa-82e1-2fe38f6b5d2d/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be12e63-8803-4ffa-82e1-2fe38f6b5d2d/disk --force-share --output=json" returned: 0 in 0.185s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json" returned: 0 in 0.218s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b21191-c874-4ca8-bd4b-2df90a41ccab/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b21191-c874-4ca8-bd4b-2df90a41ccab/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b21191-c874-4ca8-bd4b-2df90a41ccab/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b21191-c874-4ca8-bd4b-2df90a41ccab/disk --force-share --output=json" returned: 0 in 0.268s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8/disk --force-share --output=json" returned: 0 in 0.202s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/disk --force-share --output=json" returned: 0 in 0.286s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:09 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:34:09 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:34:09 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=7546MB free_disk=25.689441680908203GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 13:34:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:34:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:34:10 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 63fad324-aac2-4d60-b4ce-a32a5736657d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:34:10 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 4475f276-acc4-44f1-a5fa-6a7fb2165493 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:34:10 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:34:10 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 29b21191-c874-4ca8-bd4b-2df90a41ccab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:34:10 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b67b98f8-a7b3-499e-ba32-9520bbced960 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:34:10 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 299b7f21-b198-437b-9d5c-1269d5e9b7c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:34:10 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8822efe3-e17a-4511-b75f-37f6a83616aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:34:10 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b02ec16d-24a3-450d-858d-3ad302086ac3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:34:10 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:34:10 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 13:34:10 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 13:34:10 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Refreshing inventories for resource provider 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 29 13:34:10 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Updating ProviderTree inventory for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 29 13:34:10 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Updating inventory in ProviderTree for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 29 13:34:10 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Refreshing aggregate associations for resource provider 222db5c7-e17f-4307-968d-4284bf5c19f4, aggregates: None {{(pid=231753) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 29 13:34:10 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Refreshing trait associations for resource provider 222db5c7-e17f-4307-968d-4284bf5c19f4, traits: HW_CPU_X86_SSSE3,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_VIRTIO {{(pid=231753) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 29 13:34:10 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:34:10 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:34:11 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 13:34:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.369s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:34:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:17 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:17 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Acquiring lock "5127f26d-e912-49a4-b8ae-6157f0055270" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:34:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Lock "5127f26d-e912-49a4-b8ae-6157f0055270" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:34:28 user nova-compute[231753]: DEBUG nova.compute.manager [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:34:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:34:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:34:28 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:34:28 user nova-compute[231753]: INFO nova.compute.claims [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Claim successful on node user
Jul 29 13:34:29 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:34:29 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:34:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.596s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:34:29 user nova-compute[231753]: DEBUG nova.compute.manager [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:34:29 user nova-compute[231753]: DEBUG nova.compute.manager [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:34:29 user nova-compute[231753]: DEBUG nova.network.neutron [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:34:29 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:34:29 user nova-compute[231753]: DEBUG nova.compute.manager [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:34:29 user nova-compute[231753]: INFO nova.virt.block_device [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Booting with volume f3eaf40c-503b-4301-b848-a237cbc8d6cf at /dev/vda
Jul 29 13:34:29 user nova-compute[231753]: DEBUG os_brick.utils [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:34:29 user nova-compute[231753]: INFO oslo.privsep.daemon [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmp2_6r7g0z/privsep.sock']
Jul 29 13:34:29 user nova-compute[231753]: DEBUG nova.policy [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'dcfae116c60144ef84c15680f8936de3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '195f27dc9cac4e53b96830a5f5168711', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:34:29 user sudo[242766]:    stack : PWD=/ ; USER=root ; COMMAND=/usr/local/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmp2_6r7g0z/privsep.sock
Jul 29 13:34:29 user sudo[242766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1001)
Jul 29 13:34:30 user nova-compute[231753]: DEBUG nova.network.neutron [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Successfully created port: f6babf7d-a012-411a-a2cc-134c92ac26d8 {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:34:30 user nova-compute[231753]: DEBUG nova.network.neutron [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Successfully created port: 28d91bef-df2e-469a-b449-10e27e352ee8 {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:34:31 user nova-compute[231753]: DEBUG nova.network.neutron [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Successfully created port: 7a1e3eda-8abb-49ca-a495-aa7f584a9252 {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:34:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:31 user sudo[242766]: pam_unix(sudo:session): session closed for user root
Jul 29 13:34:31 user nova-compute[231753]: INFO oslo.privsep.daemon [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Spawned new privsep daemon via rootwrap
Jul 29 13:34:31 user nova-compute[231753]: INFO oslo.privsep.daemon [-] privsep daemon starting
Jul 29 13:34:31 user nova-compute[231753]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Jul 29 13:34:31 user nova-compute[231753]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_SYS_ADMIN/CAP_SYS_ADMIN/none
Jul 29 13:34:31 user nova-compute[231753]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 242780
Jul 29 13:34:31 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[49848940-3af7-4d32-b66a-a17a465ae625]: (2,) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:31 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:31 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.012s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:31 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2864ecb8-ebcc-441c-9d54-65c18453b2ff]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:32 user nova-compute[231753]: WARNING os_brick.initiator.connectors.nvmeof [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath'
Jul 29 13:34:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:32 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[54481d60-66b7-4772-82c3-7a95ddd66f4c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:32 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac5eaec-187d-4f7d-a9bd-ad2a7b1c3346]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:32 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ffeb4e-006d-47cb-a43e-2b2fb35492c8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:34:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:34:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:32 user nova-compute[231753]: DEBUG nova.network.neutron [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Successfully created port: 0dd83ad9-c54b-4c90-981a-8982501e36cf {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:34:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:34:32 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:34:32 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[923a5a50-0380-44f8-a923-1c1cf32d27fb]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:34:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:34:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:34:32 user nova-compute[231753]: DEBUG os_brick.utils [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] <== get_connector_properties: return (2688ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:34:32 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Updating existing volume attachment record: 5721cdf7-7a87-44ff-bc7a-3a8bdc218a5e {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:34:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:32 user nova-compute[231753]: DEBUG nova.network.neutron [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Successfully created port: 713bc8f5-df03-42c3-8250-ff7ed4e07f4e {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:34:33 user nova-compute[231753]: DEBUG nova.network.neutron [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Successfully updated port: f6babf7d-a012-411a-a2cc-134c92ac26d8 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:34:33 user nova-compute[231753]: DEBUG nova.compute.manager [req-ed1926cc-7ea5-43f9-985c-2809e0039287 req-2fd0e9ac-1442-4e1f-88ab-ea6b8429e0ec service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-changed-f6babf7d-a012-411a-a2cc-134c92ac26d8 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:34:33 user nova-compute[231753]: DEBUG nova.compute.manager [req-ed1926cc-7ea5-43f9-985c-2809e0039287 req-2fd0e9ac-1442-4e1f-88ab-ea6b8429e0ec service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Refreshing instance network info cache due to event network-changed-f6babf7d-a012-411a-a2cc-134c92ac26d8. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:34:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ed1926cc-7ea5-43f9-985c-2809e0039287 req-2fd0e9ac-1442-4e1f-88ab-ea6b8429e0ec service nova] Acquiring lock "refresh_cache-5127f26d-e912-49a4-b8ae-6157f0055270" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:34:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ed1926cc-7ea5-43f9-985c-2809e0039287 req-2fd0e9ac-1442-4e1f-88ab-ea6b8429e0ec service nova] Acquired lock "refresh_cache-5127f26d-e912-49a4-b8ae-6157f0055270" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:34:33 user nova-compute[231753]: DEBUG nova.network.neutron [req-ed1926cc-7ea5-43f9-985c-2809e0039287 req-2fd0e9ac-1442-4e1f-88ab-ea6b8429e0ec service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Refreshing network info cache for port f6babf7d-a012-411a-a2cc-134c92ac26d8 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:34:33 user nova-compute[231753]: DEBUG nova.network.neutron [req-ed1926cc-7ea5-43f9-985c-2809e0039287 req-2fd0e9ac-1442-4e1f-88ab-ea6b8429e0ec service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:34:34 user nova-compute[231753]: DEBUG nova.network.neutron [req-ed1926cc-7ea5-43f9-985c-2809e0039287 req-2fd0e9ac-1442-4e1f-88ab-ea6b8429e0ec service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:34:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ed1926cc-7ea5-43f9-985c-2809e0039287 req-2fd0e9ac-1442-4e1f-88ab-ea6b8429e0ec service nova] Releasing lock "refresh_cache-5127f26d-e912-49a4-b8ae-6157f0055270" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:34:34 user nova-compute[231753]: DEBUG nova.network.neutron [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Successfully updated port: c652fd6e-0d41-4593-8d73-893962490f30 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:34:35 user nova-compute[231753]: DEBUG nova.network.neutron [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Successfully updated port: e106a9dd-3d36-4bea-953b-fe65ba4747a5 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:34:35 user nova-compute[231753]: DEBUG nova.compute.manager [req-4b96fa94-b27c-4c3c-97bb-e82c8e955dbe req-85bcb9a4-466f-4ec4-b247-135fb3d3770b service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-changed-c652fd6e-0d41-4593-8d73-893962490f30 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:34:35 user nova-compute[231753]: DEBUG nova.compute.manager [req-4b96fa94-b27c-4c3c-97bb-e82c8e955dbe req-85bcb9a4-466f-4ec4-b247-135fb3d3770b service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Refreshing instance network info cache due to event network-changed-c652fd6e-0d41-4593-8d73-893962490f30. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:34:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4b96fa94-b27c-4c3c-97bb-e82c8e955dbe req-85bcb9a4-466f-4ec4-b247-135fb3d3770b service nova] Acquiring lock "refresh_cache-5127f26d-e912-49a4-b8ae-6157f0055270" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:34:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4b96fa94-b27c-4c3c-97bb-e82c8e955dbe req-85bcb9a4-466f-4ec4-b247-135fb3d3770b service nova] Acquired lock "refresh_cache-5127f26d-e912-49a4-b8ae-6157f0055270" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:34:35 user nova-compute[231753]: DEBUG nova.network.neutron [req-4b96fa94-b27c-4c3c-97bb-e82c8e955dbe req-85bcb9a4-466f-4ec4-b247-135fb3d3770b service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Refreshing network info cache for port c652fd6e-0d41-4593-8d73-893962490f30 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:34:36 user nova-compute[231753]: DEBUG nova.network.neutron [req-4b96fa94-b27c-4c3c-97bb-e82c8e955dbe req-85bcb9a4-466f-4ec4-b247-135fb3d3770b service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:34:36 user nova-compute[231753]: DEBUG nova.network.neutron [req-4b96fa94-b27c-4c3c-97bb-e82c8e955dbe req-85bcb9a4-466f-4ec4-b247-135fb3d3770b service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:34:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4b96fa94-b27c-4c3c-97bb-e82c8e955dbe req-85bcb9a4-466f-4ec4-b247-135fb3d3770b service nova] Releasing lock "refresh_cache-5127f26d-e912-49a4-b8ae-6157f0055270" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:34:36 user nova-compute[231753]: DEBUG nova.compute.manager [req-4b96fa94-b27c-4c3c-97bb-e82c8e955dbe req-85bcb9a4-466f-4ec4-b247-135fb3d3770b service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-changed-e106a9dd-3d36-4bea-953b-fe65ba4747a5 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:34:36 user nova-compute[231753]: DEBUG nova.compute.manager [req-4b96fa94-b27c-4c3c-97bb-e82c8e955dbe req-85bcb9a4-466f-4ec4-b247-135fb3d3770b service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Refreshing instance network info cache due to event network-changed-e106a9dd-3d36-4bea-953b-fe65ba4747a5. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:34:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4b96fa94-b27c-4c3c-97bb-e82c8e955dbe req-85bcb9a4-466f-4ec4-b247-135fb3d3770b service nova] Acquiring lock "refresh_cache-5127f26d-e912-49a4-b8ae-6157f0055270" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:34:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4b96fa94-b27c-4c3c-97bb-e82c8e955dbe req-85bcb9a4-466f-4ec4-b247-135fb3d3770b service nova] Acquired lock "refresh_cache-5127f26d-e912-49a4-b8ae-6157f0055270" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:34:36 user nova-compute[231753]: DEBUG nova.network.neutron [req-4b96fa94-b27c-4c3c-97bb-e82c8e955dbe req-85bcb9a4-466f-4ec4-b247-135fb3d3770b service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Refreshing network info cache for port e106a9dd-3d36-4bea-953b-fe65ba4747a5 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:34:36 user nova-compute[231753]: DEBUG nova.network.neutron [req-4b96fa94-b27c-4c3c-97bb-e82c8e955dbe req-85bcb9a4-466f-4ec4-b247-135fb3d3770b service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:34:36 user nova-compute[231753]: DEBUG nova.network.neutron [req-4b96fa94-b27c-4c3c-97bb-e82c8e955dbe req-85bcb9a4-466f-4ec4-b247-135fb3d3770b service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:34:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4b96fa94-b27c-4c3c-97bb-e82c8e955dbe req-85bcb9a4-466f-4ec4-b247-135fb3d3770b service nova] Releasing lock "refresh_cache-5127f26d-e912-49a4-b8ae-6157f0055270" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:34:36 user nova-compute[231753]: DEBUG nova.network.neutron [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Successfully updated port: 28d91bef-df2e-469a-b449-10e27e352ee8 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:34:37 user nova-compute[231753]: DEBUG nova.network.neutron [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Successfully updated port: 7a1e3eda-8abb-49ca-a495-aa7f584a9252 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:34:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:38 user nova-compute[231753]: DEBUG nova.compute.manager [req-4762726c-2137-4a9f-896e-5af43948aca4 req-0da827d0-e50e-4eaa-b668-1e9a8e8a8f92 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-changed-28d91bef-df2e-469a-b449-10e27e352ee8 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:34:38 user nova-compute[231753]: DEBUG nova.compute.manager [req-4762726c-2137-4a9f-896e-5af43948aca4 req-0da827d0-e50e-4eaa-b668-1e9a8e8a8f92 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Refreshing instance network info cache due to event network-changed-28d91bef-df2e-469a-b449-10e27e352ee8. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:34:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4762726c-2137-4a9f-896e-5af43948aca4 req-0da827d0-e50e-4eaa-b668-1e9a8e8a8f92 service nova] Acquiring lock "refresh_cache-5127f26d-e912-49a4-b8ae-6157f0055270" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:34:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4762726c-2137-4a9f-896e-5af43948aca4 req-0da827d0-e50e-4eaa-b668-1e9a8e8a8f92 service nova] Acquired lock "refresh_cache-5127f26d-e912-49a4-b8ae-6157f0055270" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:34:38 user nova-compute[231753]: DEBUG nova.network.neutron [req-4762726c-2137-4a9f-896e-5af43948aca4 req-0da827d0-e50e-4eaa-b668-1e9a8e8a8f92 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Refreshing network info cache for port 28d91bef-df2e-469a-b449-10e27e352ee8 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:34:38 user nova-compute[231753]: DEBUG nova.network.neutron [req-4762726c-2137-4a9f-896e-5af43948aca4 req-0da827d0-e50e-4eaa-b668-1e9a8e8a8f92 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:34:38 user nova-compute[231753]: DEBUG nova.network.neutron [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Successfully updated port: 0dd83ad9-c54b-4c90-981a-8982501e36cf {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:34:38 user nova-compute[231753]: DEBUG nova.network.neutron [req-4762726c-2137-4a9f-896e-5af43948aca4 req-0da827d0-e50e-4eaa-b668-1e9a8e8a8f92 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:34:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4762726c-2137-4a9f-896e-5af43948aca4 req-0da827d0-e50e-4eaa-b668-1e9a8e8a8f92 service nova] Releasing lock "refresh_cache-5127f26d-e912-49a4-b8ae-6157f0055270" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:34:38 user nova-compute[231753]: DEBUG nova.compute.manager [req-4762726c-2137-4a9f-896e-5af43948aca4 req-0da827d0-e50e-4eaa-b668-1e9a8e8a8f92 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-changed-7a1e3eda-8abb-49ca-a495-aa7f584a9252 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:34:38 user nova-compute[231753]: DEBUG nova.compute.manager [req-4762726c-2137-4a9f-896e-5af43948aca4 req-0da827d0-e50e-4eaa-b668-1e9a8e8a8f92 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Refreshing instance network info cache due to event network-changed-7a1e3eda-8abb-49ca-a495-aa7f584a9252. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:34:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4762726c-2137-4a9f-896e-5af43948aca4 req-0da827d0-e50e-4eaa-b668-1e9a8e8a8f92 service nova] Acquiring lock "refresh_cache-5127f26d-e912-49a4-b8ae-6157f0055270" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:34:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4762726c-2137-4a9f-896e-5af43948aca4 req-0da827d0-e50e-4eaa-b668-1e9a8e8a8f92 service nova] Acquired lock "refresh_cache-5127f26d-e912-49a4-b8ae-6157f0055270" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:34:38 user nova-compute[231753]: DEBUG nova.network.neutron [req-4762726c-2137-4a9f-896e-5af43948aca4 req-0da827d0-e50e-4eaa-b668-1e9a8e8a8f92 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Refreshing network info cache for port 7a1e3eda-8abb-49ca-a495-aa7f584a9252 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:34:38 user nova-compute[231753]: DEBUG nova.network.neutron [req-4762726c-2137-4a9f-896e-5af43948aca4 req-0da827d0-e50e-4eaa-b668-1e9a8e8a8f92 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:34:38 user nova-compute[231753]: DEBUG nova.network.neutron [req-4762726c-2137-4a9f-896e-5af43948aca4 req-0da827d0-e50e-4eaa-b668-1e9a8e8a8f92 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:34:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4762726c-2137-4a9f-896e-5af43948aca4 req-0da827d0-e50e-4eaa-b668-1e9a8e8a8f92 service nova] Releasing lock "refresh_cache-5127f26d-e912-49a4-b8ae-6157f0055270" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:34:39 user nova-compute[231753]: DEBUG nova.network.neutron [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Successfully updated port: 713bc8f5-df03-42c3-8250-ff7ed4e07f4e {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:34:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Acquiring lock "refresh_cache-5127f26d-e912-49a4-b8ae-6157f0055270" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:34:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Acquired lock "refresh_cache-5127f26d-e912-49a4-b8ae-6157f0055270" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:34:39 user nova-compute[231753]: DEBUG nova.network.neutron [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:34:39 user nova-compute[231753]: DEBUG nova.network.neutron [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:34:39 user nova-compute[231753]: INFO nova.virt.block_device [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Booting with volume 55023ac1-9e61-4b60-afc0-f6961380cd9c at /dev/vdb
Jul 29 13:34:39 user nova-compute[231753]: DEBUG os_brick.utils [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:34:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e597d31a-e62b-4ac1-87c9-30d97b44fa9e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[623c4af5-f009-499a-a9a3-1dc2513ccf1a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[911e36db-e4e9-44d1-96c1-f150783b28a5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7873d12-ad8b-4bd7-a006-c7a0bcfb64f1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:34:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:34:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:34:39 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:34:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbad7e76-cc30-4c80-943e-175e6296d7d0]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:34:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:34:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:34:39 user nova-compute[231753]: DEBUG os_brick.utils [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:34:39 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Updating existing volume attachment record: 9a5b4147-200d-4f07-b298-f71d541e3875 {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:34:40 user nova-compute[231753]: DEBUG nova.compute.manager [req-dfb0daf0-3ae7-4e76-b3c7-d800e41a883b req-c1332cf4-70d5-4f83-9082-23341d61eed0 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-changed-0dd83ad9-c54b-4c90-981a-8982501e36cf {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:34:40 user nova-compute[231753]: DEBUG nova.compute.manager [req-dfb0daf0-3ae7-4e76-b3c7-d800e41a883b req-c1332cf4-70d5-4f83-9082-23341d61eed0 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Refreshing instance network info cache due to event network-changed-0dd83ad9-c54b-4c90-981a-8982501e36cf. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:34:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-dfb0daf0-3ae7-4e76-b3c7-d800e41a883b req-c1332cf4-70d5-4f83-9082-23341d61eed0 service nova] Acquiring lock "refresh_cache-5127f26d-e912-49a4-b8ae-6157f0055270" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:34:41 user nova-compute[231753]: DEBUG nova.network.neutron [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Updating instance_info_cache with network_info: [{"id": "f6babf7d-a012-411a-a2cc-134c92ac26d8", "address": "fa:16:3e:0f:55:20", "network": {"id": "506f7783-e44a-4de3-8c0d-aa1177c2eef6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-998637392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6babf7d-a0", "ovs_interfaceid": "f6babf7d-a012-411a-a2cc-134c92ac26d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c652fd6e-0d41-4593-8d73-893962490f30", "address": "fa:16:3e:45:ca:0a", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652fd6e-0d", "ovs_interfaceid": "c652fd6e-0d41-4593-8d73-893962490f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e106a9dd-3d36-4bea-953b-fe65ba4747a5", "address": "fa:16:3e:6a:51:5c", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106a9dd-3d", "ovs_interfaceid": "e106a9dd-3d36-4bea-953b-fe65ba4747a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28d91bef-df2e-469a-b449-10e27e352ee8", "address": "fa:16:3e:d4:e9:c0", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d91bef-df", "ovs_interfaceid": "28d91bef-df2e-469a-b449-10e27e352ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a1e3eda-8abb-49ca-a495-aa7f584a9252", "address": "fa:16:3e:30:08:c1", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1e3eda-8a", "ovs_interfaceid": "7a1e3eda-8abb-49ca-a495-aa7f584a9252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0dd83ad9-c54b-4c90-981a-8982501e36cf", "address": "fa:16:3e:cb:c0:08", "network": {"id": "70108ad7-d95b-4b71-a4b1-d6750a3d30cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-155167949", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dd83ad9-c5", "ovs_interfaceid": "0dd83ad9-c54b-4c90-981a-8982501e36cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "713bc8f5-df03-42c3-8250-ff7ed4e07f4e", "address": "fa:16:3e:22:fe:88", "network": {"id": "70108ad7-d95b-4b71-a4b1-d6750a3d30cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-155167949", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap713bc8f5-df", "ovs_interfaceid": "713bc8f5-df03-42c3-8250-ff7ed4e07f4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:34:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Releasing lock "refresh_cache-5127f26d-e912-49a4-b8ae-6157f0055270" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:34:41 user nova-compute[231753]: DEBUG nova.compute.manager [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Instance network_info: |[{"id": "f6babf7d-a012-411a-a2cc-134c92ac26d8", "address": "fa:16:3e:0f:55:20", "network": {"id": "506f7783-e44a-4de3-8c0d-aa1177c2eef6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-998637392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6babf7d-a0", "ovs_interfaceid": "f6babf7d-a012-411a-a2cc-134c92ac26d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c652fd6e-0d41-4593-8d73-893962490f30", "address": "fa:16:3e:45:ca:0a", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652fd6e-0d", "ovs_interfaceid": "c652fd6e-0d41-4593-8d73-893962490f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e106a9dd-3d36-4bea-953b-fe65ba4747a5", "address": "fa:16:3e:6a:51:5c", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106a9dd-3d", "ovs_interfaceid": "e106a9dd-3d36-4bea-953b-fe65ba4747a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28d91bef-df2e-469a-b449-10e27e352ee8", "address": "fa:16:3e:d4:e9:c0", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d91bef-df", "ovs_interfaceid": "28d91bef-df2e-469a-b449-10e27e352ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a1e3eda-8abb-49ca-a495-aa7f584a9252", "address": "fa:16:3e:30:08:c1", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1e3eda-8a", "ovs_interfaceid": "7a1e3eda-8abb-49ca-a495-aa7f584a9252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0dd83ad9-c54b-4c90-981a-8982501e36cf", "address": "fa:16:3e:cb:c0:08", "network": {"id": "70108ad7-d95b-4b71-a4b1-d6750a3d30cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-155167949", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dd83ad9-c5", "ovs_interfaceid": "0dd83ad9-c54b-4c90-981a-8982501e36cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "713bc8f5-df03-42c3-8250-ff7ed4e07f4e", "address": "fa:16:3e:22:fe:88", "network": {"id": "70108ad7-d95b-4b71-a4b1-d6750a3d30cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-155167949", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap713bc8f5-df", "ovs_interfaceid": "713bc8f5-df03-42c3-8250-ff7ed4e07f4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:34:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-dfb0daf0-3ae7-4e76-b3c7-d800e41a883b req-c1332cf4-70d5-4f83-9082-23341d61eed0 service nova] Acquired lock "refresh_cache-5127f26d-e912-49a4-b8ae-6157f0055270" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:34:41 user nova-compute[231753]: DEBUG nova.network.neutron [req-dfb0daf0-3ae7-4e76-b3c7-d800e41a883b req-c1332cf4-70d5-4f83-9082-23341d61eed0 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Refreshing network info cache for port 0dd83ad9-c54b-4c90-981a-8982501e36cf {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:34:41 user nova-compute[231753]: DEBUG nova.network.neutron [req-dfb0daf0-3ae7-4e76-b3c7-d800e41a883b req-c1332cf4-70d5-4f83-9082-23341d61eed0 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Updated VIF entry in instance network info cache for port 0dd83ad9-c54b-4c90-981a-8982501e36cf. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:34:41 user nova-compute[231753]: DEBUG nova.network.neutron [req-dfb0daf0-3ae7-4e76-b3c7-d800e41a883b req-c1332cf4-70d5-4f83-9082-23341d61eed0 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Updating instance_info_cache with network_info: [{"id": "f6babf7d-a012-411a-a2cc-134c92ac26d8", "address": "fa:16:3e:0f:55:20", "network": {"id": "506f7783-e44a-4de3-8c0d-aa1177c2eef6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-998637392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6babf7d-a0", "ovs_interfaceid": "f6babf7d-a012-411a-a2cc-134c92ac26d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c652fd6e-0d41-4593-8d73-893962490f30", "address": "fa:16:3e:45:ca:0a", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652fd6e-0d", "ovs_interfaceid": "c652fd6e-0d41-4593-8d73-893962490f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e106a9dd-3d36-4bea-953b-fe65ba4747a5", "address": "fa:16:3e:6a:51:5c", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106a9dd-3d", "ovs_interfaceid": "e106a9dd-3d36-4bea-953b-fe65ba4747a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28d91bef-df2e-469a-b449-10e27e352ee8", "address": "fa:16:3e:d4:e9:c0", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d91bef-df", "ovs_interfaceid": "28d91bef-df2e-469a-b449-10e27e352ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a1e3eda-8abb-49ca-a495-aa7f584a9252", "address": "fa:16:3e:30:08:c1", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1e3eda-8a", "ovs_interfaceid": "7a1e3eda-8abb-49ca-a495-aa7f584a9252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0dd83ad9-c54b-4c90-981a-8982501e36cf", "address": "fa:16:3e:cb:c0:08", "network": {"id": "70108ad7-d95b-4b71-a4b1-d6750a3d30cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-155167949", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dd83ad9-c5", "ovs_interfaceid": "0dd83ad9-c54b-4c90-981a-8982501e36cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "713bc8f5-df03-42c3-8250-ff7ed4e07f4e", "address": "fa:16:3e:22:fe:88", "network": {"id": "70108ad7-d95b-4b71-a4b1-d6750a3d30cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-155167949", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap713bc8f5-df", "ovs_interfaceid": "713bc8f5-df03-42c3-8250-ff7ed4e07f4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:34:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-dfb0daf0-3ae7-4e76-b3c7-d800e41a883b req-c1332cf4-70d5-4f83-9082-23341d61eed0 service nova] Releasing lock "refresh_cache-5127f26d-e912-49a4-b8ae-6157f0055270" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:34:41 user nova-compute[231753]: DEBUG nova.compute.manager [req-dfb0daf0-3ae7-4e76-b3c7-d800e41a883b req-c1332cf4-70d5-4f83-9082-23341d61eed0 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-changed-713bc8f5-df03-42c3-8250-ff7ed4e07f4e {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:34:41 user nova-compute[231753]: DEBUG nova.compute.manager [req-dfb0daf0-3ae7-4e76-b3c7-d800e41a883b req-c1332cf4-70d5-4f83-9082-23341d61eed0 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Refreshing instance network info cache due to event network-changed-713bc8f5-df03-42c3-8250-ff7ed4e07f4e. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:34:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-dfb0daf0-3ae7-4e76-b3c7-d800e41a883b req-c1332cf4-70d5-4f83-9082-23341d61eed0 service nova] Acquiring lock "refresh_cache-5127f26d-e912-49a4-b8ae-6157f0055270" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:34:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-dfb0daf0-3ae7-4e76-b3c7-d800e41a883b req-c1332cf4-70d5-4f83-9082-23341d61eed0 service nova] Acquired lock "refresh_cache-5127f26d-e912-49a4-b8ae-6157f0055270" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:34:41 user nova-compute[231753]: DEBUG nova.network.neutron [req-dfb0daf0-3ae7-4e76-b3c7-d800e41a883b req-c1332cf4-70d5-4f83-9082-23341d61eed0 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Refreshing network info cache for port 713bc8f5-df03-42c3-8250-ff7ed4e07f4e {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:34:42 user nova-compute[231753]: DEBUG nova.network.neutron [req-dfb0daf0-3ae7-4e76-b3c7-d800e41a883b req-c1332cf4-70d5-4f83-9082-23341d61eed0 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Updated VIF entry in instance network info cache for port 713bc8f5-df03-42c3-8250-ff7ed4e07f4e. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:34:42 user nova-compute[231753]: DEBUG nova.network.neutron [req-dfb0daf0-3ae7-4e76-b3c7-d800e41a883b req-c1332cf4-70d5-4f83-9082-23341d61eed0 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Updating instance_info_cache with network_info: [{"id": "f6babf7d-a012-411a-a2cc-134c92ac26d8", "address": "fa:16:3e:0f:55:20", "network": {"id": "506f7783-e44a-4de3-8c0d-aa1177c2eef6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-998637392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6babf7d-a0", "ovs_interfaceid": "f6babf7d-a012-411a-a2cc-134c92ac26d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c652fd6e-0d41-4593-8d73-893962490f30", "address": "fa:16:3e:45:ca:0a", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652fd6e-0d", "ovs_interfaceid": "c652fd6e-0d41-4593-8d73-893962490f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e106a9dd-3d36-4bea-953b-fe65ba4747a5", "address": "fa:16:3e:6a:51:5c", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106a9dd-3d", "ovs_interfaceid": "e106a9dd-3d36-4bea-953b-fe65ba4747a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28d91bef-df2e-469a-b449-10e27e352ee8", "address": "fa:16:3e:d4:e9:c0", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d91bef-df", "ovs_interfaceid": "28d91bef-df2e-469a-b449-10e27e352ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a1e3eda-8abb-49ca-a495-aa7f584a9252", "address": "fa:16:3e:30:08:c1", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1e3eda-8a", "ovs_interfaceid": "7a1e3eda-8abb-49ca-a495-aa7f584a9252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0dd83ad9-c54b-4c90-981a-8982501e36cf", "address": "fa:16:3e:cb:c0:08", "network": {"id": "70108ad7-d95b-4b71-a4b1-d6750a3d30cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-155167949", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dd83ad9-c5", "ovs_interfaceid": "0dd83ad9-c54b-4c90-981a-8982501e36cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "713bc8f5-df03-42c3-8250-ff7ed4e07f4e", "address": "fa:16:3e:22:fe:88", "network": {"id": "70108ad7-d95b-4b71-a4b1-d6750a3d30cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-155167949", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap713bc8f5-df", "ovs_interfaceid": "713bc8f5-df03-42c3-8250-ff7ed4e07f4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:34:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-dfb0daf0-3ae7-4e76-b3c7-d800e41a883b req-c1332cf4-70d5-4f83-9082-23341d61eed0 service nova] Releasing lock "refresh_cache-5127f26d-e912-49a4-b8ae-6157f0055270" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:34:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:34:47 user nova-compute[231753]: INFO nova.virt.block_device [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Booting with volume d53c30b5-db6e-4df2-a6cc-598971557008 at /dev/vdc
Jul 29 13:34:47 user nova-compute[231753]: DEBUG os_brick.utils [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:34:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:47 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b947b9b8-4481-4293-b6c5-a61e05aee7fd]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:47 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccd2afa7-e470-45f6-a6e9-bad48ed75f63]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:47 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d20de45-49ed-4423-963b-e87d4f08bbdd]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:47 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[726d8c9b-71a8-4802-9cd7-110ae6d6561b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:34:47 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:34:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:34:47 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:34:47 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b95fbb7-27f2-4a91-9f29-1e00ae7f31c0]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:47 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:34:47 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:34:47 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:34:47 user nova-compute[231753]: DEBUG os_brick.utils [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:34:47 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Updating existing volume attachment record: bb27ff64-d86d-4dfb-b3ca-ca64a6202c0d {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:34:47 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:34:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG nova.compute.manager [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:34:55 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Creating image(s)
Jul 29 13:34:55 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Did not create local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Ensure instance console log exists: /opt/stack/data/nova/instances/5127f26d-e912-49a4-b8ae-6157f0055270/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Start _get_guest_xml network_info=[{"id": "f6babf7d-a012-411a-a2cc-134c92ac26d8", "address": "fa:16:3e:0f:55:20", "network": {"id": "506f7783-e44a-4de3-8c0d-aa1177c2eef6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-998637392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6babf7d-a0", "ovs_interfaceid": "f6babf7d-a012-411a-a2cc-134c92ac26d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c652fd6e-0d41-4593-8d73-893962490f30", "address": "fa:16:3e:45:ca:0a", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652fd6e-0d", "ovs_interfaceid": "c652fd6e-0d41-4593-8d73-893962490f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e106a9dd-3d36-4bea-953b-fe65ba4747a5", "address": "fa:16:3e:6a:51:5c", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106a9dd-3d", "ovs_interfaceid": "e106a9dd-3d36-4bea-953b-fe65ba4747a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28d91bef-df2e-469a-b449-10e27e352ee8", "address": "fa:16:3e:d4:e9:c0", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d91bef-df", "ovs_interfaceid": "28d91bef-df2e-469a-b449-10e27e352ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a1e3eda-8abb-49ca-a495-aa7f584a9252", "address": "fa:16:3e:30:08:c1", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1e3eda-8a", "ovs_interfaceid": "7a1e3eda-8abb-49ca-a495-aa7f584a9252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0dd83ad9-c54b-4c90-981a-8982501e36cf", "address": "fa:16:3e:cb:c0:08", "network": {"id": "70108ad7-d95b-4b71-a4b1-d6750a3d30cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-155167949", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dd83ad9-c5", "ovs_interfaceid": "0dd83ad9-c54b-4c90-981a-8982501e36cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "713bc8f5-df03-42c3-8250-ff7ed4e07f4e", "address": "fa:16:3e:22:fe:88", "network": {"id": "70108ad7-d95b-4b71-a4b1-d6750a3d30cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-155167949", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap713bc8f5-df", "ovs_interfaceid": "713bc8f5-df03-42c3-8250-ff7ed4e07f4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KqOjMvDc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5127f26d-e912-49a4-b8ae-6157f0055270', 'attached_at': '', 'detached_at': '', 'volume_id': 'f3eaf40c-503b-4301-b848-a237cbc8d6cf', 'serial': 'f3eaf40c-503b-4301-b848-a237cbc8d6cf'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '5721cdf7-7a87-44ff-bc7a-3a8bdc218a5e', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFthIgSl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5127f26d-e912-49a4-b8ae-6157f0055270', 'attached_at': '', 'detached_at': '', 'volume_id': '55023ac1-9e61-4b60-afc0-f6961380cd9c', 'serial': '55023ac1-9e61-4b60-afc0-f6961380cd9c'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '9a5b4147-200d-4f07-b298-f71d541e3875', 'boot_index': 1, 'disk_bus': 'virtio', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wDGIyoej', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '5127f26d-e912-49a4-b8ae-6157f0055270', 'attached_at': '', 'detached_at': '', 'volume_id': 'd53c30b5-db6e-4df2-a6cc-598971557008', 'serial': 'd53c30b5-db6e-4df2-a6cc-598971557008'}, 'guest_format': None, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': 'bb27ff64-d86d-4dfb-b3ca-ca64a6202c0d', 'boot_index': 2, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:34:55 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:34:55 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:34:55 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG os_brick.initiator.connector [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Factory for ISCSI on None {{(pid=231753) factory /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connector.py:281}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.<locals>._cache_volume_driver" :: held 0.006s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KqOjMvDc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:34:55 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:34:55 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:34:55 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:34:55 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:34:55 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf -p 172.16.0.220:3260" returned: 21 in 0.040s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b5865b-e528-4527-908a-0ceaaca8e580]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:34:55 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b87eaa-8484-4f60-b7c8-a69d1e04c653]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf] added
Jul 29 13:34:55 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7640c8-55eb-4750-a0cd-94c92203a817]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9eaf8c1-ef36-4111-8da3-8f191ea7c0d9]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KqOjMvDc {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v KqOjMvDc" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7134b73f-5fe7-4632-b3bf-bad6e5164f7a]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'KqOjMvDc'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffe9b616-f74d-4567-8bba-1d7a05fe3f6d]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[02425118-1efa-4a56-b015-001fe6510118]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 29 13:34:55 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 29 13:34:55 user nova-compute[231753]:  {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:34:55 user nova-compute[231753]: WARNING os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 29 13:34:55 user nova-compute[231753]: 
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc35cc1-3ce0-4b80-a7fd-c293b9c40eaf]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf, portal: 172.16.0.220,3260]
Jul 29 13:34:55 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf, portal: 172.16.0.220,3260] successful.
Jul 29 13:34:55 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eaaaa3c-4fa2-410a-a7b2-0803621157fc]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[542a4d2b-759c-4675-aa9b-eef4d7cea6b1]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:34:55 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:34:55 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.263s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] HCTL ('33', '-', '-', 0) found on session 2 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f949805e-28fe-47b7-9f4a-73df2fdd7624]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:55 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: None {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Searching for a device in session 2 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KqOjMvDc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.295s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] <== connect_volume: return (1296ms) {'type': 'block', 'scsi_wwn': '26364303763383336', 'path': '/dev/sdb'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26364303763383336', 'path': '/dev/sdb'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFthIgSl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:34:56 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:34:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:34:56 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:34:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:34:56 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:34:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9be9618-b184-4060-a20a-8d19c8732c00]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:34:56 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bc66012-663a-4479-b265-1b047090b3c5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c] added
Jul 29 13:34:56 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e4425b2-e54a-44e9-94f7-461880a905ec]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9beb01c2-c673-4054-93bd-280766fb0103]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iFthIgSl {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v iFthIgSl" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2160c6e4-5b69-4f90-ad68-3574be42f659]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'iFthIgSl'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5ee9cd-1a68-4a55-8d53-0fc5bcdd4ed1]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8203a58f-a86a-4c91-89d2-f29c2a5a3777]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:34:56 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:34:56 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c -p 172.16.0.220:3260 --login" returned: 0 in 0.057s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[59ceff4a-c8f1-4a77-a850-687b1c598d4e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c, portal: 172.16.0.220,3260]
Jul 29 13:34:56 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c, portal: 172.16.0.220,3260] successful.
Jul 29 13:34:56 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.043s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[585c97d8-a073-4857-9768-70b5dd7b325c]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb19ccbb-6967-45ef-8def-4abbf86a7ed3]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:34:56 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:34:56 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:34:56 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:34:56 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.297s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] HCTL ('34', '-', '-', 0) found on session 3 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2babf6c-8b07-481e-b5c3-4dabafe94563]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:56 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: None {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:34:57 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:57 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Searching for a device in session 3 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:34:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFthIgSl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:34:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.324s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:34:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] <== connect_volume: return (1325ms) {'type': 'block', 'scsi_wwn': '23638656330396535', 'path': '/dev/sdc'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:34:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23638656330396535', 'path': '/dev/sdc'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:34:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:34:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wDGIyoej', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:34:57 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:34:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:34:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:34:57 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:34:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:34:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:34:57 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:34:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:57 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe85b53-c32f-4592-a8e4-bddfaff90233]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:34:57 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:34:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:57 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd20f012-0882-4990-b5b0-d26f0729cea5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008] added
Jul 29 13:34:57 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:34:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.092s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a83c834-50de-428c-ab66-e8299842d8e4]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4197dc8c-eeec-43cc-9840-7ce9835150b0]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wDGIyoej {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wDGIyoej" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ffffcfe-f4b8-4d1d-be2a-5e646d06004c]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wDGIyoej'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[467cb2ae-e04a-4f01-8606-bd1ad6ddc9cf]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[950d48bb-9ce0-4483-8f80-d623f761ea31]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:34:58 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:34:58 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:34:58 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:34:58 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 -p 172.16.0.220:3260 --login" returned: 0 in 0.067s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d834aac-4aa7-41f3-8f45-afde94cda019]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008, portal: 172.16.0.220,3260]
Jul 29 13:34:58 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008, portal: 172.16.0.220,3260] successful.
Jul 29 13:34:58 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcc7404b-c430-438c-bc5c-4714d3d85da6]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[426839fa-cb8a-4bd2-9ad5-06c4566879a7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:34:58 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:34:58 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:34:58 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:34:58 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:34:58 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:34:58 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.349s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] HCTL ('35', '-', '-', 0) found on session 4 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f6bc4db-f46a-4b8e-86b8-162e7a6ecd3a]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:34:58 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: None {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Searching for a device in session 4 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wDGIyoej', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] <== connect_volume: return (1381ms) {'type': 'block', 'scsi_wwn': '26561306636373465', 'path': '/dev/sdd'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26561306636373465', 'path': '/dev/sdd'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:34:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-193231798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-193231798',id=10,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnjgLufIx9AcHRLY1+xFOFrurx8FQrjKmAFitYyIVkA0E/XFblcb7deXyn7s807fFsDqkhMPJXSw7WsvI3EyPFy9AaTFOnoPnOc9y58HRuKN2BV9abvk9+1sjgea9bM1A==',key_name='tempest-keypair-2063282615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='195f27dc9cac4e53b96830a5f5168711',ramdisk_id='',reservation_id='r-97j3f17v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2120010551',owner_user_name='tempest-TaggedBootDevicesTest-2120010551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:34:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcfae116c60144ef84c15680f8936de3',uuid=5127f26d-e912-49a4-b8ae-6157f0055270,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6babf7d-a012-411a-a2cc-134c92ac26d8", "address": "fa:16:3e:0f:55:20", "network": {"id": "506f7783-e44a-4de3-8c0d-aa1177c2eef6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-998637392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6babf7d-a0", "ovs_interfaceid": "f6babf7d-a012-411a-a2cc-134c92ac26d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converting VIF {"id": "f6babf7d-a012-411a-a2cc-134c92ac26d8", "address": "fa:16:3e:0f:55:20", "network": {"id": "506f7783-e44a-4de3-8c0d-aa1177c2eef6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-998637392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6babf7d-a0", "ovs_interfaceid": "f6babf7d-a012-411a-a2cc-134c92ac26d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:55:20,bridge_name='br-int',has_traffic_filtering=True,id=f6babf7d-a012-411a-a2cc-134c92ac26d8,network=Network(506f7783-e44a-4de3-8c0d-aa1177c2eef6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6babf7d-a0') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:34:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-193231798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-193231798',id=10,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnjgLufIx9AcHRLY1+xFOFrurx8FQrjKmAFitYyIVkA0E/XFblcb7deXyn7s807fFsDqkhMPJXSw7WsvI3EyPFy9AaTFOnoPnOc9y58HRuKN2BV9abvk9+1sjgea9bM1A==',key_name='tempest-keypair-2063282615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='195f27dc9cac4e53b96830a5f5168711',ramdisk_id='',reservation_id='r-97j3f17v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2120010551',owner_user_name='tempest-TaggedBootDevicesTest-2120010551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:34:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcfae116c60144ef84c15680f8936de3',uuid=5127f26d-e912-49a4-b8ae-6157f0055270,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c652fd6e-0d41-4593-8d73-893962490f30", "address": "fa:16:3e:45:ca:0a", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652fd6e-0d", "ovs_interfaceid": "c652fd6e-0d41-4593-8d73-893962490f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converting VIF {"id": "c652fd6e-0d41-4593-8d73-893962490f30", "address": "fa:16:3e:45:ca:0a", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652fd6e-0d", "ovs_interfaceid": "c652fd6e-0d41-4593-8d73-893962490f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:ca:0a,bridge_name='br-int',has_traffic_filtering=True,id=c652fd6e-0d41-4593-8d73-893962490f30,network=Network(fc93cbb9-0614-404f-bbdf-ea3ae231e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc652fd6e-0d') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:34:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-193231798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-193231798',id=10,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnjgLufIx9AcHRLY1+xFOFrurx8FQrjKmAFitYyIVkA0E/XFblcb7deXyn7s807fFsDqkhMPJXSw7WsvI3EyPFy9AaTFOnoPnOc9y58HRuKN2BV9abvk9+1sjgea9bM1A==',key_name='tempest-keypair-2063282615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='195f27dc9cac4e53b96830a5f5168711',ramdisk_id='',reservation_id='r-97j3f17v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2120010551',owner_user_name='tempest-TaggedBootDevicesTest-2120010551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:34:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcfae116c60144ef84c15680f8936de3',uuid=5127f26d-e912-49a4-b8ae-6157f0055270,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e106a9dd-3d36-4bea-953b-fe65ba4747a5", "address": "fa:16:3e:6a:51:5c", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106a9dd-3d", "ovs_interfaceid": "e106a9dd-3d36-4bea-953b-fe65ba4747a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converting VIF {"id": "e106a9dd-3d36-4bea-953b-fe65ba4747a5", "address": "fa:16:3e:6a:51:5c", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106a9dd-3d", "ovs_interfaceid": "e106a9dd-3d36-4bea-953b-fe65ba4747a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:51:5c,bridge_name='br-int',has_traffic_filtering=True,id=e106a9dd-3d36-4bea-953b-fe65ba4747a5,network=Network(fc93cbb9-0614-404f-bbdf-ea3ae231e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape106a9dd-3d') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:34:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-193231798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-193231798',id=10,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnjgLufIx9AcHRLY1+xFOFrurx8FQrjKmAFitYyIVkA0E/XFblcb7deXyn7s807fFsDqkhMPJXSw7WsvI3EyPFy9AaTFOnoPnOc9y58HRuKN2BV9abvk9+1sjgea9bM1A==',key_name='tempest-keypair-2063282615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='195f27dc9cac4e53b96830a5f5168711',ramdisk_id='',reservation_id='r-97j3f17v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2120010551',owner_user_name='tempest-TaggedBootDevicesTest-2120010551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:34:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcfae116c60144ef84c15680f8936de3',uuid=5127f26d-e912-49a4-b8ae-6157f0055270,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28d91bef-df2e-469a-b449-10e27e352ee8", "address": "fa:16:3e:d4:e9:c0", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d91bef-df", "ovs_interfaceid": "28d91bef-df2e-469a-b449-10e27e352ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converting VIF {"id": "28d91bef-df2e-469a-b449-10e27e352ee8", "address": "fa:16:3e:d4:e9:c0", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d91bef-df", "ovs_interfaceid": "28d91bef-df2e-469a-b449-10e27e352ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:e9:c0,bridge_name='br-int',has_traffic_filtering=True,id=28d91bef-df2e-469a-b449-10e27e352ee8,network=Network(fc93cbb9-0614-404f-bbdf-ea3ae231e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28d91bef-df') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:34:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-193231798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-193231798',id=10,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnjgLufIx9AcHRLY1+xFOFrurx8FQrjKmAFitYyIVkA0E/XFblcb7deXyn7s807fFsDqkhMPJXSw7WsvI3EyPFy9AaTFOnoPnOc9y58HRuKN2BV9abvk9+1sjgea9bM1A==',key_name='tempest-keypair-2063282615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='195f27dc9cac4e53b96830a5f5168711',ramdisk_id='',reservation_id='r-97j3f17v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2120010551',owner_user_name='tempest-TaggedBootDevicesTest-2120010551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:34:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcfae116c60144ef84c15680f8936de3',uuid=5127f26d-e912-49a4-b8ae-6157f0055270,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a1e3eda-8abb-49ca-a495-aa7f584a9252", "address": "fa:16:3e:30:08:c1", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1e3eda-8a", "ovs_interfaceid": "7a1e3eda-8abb-49ca-a495-aa7f584a9252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converting VIF {"id": "7a1e3eda-8abb-49ca-a495-aa7f584a9252", "address": "fa:16:3e:30:08:c1", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1e3eda-8a", "ovs_interfaceid": "7a1e3eda-8abb-49ca-a495-aa7f584a9252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:08:c1,bridge_name='br-int',has_traffic_filtering=True,id=7a1e3eda-8abb-49ca-a495-aa7f584a9252,network=Network(fc93cbb9-0614-404f-bbdf-ea3ae231e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a1e3eda-8a') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:34:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-193231798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-193231798',id=10,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnjgLufIx9AcHRLY1+xFOFrurx8FQrjKmAFitYyIVkA0E/XFblcb7deXyn7s807fFsDqkhMPJXSw7WsvI3EyPFy9AaTFOnoPnOc9y58HRuKN2BV9abvk9+1sjgea9bM1A==',key_name='tempest-keypair-2063282615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='195f27dc9cac4e53b96830a5f5168711',ramdisk_id='',reservation_id='r-97j3f17v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2120010551',owner_user_name='tempest-TaggedBootDevicesTest-2120010551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:34:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcfae116c60144ef84c15680f8936de3',uuid=5127f26d-e912-49a4-b8ae-6157f0055270,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0dd83ad9-c54b-4c90-981a-8982501e36cf", "address": "fa:16:3e:cb:c0:08", "network": {"id": "70108ad7-d95b-4b71-a4b1-d6750a3d30cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-155167949", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dd83ad9-c5", "ovs_interfaceid": "0dd83ad9-c54b-4c90-981a-8982501e36cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converting VIF {"id": "0dd83ad9-c54b-4c90-981a-8982501e36cf", "address": "fa:16:3e:cb:c0:08", "network": {"id": "70108ad7-d95b-4b71-a4b1-d6750a3d30cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-155167949", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dd83ad9-c5", "ovs_interfaceid": "0dd83ad9-c54b-4c90-981a-8982501e36cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:c0:08,bridge_name='br-int',has_traffic_filtering=True,id=0dd83ad9-c54b-4c90-981a-8982501e36cf,network=Network(70108ad7-d95b-4b71-a4b1-d6750a3d30cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dd83ad9-c5') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:34:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-193231798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-193231798',id=10,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnjgLufIx9AcHRLY1+xFOFrurx8FQrjKmAFitYyIVkA0E/XFblcb7deXyn7s807fFsDqkhMPJXSw7WsvI3EyPFy9AaTFOnoPnOc9y58HRuKN2BV9abvk9+1sjgea9bM1A==',key_name='tempest-keypair-2063282615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='195f27dc9cac4e53b96830a5f5168711',ramdisk_id='',reservation_id='r-97j3f17v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2120010551',owner_user_name='tempest-TaggedBootDevicesTest-2120010551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:34:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcfae116c60144ef84c15680f8936de3',uuid=5127f26d-e912-49a4-b8ae-6157f0055270,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "713bc8f5-df03-42c3-8250-ff7ed4e07f4e", "address": "fa:16:3e:22:fe:88", "network": {"id": "70108ad7-d95b-4b71-a4b1-d6750a3d30cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-155167949", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap713bc8f5-df", "ovs_interfaceid": "713bc8f5-df03-42c3-8250-ff7ed4e07f4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converting VIF {"id": "713bc8f5-df03-42c3-8250-ff7ed4e07f4e", "address": "fa:16:3e:22:fe:88", "network": {"id": "70108ad7-d95b-4b71-a4b1-d6750a3d30cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-155167949", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap713bc8f5-df", "ovs_interfaceid": "713bc8f5-df03-42c3-8250-ff7ed4e07f4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:fe:88,bridge_name='br-int',has_traffic_filtering=True,id=713bc8f5-df03-42c3-8250-ff7ed4e07f4e,network=Network(70108ad7-d95b-4b71-a4b1-d6750a3d30cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap713bc8f5-df') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.objects.instance [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Lazy-loading 'pci_devices' on Instance uuid 5127f26d-e912-49a4-b8ae-6157f0055270 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:34:59 user nova-compute[231753]:   <uuid>5127f26d-e912-49a4-b8ae-6157f0055270</uuid>
Jul 29 13:34:59 user nova-compute[231753]:   <name>instance-0000000a</name>
Jul 29 13:34:59 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:34:59 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:34:59 user nova-compute[231753]:   <metadata>
Jul 29 13:34:59 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:34:59 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:34:59 user nova-compute[231753]:       <nova:name>tempest-device-tagging-server-193231798</nova:name>
Jul 29 13:34:59 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:34:55</nova:creationTime>
Jul 29 13:34:59 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:34:59 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:34:59 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:34:59 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:34:59 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:34:59 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:34:59 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:34:59 user nova-compute[231753]:       <nova:owner>
Jul 29 13:34:59 user nova-compute[231753]:         <nova:user uuid="dcfae116c60144ef84c15680f8936de3">tempest-TaggedBootDevicesTest-2120010551-project-member</nova:user>
Jul 29 13:34:59 user nova-compute[231753]:         <nova:project uuid="195f27dc9cac4e53b96830a5f5168711">tempest-TaggedBootDevicesTest-2120010551</nova:project>
Jul 29 13:34:59 user nova-compute[231753]:       </nova:owner>
Jul 29 13:34:59 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:34:59 user nova-compute[231753]:       <nova:ports>
Jul 29 13:34:59 user nova-compute[231753]:         <nova:port uuid="f6babf7d-a012-411a-a2cc-134c92ac26d8">
Jul 29 13:34:59 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 29 13:34:59 user nova-compute[231753]:         </nova:port>
Jul 29 13:34:59 user nova-compute[231753]:         <nova:port uuid="c652fd6e-0d41-4593-8d73-893962490f30">
Jul 29 13:34:59 user nova-compute[231753]:           <nova:ip type="fixed" address="10.1.1.117" ipVersion="4"/>
Jul 29 13:34:59 user nova-compute[231753]:         </nova:port>
Jul 29 13:34:59 user nova-compute[231753]:         <nova:port uuid="e106a9dd-3d36-4bea-953b-fe65ba4747a5">
Jul 29 13:34:59 user nova-compute[231753]:           <nova:ip type="fixed" address="10.1.1.60" ipVersion="4"/>
Jul 29 13:34:59 user nova-compute[231753]:         </nova:port>
Jul 29 13:34:59 user nova-compute[231753]:         <nova:port uuid="28d91bef-df2e-469a-b449-10e27e352ee8">
Jul 29 13:34:59 user nova-compute[231753]:           <nova:ip type="fixed" address="10.1.1.59" ipVersion="4"/>
Jul 29 13:34:59 user nova-compute[231753]:         </nova:port>
Jul 29 13:34:59 user nova-compute[231753]:         <nova:port uuid="7a1e3eda-8abb-49ca-a495-aa7f584a9252">
Jul 29 13:34:59 user nova-compute[231753]:           <nova:ip type="fixed" address="10.1.1.223" ipVersion="4"/>
Jul 29 13:34:59 user nova-compute[231753]:         </nova:port>
Jul 29 13:34:59 user nova-compute[231753]:         <nova:port uuid="0dd83ad9-c54b-4c90-981a-8982501e36cf">
Jul 29 13:34:59 user nova-compute[231753]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 29 13:34:59 user nova-compute[231753]:         </nova:port>
Jul 29 13:34:59 user nova-compute[231753]:         <nova:port uuid="713bc8f5-df03-42c3-8250-ff7ed4e07f4e">
Jul 29 13:34:59 user nova-compute[231753]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 29 13:34:59 user nova-compute[231753]:         </nova:port>
Jul 29 13:34:59 user nova-compute[231753]:       </nova:ports>
Jul 29 13:34:59 user nova-compute[231753]:     </nova:instance>
Jul 29 13:34:59 user nova-compute[231753]:   </metadata>
Jul 29 13:34:59 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:34:59 user nova-compute[231753]:     <system>
Jul 29 13:34:59 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:34:59 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:34:59 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:34:59 user nova-compute[231753]:       <entry name="serial">5127f26d-e912-49a4-b8ae-6157f0055270</entry>
Jul 29 13:34:59 user nova-compute[231753]:       <entry name="uuid">5127f26d-e912-49a4-b8ae-6157f0055270</entry>
Jul 29 13:34:59 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:34:59 user nova-compute[231753]:     </system>
Jul 29 13:34:59 user nova-compute[231753]:   </sysinfo>
Jul 29 13:34:59 user nova-compute[231753]:   <os>
Jul 29 13:34:59 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:34:59 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:34:59 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:34:59 user nova-compute[231753]:   </os>
Jul 29 13:34:59 user nova-compute[231753]:   <features>
Jul 29 13:34:59 user nova-compute[231753]:     <acpi/>
Jul 29 13:34:59 user nova-compute[231753]:     <apic/>
Jul 29 13:34:59 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:34:59 user nova-compute[231753]:   </features>
Jul 29 13:34:59 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:34:59 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:34:59 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:34:59 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:34:59 user nova-compute[231753]:   </clock>
Jul 29 13:34:59 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:34:59 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:34:59 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:34:59 user nova-compute[231753]:   </cpu>
Jul 29 13:34:59 user nova-compute[231753]:   <devices>
Jul 29 13:34:59 user nova-compute[231753]:     <disk type="file" device="cdrom">
Jul 29 13:34:59 user nova-compute[231753]:       <driver name="qemu" type="raw" cache="none"/>
Jul 29 13:34:59 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/5127f26d-e912-49a4-b8ae-6157f0055270/disk.config"/>
Jul 29 13:34:59 user nova-compute[231753]:       <target dev="hda" bus="ide"/>
Jul 29 13:34:59 user nova-compute[231753]:     </disk>
Jul 29 13:34:59 user nova-compute[231753]:     <disk type="block" device="disk">
Jul 29 13:34:59 user nova-compute[231753]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:34:59 user nova-compute[231753]:       <source dev="/dev/sdb"/>
Jul 29 13:34:59 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:34:59 user nova-compute[231753]:       <serial>f3eaf40c-503b-4301-b848-a237cbc8d6cf</serial>
Jul 29 13:34:59 user nova-compute[231753]:     </disk>
Jul 29 13:34:59 user nova-compute[231753]:     <disk type="block" device="disk">
Jul 29 13:34:59 user nova-compute[231753]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:34:59 user nova-compute[231753]:       <source dev="/dev/sdc"/>
Jul 29 13:34:59 user nova-compute[231753]:       <target dev="vdb" bus="virtio"/>
Jul 29 13:34:59 user nova-compute[231753]:       <serial>55023ac1-9e61-4b60-afc0-f6961380cd9c</serial>
Jul 29 13:34:59 user nova-compute[231753]:     </disk>
Jul 29 13:34:59 user nova-compute[231753]:     <disk type="block" device="disk">
Jul 29 13:34:59 user nova-compute[231753]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:34:59 user nova-compute[231753]:       <source dev="/dev/sdd"/>
Jul 29 13:34:59 user nova-compute[231753]:       <target dev="vdc" bus="virtio"/>
Jul 29 13:34:59 user nova-compute[231753]:       <serial>d53c30b5-db6e-4df2-a6cc-598971557008</serial>
Jul 29 13:34:59 user nova-compute[231753]:     </disk>
Jul 29 13:34:59 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:34:59 user nova-compute[231753]:       <mac address="fa:16:3e:0f:55:20"/>
Jul 29 13:34:59 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:34:59 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:34:59 user nova-compute[231753]:       <target dev="tapf6babf7d-a0"/>
Jul 29 13:34:59 user nova-compute[231753]:     </interface>
Jul 29 13:34:59 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:34:59 user nova-compute[231753]:       <mac address="fa:16:3e:45:ca:0a"/>
Jul 29 13:34:59 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:34:59 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:34:59 user nova-compute[231753]:       <target dev="tapc652fd6e-0d"/>
Jul 29 13:34:59 user nova-compute[231753]:     </interface>
Jul 29 13:34:59 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:34:59 user nova-compute[231753]:       <mac address="fa:16:3e:6a:51:5c"/>
Jul 29 13:34:59 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:34:59 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:34:59 user nova-compute[231753]:       <target dev="tape106a9dd-3d"/>
Jul 29 13:34:59 user nova-compute[231753]:     </interface>
Jul 29 13:34:59 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:34:59 user nova-compute[231753]:       <mac address="fa:16:3e:d4:e9:c0"/>
Jul 29 13:34:59 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:34:59 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:34:59 user nova-compute[231753]:       <target dev="tap28d91bef-df"/>
Jul 29 13:34:59 user nova-compute[231753]:     </interface>
Jul 29 13:34:59 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:34:59 user nova-compute[231753]:       <mac address="fa:16:3e:30:08:c1"/>
Jul 29 13:34:59 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:34:59 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:34:59 user nova-compute[231753]:       <target dev="tap7a1e3eda-8a"/>
Jul 29 13:34:59 user nova-compute[231753]:     </interface>
Jul 29 13:34:59 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:34:59 user nova-compute[231753]:       <mac address="fa:16:3e:cb:c0:08"/>
Jul 29 13:34:59 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:34:59 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:34:59 user nova-compute[231753]:       <target dev="tap0dd83ad9-c5"/>
Jul 29 13:34:59 user nova-compute[231753]:     </interface>
Jul 29 13:34:59 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:34:59 user nova-compute[231753]:       <mac address="fa:16:3e:22:fe:88"/>
Jul 29 13:34:59 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:34:59 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:34:59 user nova-compute[231753]:       <target dev="tap713bc8f5-df"/>
Jul 29 13:34:59 user nova-compute[231753]:     </interface>
Jul 29 13:34:59 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:34:59 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/5127f26d-e912-49a4-b8ae-6157f0055270/console.log" append="off"/>
Jul 29 13:34:59 user nova-compute[231753]:     </serial>
Jul 29 13:34:59 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:34:59 user nova-compute[231753]:     <video>
Jul 29 13:34:59 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:34:59 user nova-compute[231753]:     </video>
Jul 29 13:34:59 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:34:59 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:34:59 user nova-compute[231753]:     </rng>
Jul 29 13:34:59 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:34:59 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:34:59 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:34:59 user nova-compute[231753]:     </memballoon>
Jul 29 13:34:59 user nova-compute[231753]:   </devices>
Jul 29 13:34:59 user nova-compute[231753]: </domain>
Jul 29 13:34:59 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:34:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-193231798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-193231798',id=10,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnjgLufIx9AcHRLY1+xFOFrurx8FQrjKmAFitYyIVkA0E/XFblcb7deXyn7s807fFsDqkhMPJXSw7WsvI3EyPFy9AaTFOnoPnOc9y58HRuKN2BV9abvk9+1sjgea9bM1A==',key_name='tempest-keypair-2063282615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='195f27dc9cac4e53b96830a5f5168711',ramdisk_id='',reservation_id='r-97j3f17v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2120010551',owner_user_name='tempest-TaggedBootDevicesTest-2120010551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:34:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcfae116c60144ef84c15680f8936de3',uuid=5127f26d-e912-49a4-b8ae-6157f0055270,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f6babf7d-a012-411a-a2cc-134c92ac26d8", "address": "fa:16:3e:0f:55:20", "network": {"id": "506f7783-e44a-4de3-8c0d-aa1177c2eef6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-998637392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6babf7d-a0", "ovs_interfaceid": "f6babf7d-a012-411a-a2cc-134c92ac26d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converting VIF {"id": "f6babf7d-a012-411a-a2cc-134c92ac26d8", "address": "fa:16:3e:0f:55:20", "network": {"id": "506f7783-e44a-4de3-8c0d-aa1177c2eef6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-998637392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6babf7d-a0", "ovs_interfaceid": "f6babf7d-a012-411a-a2cc-134c92ac26d8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0f:55:20,bridge_name='br-int',has_traffic_filtering=True,id=f6babf7d-a012-411a-a2cc-134c92ac26d8,network=Network(506f7783-e44a-4de3-8c0d-aa1177c2eef6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6babf7d-a0') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG os_vif [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:55:20,bridge_name='br-int',has_traffic_filtering=True,id=f6babf7d-a012-411a-a2cc-134c92ac26d8,network=Network(506f7783-e44a-4de3-8c0d-aa1177c2eef6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6babf7d-a0') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf6babf7d-a0, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf6babf7d-a0, col_values=(('external_ids', {'iface-id': 'f6babf7d-a012-411a-a2cc-134c92ac26d8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0f:55:20', 'vm-uuid': '5127f26d-e912-49a4-b8ae-6157f0055270'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:59 user nova-compute[231753]: INFO os_vif [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0f:55:20,bridge_name='br-int',has_traffic_filtering=True,id=f6babf7d-a012-411a-a2cc-134c92ac26d8,network=Network(506f7783-e44a-4de3-8c0d-aa1177c2eef6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6babf7d-a0')
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:34:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-193231798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-193231798',id=10,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnjgLufIx9AcHRLY1+xFOFrurx8FQrjKmAFitYyIVkA0E/XFblcb7deXyn7s807fFsDqkhMPJXSw7WsvI3EyPFy9AaTFOnoPnOc9y58HRuKN2BV9abvk9+1sjgea9bM1A==',key_name='tempest-keypair-2063282615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='195f27dc9cac4e53b96830a5f5168711',ramdisk_id='',reservation_id='r-97j3f17v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2120010551',owner_user_name='tempest-TaggedBootDevicesTest-2120010551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:34:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcfae116c60144ef84c15680f8936de3',uuid=5127f26d-e912-49a4-b8ae-6157f0055270,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c652fd6e-0d41-4593-8d73-893962490f30", "address": "fa:16:3e:45:ca:0a", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652fd6e-0d", "ovs_interfaceid": "c652fd6e-0d41-4593-8d73-893962490f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converting VIF {"id": "c652fd6e-0d41-4593-8d73-893962490f30", "address": "fa:16:3e:45:ca:0a", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652fd6e-0d", "ovs_interfaceid": "c652fd6e-0d41-4593-8d73-893962490f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:ca:0a,bridge_name='br-int',has_traffic_filtering=True,id=c652fd6e-0d41-4593-8d73-893962490f30,network=Network(fc93cbb9-0614-404f-bbdf-ea3ae231e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc652fd6e-0d') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG os_vif [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:ca:0a,bridge_name='br-int',has_traffic_filtering=True,id=c652fd6e-0d41-4593-8d73-893962490f30,network=Network(fc93cbb9-0614-404f-bbdf-ea3ae231e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc652fd6e-0d') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc652fd6e-0d, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc652fd6e-0d, col_values=(('external_ids', {'iface-id': 'c652fd6e-0d41-4593-8d73-893962490f30', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:45:ca:0a', 'vm-uuid': '5127f26d-e912-49a4-b8ae-6157f0055270'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:59 user nova-compute[231753]: INFO os_vif [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:ca:0a,bridge_name='br-int',has_traffic_filtering=True,id=c652fd6e-0d41-4593-8d73-893962490f30,network=Network(fc93cbb9-0614-404f-bbdf-ea3ae231e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc652fd6e-0d')
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:34:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-193231798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-193231798',id=10,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnjgLufIx9AcHRLY1+xFOFrurx8FQrjKmAFitYyIVkA0E/XFblcb7deXyn7s807fFsDqkhMPJXSw7WsvI3EyPFy9AaTFOnoPnOc9y58HRuKN2BV9abvk9+1sjgea9bM1A==',key_name='tempest-keypair-2063282615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='195f27dc9cac4e53b96830a5f5168711',ramdisk_id='',reservation_id='r-97j3f17v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2120010551',owner_user_name='tempest-TaggedBootDevicesTest-2120010551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:34:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcfae116c60144ef84c15680f8936de3',uuid=5127f26d-e912-49a4-b8ae-6157f0055270,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e106a9dd-3d36-4bea-953b-fe65ba4747a5", "address": "fa:16:3e:6a:51:5c", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106a9dd-3d", "ovs_interfaceid": "e106a9dd-3d36-4bea-953b-fe65ba4747a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converting VIF {"id": "e106a9dd-3d36-4bea-953b-fe65ba4747a5", "address": "fa:16:3e:6a:51:5c", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106a9dd-3d", "ovs_interfaceid": "e106a9dd-3d36-4bea-953b-fe65ba4747a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:51:5c,bridge_name='br-int',has_traffic_filtering=True,id=e106a9dd-3d36-4bea-953b-fe65ba4747a5,network=Network(fc93cbb9-0614-404f-bbdf-ea3ae231e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape106a9dd-3d') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG os_vif [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:51:5c,bridge_name='br-int',has_traffic_filtering=True,id=e106a9dd-3d36-4bea-953b-fe65ba4747a5,network=Network(fc93cbb9-0614-404f-bbdf-ea3ae231e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape106a9dd-3d') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape106a9dd-3d, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape106a9dd-3d, col_values=(('external_ids', {'iface-id': 'e106a9dd-3d36-4bea-953b-fe65ba4747a5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:51:5c', 'vm-uuid': '5127f26d-e912-49a4-b8ae-6157f0055270'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:59 user nova-compute[231753]: INFO os_vif [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:51:5c,bridge_name='br-int',has_traffic_filtering=True,id=e106a9dd-3d36-4bea-953b-fe65ba4747a5,network=Network(fc93cbb9-0614-404f-bbdf-ea3ae231e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape106a9dd-3d')
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:34:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-193231798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-193231798',id=10,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnjgLufIx9AcHRLY1+xFOFrurx8FQrjKmAFitYyIVkA0E/XFblcb7deXyn7s807fFsDqkhMPJXSw7WsvI3EyPFy9AaTFOnoPnOc9y58HRuKN2BV9abvk9+1sjgea9bM1A==',key_name='tempest-keypair-2063282615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='195f27dc9cac4e53b96830a5f5168711',ramdisk_id='',reservation_id='r-97j3f17v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2120010551',owner_user_name='tempest-TaggedBootDevicesTest-2120010551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:34:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcfae116c60144ef84c15680f8936de3',uuid=5127f26d-e912-49a4-b8ae-6157f0055270,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "28d91bef-df2e-469a-b449-10e27e352ee8", "address": "fa:16:3e:d4:e9:c0", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d91bef-df", "ovs_interfaceid": "28d91bef-df2e-469a-b449-10e27e352ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converting VIF {"id": "28d91bef-df2e-469a-b449-10e27e352ee8", "address": "fa:16:3e:d4:e9:c0", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d91bef-df", "ovs_interfaceid": "28d91bef-df2e-469a-b449-10e27e352ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:e9:c0,bridge_name='br-int',has_traffic_filtering=True,id=28d91bef-df2e-469a-b449-10e27e352ee8,network=Network(fc93cbb9-0614-404f-bbdf-ea3ae231e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28d91bef-df') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG os_vif [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:e9:c0,bridge_name='br-int',has_traffic_filtering=True,id=28d91bef-df2e-469a-b449-10e27e352ee8,network=Network(fc93cbb9-0614-404f-bbdf-ea3ae231e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28d91bef-df') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap28d91bef-df, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap28d91bef-df, col_values=(('external_ids', {'iface-id': '28d91bef-df2e-469a-b449-10e27e352ee8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:d4:e9:c0', 'vm-uuid': '5127f26d-e912-49a4-b8ae-6157f0055270'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:59 user nova-compute[231753]: INFO os_vif [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:e9:c0,bridge_name='br-int',has_traffic_filtering=True,id=28d91bef-df2e-469a-b449-10e27e352ee8,network=Network(fc93cbb9-0614-404f-bbdf-ea3ae231e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28d91bef-df')
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:34:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-193231798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-193231798',id=10,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnjgLufIx9AcHRLY1+xFOFrurx8FQrjKmAFitYyIVkA0E/XFblcb7deXyn7s807fFsDqkhMPJXSw7WsvI3EyPFy9AaTFOnoPnOc9y58HRuKN2BV9abvk9+1sjgea9bM1A==',key_name='tempest-keypair-2063282615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='195f27dc9cac4e53b96830a5f5168711',ramdisk_id='',reservation_id='r-97j3f17v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2120010551',owner_user_name='tempest-TaggedBootDevicesTest-2120010551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:34:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcfae116c60144ef84c15680f8936de3',uuid=5127f26d-e912-49a4-b8ae-6157f0055270,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7a1e3eda-8abb-49ca-a495-aa7f584a9252", "address": "fa:16:3e:30:08:c1", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1e3eda-8a", "ovs_interfaceid": "7a1e3eda-8abb-49ca-a495-aa7f584a9252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converting VIF {"id": "7a1e3eda-8abb-49ca-a495-aa7f584a9252", "address": "fa:16:3e:30:08:c1", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1e3eda-8a", "ovs_interfaceid": "7a1e3eda-8abb-49ca-a495-aa7f584a9252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:08:c1,bridge_name='br-int',has_traffic_filtering=True,id=7a1e3eda-8abb-49ca-a495-aa7f584a9252,network=Network(fc93cbb9-0614-404f-bbdf-ea3ae231e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a1e3eda-8a') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG os_vif [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:08:c1,bridge_name='br-int',has_traffic_filtering=True,id=7a1e3eda-8abb-49ca-a495-aa7f584a9252,network=Network(fc93cbb9-0614-404f-bbdf-ea3ae231e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a1e3eda-8a') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7a1e3eda-8a, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7a1e3eda-8a, col_values=(('external_ids', {'iface-id': '7a1e3eda-8abb-49ca-a495-aa7f584a9252', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:08:c1', 'vm-uuid': '5127f26d-e912-49a4-b8ae-6157f0055270'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:59 user nova-compute[231753]: INFO os_vif [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:08:c1,bridge_name='br-int',has_traffic_filtering=True,id=7a1e3eda-8abb-49ca-a495-aa7f584a9252,network=Network(fc93cbb9-0614-404f-bbdf-ea3ae231e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a1e3eda-8a')
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:34:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-193231798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-193231798',id=10,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnjgLufIx9AcHRLY1+xFOFrurx8FQrjKmAFitYyIVkA0E/XFblcb7deXyn7s807fFsDqkhMPJXSw7WsvI3EyPFy9AaTFOnoPnOc9y58HRuKN2BV9abvk9+1sjgea9bM1A==',key_name='tempest-keypair-2063282615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='195f27dc9cac4e53b96830a5f5168711',ramdisk_id='',reservation_id='r-97j3f17v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2120010551',owner_user_name='tempest-TaggedBootDevicesTest-2120010551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:34:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcfae116c60144ef84c15680f8936de3',uuid=5127f26d-e912-49a4-b8ae-6157f0055270,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0dd83ad9-c54b-4c90-981a-8982501e36cf", "address": "fa:16:3e:cb:c0:08", "network": {"id": "70108ad7-d95b-4b71-a4b1-d6750a3d30cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-155167949", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dd83ad9-c5", "ovs_interfaceid": "0dd83ad9-c54b-4c90-981a-8982501e36cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converting VIF {"id": "0dd83ad9-c54b-4c90-981a-8982501e36cf", "address": "fa:16:3e:cb:c0:08", "network": {"id": "70108ad7-d95b-4b71-a4b1-d6750a3d30cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-155167949", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dd83ad9-c5", "ovs_interfaceid": "0dd83ad9-c54b-4c90-981a-8982501e36cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:c0:08,bridge_name='br-int',has_traffic_filtering=True,id=0dd83ad9-c54b-4c90-981a-8982501e36cf,network=Network(70108ad7-d95b-4b71-a4b1-d6750a3d30cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dd83ad9-c5') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG os_vif [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:c0:08,bridge_name='br-int',has_traffic_filtering=True,id=0dd83ad9-c54b-4c90-981a-8982501e36cf,network=Network(70108ad7-d95b-4b71-a4b1-d6750a3d30cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dd83ad9-c5') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0dd83ad9-c5, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap0dd83ad9-c5, col_values=(('external_ids', {'iface-id': '0dd83ad9-c54b-4c90-981a-8982501e36cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:c0:08', 'vm-uuid': '5127f26d-e912-49a4-b8ae-6157f0055270'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:59 user nova-compute[231753]: INFO os_vif [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:c0:08,bridge_name='br-int',has_traffic_filtering=True,id=0dd83ad9-c54b-4c90-981a-8982501e36cf,network=Network(70108ad7-d95b-4b71-a4b1-d6750a3d30cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dd83ad9-c5')
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:34:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-193231798',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-193231798',id=10,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnjgLufIx9AcHRLY1+xFOFrurx8FQrjKmAFitYyIVkA0E/XFblcb7deXyn7s807fFsDqkhMPJXSw7WsvI3EyPFy9AaTFOnoPnOc9y58HRuKN2BV9abvk9+1sjgea9bM1A==',key_name='tempest-keypair-2063282615',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='195f27dc9cac4e53b96830a5f5168711',ramdisk_id='',reservation_id='r-97j3f17v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-2120010551',owner_user_name='tempest-TaggedBootDevicesTest-2120010551-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:34:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcfae116c60144ef84c15680f8936de3',uuid=5127f26d-e912-49a4-b8ae-6157f0055270,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "713bc8f5-df03-42c3-8250-ff7ed4e07f4e", "address": "fa:16:3e:22:fe:88", "network": {"id": "70108ad7-d95b-4b71-a4b1-d6750a3d30cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-155167949", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap713bc8f5-df", "ovs_interfaceid": "713bc8f5-df03-42c3-8250-ff7ed4e07f4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converting VIF {"id": "713bc8f5-df03-42c3-8250-ff7ed4e07f4e", "address": "fa:16:3e:22:fe:88", "network": {"id": "70108ad7-d95b-4b71-a4b1-d6750a3d30cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-155167949", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap713bc8f5-df", "ovs_interfaceid": "713bc8f5-df03-42c3-8250-ff7ed4e07f4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:fe:88,bridge_name='br-int',has_traffic_filtering=True,id=713bc8f5-df03-42c3-8250-ff7ed4e07f4e,network=Network(70108ad7-d95b-4b71-a4b1-d6750a3d30cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap713bc8f5-df') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG os_vif [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:fe:88,bridge_name='br-int',has_traffic_filtering=True,id=713bc8f5-df03-42c3-8250-ff7ed4e07f4e,network=Network(70108ad7-d95b-4b71-a4b1-d6750a3d30cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap713bc8f5-df') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap713bc8f5-df, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap713bc8f5-df, col_values=(('external_ids', {'iface-id': '713bc8f5-df03-42c3-8250-ff7ed4e07f4e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:22:fe:88', 'vm-uuid': '5127f26d-e912-49a4-b8ae-6157f0055270'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:34:59 user nova-compute[231753]: INFO os_vif [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:fe:88,bridge_name='br-int',has_traffic_filtering=True,id=713bc8f5-df03-42c3-8250-ff7ed4e07f4e,network=Network(70108ad7-d95b-4b71-a4b1-d6750a3d30cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap713bc8f5-df')
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] No BDM found with device name hda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] No BDM found with device name vdc, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] No VIF found with MAC fa:16:3e:0f:55:20, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:34:59 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] No VIF found with MAC fa:16:3e:30:08:c1, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:34:59 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Using config drive
Jul 29 13:34:59 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Creating config drive at /opt/stack/data/nova/instances/5127f26d-e912-49a4-b8ae-6157f0055270/disk.config
Jul 29 13:35:00 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5127f26d-e912-49a4-b8ae-6157f0055270/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmplqy3hkfb {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:00 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5127f26d-e912-49a4-b8ae-6157f0055270/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmplqy3hkfb" returned: 0 in 0.063s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:01 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:01 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:01 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:01 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:02 user nova-compute[231753]: DEBUG nova.compute.manager [req-5951ca70-1e58-4adb-9ee6-c3a3e47e1afc req-4b535919-702d-48b2-885a-6984687bcd00 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-plugged-f6babf7d-a012-411a-a2cc-134c92ac26d8 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:35:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5951ca70-1e58-4adb-9ee6-c3a3e47e1afc req-4b535919-702d-48b2-885a-6984687bcd00 service nova] Acquiring lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5951ca70-1e58-4adb-9ee6-c3a3e47e1afc req-4b535919-702d-48b2-885a-6984687bcd00 service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5951ca70-1e58-4adb-9ee6-c3a3e47e1afc req-4b535919-702d-48b2-885a-6984687bcd00 service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:02 user nova-compute[231753]: DEBUG nova.compute.manager [req-5951ca70-1e58-4adb-9ee6-c3a3e47e1afc req-4b535919-702d-48b2-885a-6984687bcd00 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] No waiting events found dispatching network-vif-plugged-f6babf7d-a012-411a-a2cc-134c92ac26d8 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:35:02 user nova-compute[231753]: WARNING nova.compute.manager [req-5951ca70-1e58-4adb-9ee6-c3a3e47e1afc req-4b535919-702d-48b2-885a-6984687bcd00 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received unexpected event network-vif-plugged-f6babf7d-a012-411a-a2cc-134c92ac26d8 for instance with vm_state building and task_state spawning.
Jul 29 13:35:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:02 user nova-compute[231753]: DEBUG nova.compute.manager [req-81053d40-ad85-4db2-9bba-d9d1dc37cb88 req-cf397a84-d090-4cc2-bd11-e94a596d0e2a service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-plugged-c652fd6e-0d41-4593-8d73-893962490f30 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:35:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-81053d40-ad85-4db2-9bba-d9d1dc37cb88 req-cf397a84-d090-4cc2-bd11-e94a596d0e2a service nova] Acquiring lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-81053d40-ad85-4db2-9bba-d9d1dc37cb88 req-cf397a84-d090-4cc2-bd11-e94a596d0e2a service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-81053d40-ad85-4db2-9bba-d9d1dc37cb88 req-cf397a84-d090-4cc2-bd11-e94a596d0e2a service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:02 user nova-compute[231753]: DEBUG nova.compute.manager [req-81053d40-ad85-4db2-9bba-d9d1dc37cb88 req-cf397a84-d090-4cc2-bd11-e94a596d0e2a service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] No waiting events found dispatching network-vif-plugged-c652fd6e-0d41-4593-8d73-893962490f30 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:35:02 user nova-compute[231753]: WARNING nova.compute.manager [req-81053d40-ad85-4db2-9bba-d9d1dc37cb88 req-cf397a84-d090-4cc2-bd11-e94a596d0e2a service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received unexpected event network-vif-plugged-c652fd6e-0d41-4593-8d73-893962490f30 for instance with vm_state building and task_state spawning.
Jul 29 13:35:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:03 user nova-compute[231753]: DEBUG nova.compute.manager [req-9fcd086b-60c2-46fa-b675-42335548f3cd req-c59e5cb1-7a60-4536-8b6a-5b57a013b65c service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-plugged-28d91bef-df2e-469a-b449-10e27e352ee8 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:35:03 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9fcd086b-60c2-46fa-b675-42335548f3cd req-c59e5cb1-7a60-4536-8b6a-5b57a013b65c service nova] Acquiring lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:03 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9fcd086b-60c2-46fa-b675-42335548f3cd req-c59e5cb1-7a60-4536-8b6a-5b57a013b65c service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:03 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9fcd086b-60c2-46fa-b675-42335548f3cd req-c59e5cb1-7a60-4536-8b6a-5b57a013b65c service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:03 user nova-compute[231753]: DEBUG nova.compute.manager [req-9fcd086b-60c2-46fa-b675-42335548f3cd req-c59e5cb1-7a60-4536-8b6a-5b57a013b65c service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] No waiting events found dispatching network-vif-plugged-28d91bef-df2e-469a-b449-10e27e352ee8 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:35:03 user nova-compute[231753]: WARNING nova.compute.manager [req-9fcd086b-60c2-46fa-b675-42335548f3cd req-c59e5cb1-7a60-4536-8b6a-5b57a013b65c service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received unexpected event network-vif-plugged-28d91bef-df2e-469a-b449-10e27e352ee8 for instance with vm_state building and task_state spawning.
Jul 29 13:35:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:04 user nova-compute[231753]: DEBUG nova.compute.manager [req-a14c8014-a6e1-44da-896b-2fb12ed748d7 req-eaa2d96c-0cec-451e-be7b-7711a16e909b service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Received event network-changed-fadc1466-5336-4230-b0f1-4fe4053f216a {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:35:04 user nova-compute[231753]: DEBUG nova.compute.manager [req-a14c8014-a6e1-44da-896b-2fb12ed748d7 req-eaa2d96c-0cec-451e-be7b-7711a16e909b service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Refreshing instance network info cache due to event network-changed-fadc1466-5336-4230-b0f1-4fe4053f216a. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:35:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a14c8014-a6e1-44da-896b-2fb12ed748d7 req-eaa2d96c-0cec-451e-be7b-7711a16e909b service nova] Acquiring lock "refresh_cache-63fad324-aac2-4d60-b4ce-a32a5736657d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:35:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a14c8014-a6e1-44da-896b-2fb12ed748d7 req-eaa2d96c-0cec-451e-be7b-7711a16e909b service nova] Acquired lock "refresh_cache-63fad324-aac2-4d60-b4ce-a32a5736657d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:35:04 user nova-compute[231753]: DEBUG nova.network.neutron [req-a14c8014-a6e1-44da-896b-2fb12ed748d7 req-eaa2d96c-0cec-451e-be7b-7711a16e909b service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Refreshing network info cache for port fadc1466-5336-4230-b0f1-4fe4053f216a {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:35:04 user nova-compute[231753]: DEBUG nova.compute.manager [req-93711ce0-ebcb-4bb9-b584-5f57e2af10c6 req-71c9cd7d-cf6d-4ae0-8437-19006fbf182d service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-plugged-c652fd6e-0d41-4593-8d73-893962490f30 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:35:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-93711ce0-ebcb-4bb9-b584-5f57e2af10c6 req-71c9cd7d-cf6d-4ae0-8437-19006fbf182d service nova] Acquiring lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-93711ce0-ebcb-4bb9-b584-5f57e2af10c6 req-71c9cd7d-cf6d-4ae0-8437-19006fbf182d service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-93711ce0-ebcb-4bb9-b584-5f57e2af10c6 req-71c9cd7d-cf6d-4ae0-8437-19006fbf182d service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:04 user nova-compute[231753]: DEBUG nova.compute.manager [req-93711ce0-ebcb-4bb9-b584-5f57e2af10c6 req-71c9cd7d-cf6d-4ae0-8437-19006fbf182d service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] No waiting events found dispatching network-vif-plugged-c652fd6e-0d41-4593-8d73-893962490f30 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:35:04 user nova-compute[231753]: WARNING nova.compute.manager [req-93711ce0-ebcb-4bb9-b584-5f57e2af10c6 req-71c9cd7d-cf6d-4ae0-8437-19006fbf182d service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received unexpected event network-vif-plugged-c652fd6e-0d41-4593-8d73-893962490f30 for instance with vm_state building and task_state spawning.
Jul 29 13:35:04 user nova-compute[231753]: DEBUG nova.compute.manager [req-93711ce0-ebcb-4bb9-b584-5f57e2af10c6 req-71c9cd7d-cf6d-4ae0-8437-19006fbf182d service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-plugged-e106a9dd-3d36-4bea-953b-fe65ba4747a5 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:35:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-93711ce0-ebcb-4bb9-b584-5f57e2af10c6 req-71c9cd7d-cf6d-4ae0-8437-19006fbf182d service nova] Acquiring lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-93711ce0-ebcb-4bb9-b584-5f57e2af10c6 req-71c9cd7d-cf6d-4ae0-8437-19006fbf182d service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-93711ce0-ebcb-4bb9-b584-5f57e2af10c6 req-71c9cd7d-cf6d-4ae0-8437-19006fbf182d service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:04 user nova-compute[231753]: DEBUG nova.compute.manager [req-93711ce0-ebcb-4bb9-b584-5f57e2af10c6 req-71c9cd7d-cf6d-4ae0-8437-19006fbf182d service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] No waiting events found dispatching network-vif-plugged-e106a9dd-3d36-4bea-953b-fe65ba4747a5 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:35:04 user nova-compute[231753]: WARNING nova.compute.manager [req-93711ce0-ebcb-4bb9-b584-5f57e2af10c6 req-71c9cd7d-cf6d-4ae0-8437-19006fbf182d service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received unexpected event network-vif-plugged-e106a9dd-3d36-4bea-953b-fe65ba4747a5 for instance with vm_state building and task_state spawning.
Jul 29 13:35:04 user nova-compute[231753]: DEBUG nova.compute.manager [req-93711ce0-ebcb-4bb9-b584-5f57e2af10c6 req-71c9cd7d-cf6d-4ae0-8437-19006fbf182d service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-plugged-e106a9dd-3d36-4bea-953b-fe65ba4747a5 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:35:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-93711ce0-ebcb-4bb9-b584-5f57e2af10c6 req-71c9cd7d-cf6d-4ae0-8437-19006fbf182d service nova] Acquiring lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-93711ce0-ebcb-4bb9-b584-5f57e2af10c6 req-71c9cd7d-cf6d-4ae0-8437-19006fbf182d service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-93711ce0-ebcb-4bb9-b584-5f57e2af10c6 req-71c9cd7d-cf6d-4ae0-8437-19006fbf182d service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:04 user nova-compute[231753]: DEBUG nova.compute.manager [req-93711ce0-ebcb-4bb9-b584-5f57e2af10c6 req-71c9cd7d-cf6d-4ae0-8437-19006fbf182d service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] No waiting events found dispatching network-vif-plugged-e106a9dd-3d36-4bea-953b-fe65ba4747a5 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:35:04 user nova-compute[231753]: WARNING nova.compute.manager [req-93711ce0-ebcb-4bb9-b584-5f57e2af10c6 req-71c9cd7d-cf6d-4ae0-8437-19006fbf182d service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received unexpected event network-vif-plugged-e106a9dd-3d36-4bea-953b-fe65ba4747a5 for instance with vm_state building and task_state spawning.
Jul 29 13:35:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:05 user nova-compute[231753]: DEBUG nova.compute.manager [req-c261e4b5-d4bd-4ced-81cf-78c281a7ab59 req-d6904d6a-8b2a-42fb-84e2-e40e01434176 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-plugged-28d91bef-df2e-469a-b449-10e27e352ee8 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:35:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c261e4b5-d4bd-4ced-81cf-78c281a7ab59 req-d6904d6a-8b2a-42fb-84e2-e40e01434176 service nova] Acquiring lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c261e4b5-d4bd-4ced-81cf-78c281a7ab59 req-d6904d6a-8b2a-42fb-84e2-e40e01434176 service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c261e4b5-d4bd-4ced-81cf-78c281a7ab59 req-d6904d6a-8b2a-42fb-84e2-e40e01434176 service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:05 user nova-compute[231753]: DEBUG nova.compute.manager [req-c261e4b5-d4bd-4ced-81cf-78c281a7ab59 req-d6904d6a-8b2a-42fb-84e2-e40e01434176 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] No waiting events found dispatching network-vif-plugged-28d91bef-df2e-469a-b449-10e27e352ee8 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:35:05 user nova-compute[231753]: WARNING nova.compute.manager [req-c261e4b5-d4bd-4ced-81cf-78c281a7ab59 req-d6904d6a-8b2a-42fb-84e2-e40e01434176 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received unexpected event network-vif-plugged-28d91bef-df2e-469a-b449-10e27e352ee8 for instance with vm_state building and task_state spawning.
Jul 29 13:35:05 user nova-compute[231753]: DEBUG nova.compute.manager [req-c261e4b5-d4bd-4ced-81cf-78c281a7ab59 req-d6904d6a-8b2a-42fb-84e2-e40e01434176 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-plugged-7a1e3eda-8abb-49ca-a495-aa7f584a9252 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:35:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c261e4b5-d4bd-4ced-81cf-78c281a7ab59 req-d6904d6a-8b2a-42fb-84e2-e40e01434176 service nova] Acquiring lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c261e4b5-d4bd-4ced-81cf-78c281a7ab59 req-d6904d6a-8b2a-42fb-84e2-e40e01434176 service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c261e4b5-d4bd-4ced-81cf-78c281a7ab59 req-d6904d6a-8b2a-42fb-84e2-e40e01434176 service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:05 user nova-compute[231753]: DEBUG nova.compute.manager [req-c261e4b5-d4bd-4ced-81cf-78c281a7ab59 req-d6904d6a-8b2a-42fb-84e2-e40e01434176 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] No waiting events found dispatching network-vif-plugged-7a1e3eda-8abb-49ca-a495-aa7f584a9252 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:35:05 user nova-compute[231753]: WARNING nova.compute.manager [req-c261e4b5-d4bd-4ced-81cf-78c281a7ab59 req-d6904d6a-8b2a-42fb-84e2-e40e01434176 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received unexpected event network-vif-plugged-7a1e3eda-8abb-49ca-a495-aa7f584a9252 for instance with vm_state building and task_state spawning.
Jul 29 13:35:05 user nova-compute[231753]: DEBUG nova.compute.manager [req-c261e4b5-d4bd-4ced-81cf-78c281a7ab59 req-d6904d6a-8b2a-42fb-84e2-e40e01434176 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-plugged-7a1e3eda-8abb-49ca-a495-aa7f584a9252 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:35:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c261e4b5-d4bd-4ced-81cf-78c281a7ab59 req-d6904d6a-8b2a-42fb-84e2-e40e01434176 service nova] Acquiring lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c261e4b5-d4bd-4ced-81cf-78c281a7ab59 req-d6904d6a-8b2a-42fb-84e2-e40e01434176 service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c261e4b5-d4bd-4ced-81cf-78c281a7ab59 req-d6904d6a-8b2a-42fb-84e2-e40e01434176 service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:05 user nova-compute[231753]: DEBUG nova.compute.manager [req-c261e4b5-d4bd-4ced-81cf-78c281a7ab59 req-d6904d6a-8b2a-42fb-84e2-e40e01434176 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] No waiting events found dispatching network-vif-plugged-7a1e3eda-8abb-49ca-a495-aa7f584a9252 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:35:05 user nova-compute[231753]: WARNING nova.compute.manager [req-c261e4b5-d4bd-4ced-81cf-78c281a7ab59 req-d6904d6a-8b2a-42fb-84e2-e40e01434176 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received unexpected event network-vif-plugged-7a1e3eda-8abb-49ca-a495-aa7f584a9252 for instance with vm_state building and task_state spawning.
Jul 29 13:35:05 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:05 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:05 user nova-compute[231753]: DEBUG nova.network.neutron [req-a14c8014-a6e1-44da-896b-2fb12ed748d7 req-eaa2d96c-0cec-451e-be7b-7711a16e909b service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Updated VIF entry in instance network info cache for port fadc1466-5336-4230-b0f1-4fe4053f216a. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:35:05 user nova-compute[231753]: DEBUG nova.network.neutron [req-a14c8014-a6e1-44da-896b-2fb12ed748d7 req-eaa2d96c-0cec-451e-be7b-7711a16e909b service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Updating instance_info_cache with network_info: [{"id": "fadc1466-5336-4230-b0f1-4fe4053f216a", "address": "fa:16:3e:df:12:9c", "network": {"id": "8897db8c-6e92-4b9e-b7ee-a69230eb07f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1596242231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a8a3e0bcef4bbc979ef187e4ed48cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc1466-53", "ovs_interfaceid": "fadc1466-5336-4230-b0f1-4fe4053f216a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:35:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a14c8014-a6e1-44da-896b-2fb12ed748d7 req-eaa2d96c-0cec-451e-be7b-7711a16e909b service nova] Releasing lock "refresh_cache-63fad324-aac2-4d60-b4ce-a32a5736657d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:35:05 user nova-compute[231753]: DEBUG nova.compute.manager [req-a14c8014-a6e1-44da-896b-2fb12ed748d7 req-eaa2d96c-0cec-451e-be7b-7711a16e909b service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-plugged-f6babf7d-a012-411a-a2cc-134c92ac26d8 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:35:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a14c8014-a6e1-44da-896b-2fb12ed748d7 req-eaa2d96c-0cec-451e-be7b-7711a16e909b service nova] Acquiring lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a14c8014-a6e1-44da-896b-2fb12ed748d7 req-eaa2d96c-0cec-451e-be7b-7711a16e909b service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a14c8014-a6e1-44da-896b-2fb12ed748d7 req-eaa2d96c-0cec-451e-be7b-7711a16e909b service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:05 user nova-compute[231753]: DEBUG nova.compute.manager [req-a14c8014-a6e1-44da-896b-2fb12ed748d7 req-eaa2d96c-0cec-451e-be7b-7711a16e909b service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] No waiting events found dispatching network-vif-plugged-f6babf7d-a012-411a-a2cc-134c92ac26d8 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:35:05 user nova-compute[231753]: WARNING nova.compute.manager [req-a14c8014-a6e1-44da-896b-2fb12ed748d7 req-eaa2d96c-0cec-451e-be7b-7711a16e909b service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received unexpected event network-vif-plugged-f6babf7d-a012-411a-a2cc-134c92ac26d8 for instance with vm_state building and task_state spawning.
Jul 29 13:35:05 user nova-compute[231753]: DEBUG nova.compute.manager [req-a14c8014-a6e1-44da-896b-2fb12ed748d7 req-eaa2d96c-0cec-451e-be7b-7711a16e909b service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-plugged-0dd83ad9-c54b-4c90-981a-8982501e36cf {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:35:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a14c8014-a6e1-44da-896b-2fb12ed748d7 req-eaa2d96c-0cec-451e-be7b-7711a16e909b service nova] Acquiring lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a14c8014-a6e1-44da-896b-2fb12ed748d7 req-eaa2d96c-0cec-451e-be7b-7711a16e909b service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a14c8014-a6e1-44da-896b-2fb12ed748d7 req-eaa2d96c-0cec-451e-be7b-7711a16e909b service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:05 user nova-compute[231753]: DEBUG nova.compute.manager [req-a14c8014-a6e1-44da-896b-2fb12ed748d7 req-eaa2d96c-0cec-451e-be7b-7711a16e909b service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] No waiting events found dispatching network-vif-plugged-0dd83ad9-c54b-4c90-981a-8982501e36cf {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:35:05 user nova-compute[231753]: WARNING nova.compute.manager [req-a14c8014-a6e1-44da-896b-2fb12ed748d7 req-eaa2d96c-0cec-451e-be7b-7711a16e909b service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received unexpected event network-vif-plugged-0dd83ad9-c54b-4c90-981a-8982501e36cf for instance with vm_state building and task_state spawning.
Jul 29 13:35:05 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:05 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:06 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637706.381581, 5127f26d-e912-49a4-b8ae-6157f0055270 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:35:06 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] VM Resumed (Lifecycle Event)
Jul 29 13:35:06 user nova-compute[231753]: DEBUG nova.compute.manager [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:35:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:35:06 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Instance spawned successfully.
Jul 29 13:35:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:35:06 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:35:06 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:35:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:35:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:35:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:35:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:35:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:35:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:35:06 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:35:06 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637706.385793, 5127f26d-e912-49a4-b8ae-6157f0055270 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:35:06 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] VM Started (Lifecycle Event)
Jul 29 13:35:06 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:35:06 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:35:06 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:35:06 user nova-compute[231753]: INFO nova.compute.manager [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Took 11.36 seconds to spawn the instance on the hypervisor.
Jul 29 13:35:06 user nova-compute[231753]: DEBUG nova.compute.manager [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:35:06 user nova-compute[231753]: DEBUG nova.compute.manager [req-30ad35db-fc42-450c-8b4d-04588efbcf9a req-acac057f-92a6-46cc-bd92-220633d98f1a service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-plugged-713bc8f5-df03-42c3-8250-ff7ed4e07f4e {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:35:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-30ad35db-fc42-450c-8b4d-04588efbcf9a req-acac057f-92a6-46cc-bd92-220633d98f1a service nova] Acquiring lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-30ad35db-fc42-450c-8b4d-04588efbcf9a req-acac057f-92a6-46cc-bd92-220633d98f1a service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-30ad35db-fc42-450c-8b4d-04588efbcf9a req-acac057f-92a6-46cc-bd92-220633d98f1a service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:06 user nova-compute[231753]: DEBUG nova.compute.manager [req-30ad35db-fc42-450c-8b4d-04588efbcf9a req-acac057f-92a6-46cc-bd92-220633d98f1a service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] No waiting events found dispatching network-vif-plugged-713bc8f5-df03-42c3-8250-ff7ed4e07f4e {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:35:06 user nova-compute[231753]: WARNING nova.compute.manager [req-30ad35db-fc42-450c-8b4d-04588efbcf9a req-acac057f-92a6-46cc-bd92-220633d98f1a service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received unexpected event network-vif-plugged-713bc8f5-df03-42c3-8250-ff7ed4e07f4e for instance with vm_state building and task_state spawning.
Jul 29 13:35:06 user nova-compute[231753]: DEBUG nova.compute.manager [req-30ad35db-fc42-450c-8b4d-04588efbcf9a req-acac057f-92a6-46cc-bd92-220633d98f1a service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Received event network-changed-d219916c-23c3-4319-ad8e-9d04e9399ab7 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:35:06 user nova-compute[231753]: DEBUG nova.compute.manager [req-30ad35db-fc42-450c-8b4d-04588efbcf9a req-acac057f-92a6-46cc-bd92-220633d98f1a service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Refreshing instance network info cache due to event network-changed-d219916c-23c3-4319-ad8e-9d04e9399ab7. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:35:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-30ad35db-fc42-450c-8b4d-04588efbcf9a req-acac057f-92a6-46cc-bd92-220633d98f1a service nova] Acquiring lock "refresh_cache-4475f276-acc4-44f1-a5fa-6a7fb2165493" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:35:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-30ad35db-fc42-450c-8b4d-04588efbcf9a req-acac057f-92a6-46cc-bd92-220633d98f1a service nova] Acquired lock "refresh_cache-4475f276-acc4-44f1-a5fa-6a7fb2165493" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:35:06 user nova-compute[231753]: DEBUG nova.network.neutron [req-30ad35db-fc42-450c-8b4d-04588efbcf9a req-acac057f-92a6-46cc-bd92-220633d98f1a service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Refreshing network info cache for port d219916c-23c3-4319-ad8e-9d04e9399ab7 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:35:06 user nova-compute[231753]: INFO nova.compute.manager [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Took 38.13 seconds to build instance.
Jul 29 13:35:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d65d72b0-60d1-4759-853d-d21e3cbdc0d6 tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Lock "5127f26d-e912-49a4-b8ae-6157f0055270" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 38.232s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:06 user nova-compute[231753]: DEBUG nova.compute.manager [req-26e28d8a-1e71-4367-ace6-bae98d6f8cd1 req-c6d30f6b-1cce-4162-955f-aae98773ee68 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-plugged-0dd83ad9-c54b-4c90-981a-8982501e36cf {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:35:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-26e28d8a-1e71-4367-ace6-bae98d6f8cd1 req-c6d30f6b-1cce-4162-955f-aae98773ee68 service nova] Acquiring lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-26e28d8a-1e71-4367-ace6-bae98d6f8cd1 req-c6d30f6b-1cce-4162-955f-aae98773ee68 service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-26e28d8a-1e71-4367-ace6-bae98d6f8cd1 req-c6d30f6b-1cce-4162-955f-aae98773ee68 service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:06 user nova-compute[231753]: DEBUG nova.compute.manager [req-26e28d8a-1e71-4367-ace6-bae98d6f8cd1 req-c6d30f6b-1cce-4162-955f-aae98773ee68 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] No waiting events found dispatching network-vif-plugged-0dd83ad9-c54b-4c90-981a-8982501e36cf {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:35:06 user nova-compute[231753]: WARNING nova.compute.manager [req-26e28d8a-1e71-4367-ace6-bae98d6f8cd1 req-c6d30f6b-1cce-4162-955f-aae98773ee68 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received unexpected event network-vif-plugged-0dd83ad9-c54b-4c90-981a-8982501e36cf for instance with vm_state active and task_state None.
Jul 29 13:35:07 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:35:07 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:35:07 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:35:07 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 13:35:07 user nova-compute[231753]: DEBUG nova.network.neutron [req-30ad35db-fc42-450c-8b4d-04588efbcf9a req-acac057f-92a6-46cc-bd92-220633d98f1a service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Updated VIF entry in instance network info cache for port d219916c-23c3-4319-ad8e-9d04e9399ab7. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:35:07 user nova-compute[231753]: DEBUG nova.network.neutron [req-30ad35db-fc42-450c-8b4d-04588efbcf9a req-acac057f-92a6-46cc-bd92-220633d98f1a service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Updating instance_info_cache with network_info: [{"id": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "address": "fa:16:3e:52:5c:6f", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd219916c-23", "ovs_interfaceid": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:35:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-30ad35db-fc42-450c-8b4d-04588efbcf9a req-acac057f-92a6-46cc-bd92-220633d98f1a service nova] Releasing lock "refresh_cache-4475f276-acc4-44f1-a5fa-6a7fb2165493" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:35:07 user nova-compute[231753]: DEBUG nova.compute.manager [req-30ad35db-fc42-450c-8b4d-04588efbcf9a req-acac057f-92a6-46cc-bd92-220633d98f1a service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-plugged-713bc8f5-df03-42c3-8250-ff7ed4e07f4e {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:35:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-30ad35db-fc42-450c-8b4d-04588efbcf9a req-acac057f-92a6-46cc-bd92-220633d98f1a service nova] Acquiring lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-30ad35db-fc42-450c-8b4d-04588efbcf9a req-acac057f-92a6-46cc-bd92-220633d98f1a service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-30ad35db-fc42-450c-8b4d-04588efbcf9a req-acac057f-92a6-46cc-bd92-220633d98f1a service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:07 user nova-compute[231753]: DEBUG nova.compute.manager [req-30ad35db-fc42-450c-8b4d-04588efbcf9a req-acac057f-92a6-46cc-bd92-220633d98f1a service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] No waiting events found dispatching network-vif-plugged-713bc8f5-df03-42c3-8250-ff7ed4e07f4e {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:35:07 user nova-compute[231753]: WARNING nova.compute.manager [req-30ad35db-fc42-450c-8b4d-04588efbcf9a req-acac057f-92a6-46cc-bd92-220633d98f1a service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received unexpected event network-vif-plugged-713bc8f5-df03-42c3-8250-ff7ed4e07f4e for instance with vm_state building and task_state spawning.
Jul 29 13:35:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "refresh_cache-4475f276-acc4-44f1-a5fa-6a7fb2165493" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:35:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquired lock "refresh_cache-4475f276-acc4-44f1-a5fa-6a7fb2165493" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:35:07 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Forcefully refreshing network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 13:35:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:07 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Updating instance_info_cache with network_info: [{"id": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "address": "fa:16:3e:52:5c:6f", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd219916c-23", "ovs_interfaceid": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:35:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Releasing lock "refresh_cache-4475f276-acc4-44f1-a5fa-6a7fb2165493" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:35:07 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Updated the network info_cache for instance {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 13:35:07 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:35:07 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:35:07 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:35:07 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:35:07 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:35:07 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:35:07 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 13:35:07 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:35:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:07 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 13:35:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02ec16d-24a3-450d-858d-3ad302086ac3/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:08 user nova-compute[231753]: DEBUG nova.compute.manager [req-6e689ce6-6080-43f1-a424-33e40026268e req-042546c2-081e-43ab-85ed-883dc3c9c796 service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Received event network-changed-2a7981fb-647d-4610-9da2-3b162f366dfe {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:35:08 user nova-compute[231753]: DEBUG nova.compute.manager [req-6e689ce6-6080-43f1-a424-33e40026268e req-042546c2-081e-43ab-85ed-883dc3c9c796 service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Refreshing instance network info cache due to event network-changed-2a7981fb-647d-4610-9da2-3b162f366dfe. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:35:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6e689ce6-6080-43f1-a424-33e40026268e req-042546c2-081e-43ab-85ed-883dc3c9c796 service nova] Acquiring lock "refresh_cache-3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:35:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6e689ce6-6080-43f1-a424-33e40026268e req-042546c2-081e-43ab-85ed-883dc3c9c796 service nova] Acquired lock "refresh_cache-3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:35:08 user nova-compute[231753]: DEBUG nova.network.neutron [req-6e689ce6-6080-43f1-a424-33e40026268e req-042546c2-081e-43ab-85ed-883dc3c9c796 service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Refreshing network info cache for port 2a7981fb-647d-4610-9da2-3b162f366dfe {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:35:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02ec16d-24a3-450d-858d-3ad302086ac3/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02ec16d-24a3-450d-858d-3ad302086ac3/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02ec16d-24a3-450d-858d-3ad302086ac3/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be12e63-8803-4ffa-82e1-2fe38f6b5d2d/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:09 user nova-compute[231753]: DEBUG nova.network.neutron [req-6e689ce6-6080-43f1-a424-33e40026268e req-042546c2-081e-43ab-85ed-883dc3c9c796 service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Updated VIF entry in instance network info cache for port 2a7981fb-647d-4610-9da2-3b162f366dfe. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:35:09 user nova-compute[231753]: DEBUG nova.network.neutron [req-6e689ce6-6080-43f1-a424-33e40026268e req-042546c2-081e-43ab-85ed-883dc3c9c796 service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Updating instance_info_cache with network_info: [{"id": "2a7981fb-647d-4610-9da2-3b162f366dfe", "address": "fa:16:3e:0c:e3:a3", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7981fb-64", "ovs_interfaceid": "2a7981fb-647d-4610-9da2-3b162f366dfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:35:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be12e63-8803-4ffa-82e1-2fe38f6b5d2d/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be12e63-8803-4ffa-82e1-2fe38f6b5d2d/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6e689ce6-6080-43f1-a424-33e40026268e req-042546c2-081e-43ab-85ed-883dc3c9c796 service nova] Releasing lock "refresh_cache-3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:35:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/1be12e63-8803-4ffa-82e1-2fe38f6b5d2d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b21191-c874-4ca8-bd4b-2df90a41ccab/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b21191-c874-4ca8-bd4b-2df90a41ccab/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b21191-c874-4ca8-bd4b-2df90a41ccab/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b50d9409-12db-4fd4-8576-7327d336a2db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "4475f276-acc4-44f1-a5fa-6a7fb2165493" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b50d9409-12db-4fd4-8576-7327d336a2db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "4475f276-acc4-44f1-a5fa-6a7fb2165493" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:10 user nova-compute[231753]: INFO nova.compute.manager [None req-b50d9409-12db-4fd4-8576-7327d336a2db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Shelving
Jul 29 13:35:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/29b21191-c874-4ca8-bd4b-2df90a41ccab/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8/disk --force-share --output=json" returned: 0 in 0.182s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:10 user nova-compute[231753]: DEBUG nova.compute.manager [req-9a4983ed-6605-4984-81be-5113331475f5 req-c094cc59-c247-48da-a56f-c42b6650dce8 service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Received event network-vif-unplugged-d219916c-23c3-4319-ad8e-9d04e9399ab7 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:35:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9a4983ed-6605-4984-81be-5113331475f5 req-c094cc59-c247-48da-a56f-c42b6650dce8 service nova] Acquiring lock "4475f276-acc4-44f1-a5fa-6a7fb2165493-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9a4983ed-6605-4984-81be-5113331475f5 req-c094cc59-c247-48da-a56f-c42b6650dce8 service nova] Lock "4475f276-acc4-44f1-a5fa-6a7fb2165493-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9a4983ed-6605-4984-81be-5113331475f5 req-c094cc59-c247-48da-a56f-c42b6650dce8 service nova] Lock "4475f276-acc4-44f1-a5fa-6a7fb2165493-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:10 user nova-compute[231753]: DEBUG nova.compute.manager [req-9a4983ed-6605-4984-81be-5113331475f5 req-c094cc59-c247-48da-a56f-c42b6650dce8 service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] No waiting events found dispatching network-vif-unplugged-d219916c-23c3-4319-ad8e-9d04e9399ab7 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:35:10 user nova-compute[231753]: WARNING nova.compute.manager [req-9a4983ed-6605-4984-81be-5113331475f5 req-c094cc59-c247-48da-a56f-c42b6650dce8 service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Received unexpected event network-vif-unplugged-d219916c-23c3-4319-ad8e-9d04e9399ab7 for instance with vm_state active and task_state shelving.
Jul 29 13:35:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:35:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:35:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:35:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:11 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Instance destroyed successfully.
Jul 29 13:35:11 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-b50d9409-12db-4fd4-8576-7327d336a2db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Beginning cold snapshot process
Jul 29 13:35:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:12 user nova-compute[231753]: DEBUG nova.privsep.utils [None req-b50d9409-12db-4fd4-8576-7327d336a2db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=231753) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 29 13:35:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-b50d9409-12db-4fd4-8576-7327d336a2db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/disk /opt/stack/data/nova/instances/snapshots/tmpemmlu73a/3901ccaa8a444604931125de5eb96a8b {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:12 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:35:12 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:35:12 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=6795MB free_disk=25.56625747680664GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 13:35:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Acquiring lock "3d25aef1-5ef1-42a9-be32-1e26077f7b74" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lock "3d25aef1-5ef1-42a9-be32-1e26077f7b74" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:12 user nova-compute[231753]: DEBUG nova.compute.manager [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:35:12 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 5127f26d-e912-49a4-b8ae-6157f0055270 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:35:12 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8822efe3-e17a-4511-b75f-37f6a83616aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:35:12 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 3d25aef1-5ef1-42a9-be32-1e26077f7b74 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Jul 29 13:35:12 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b67b98f8-a7b3-499e-ba32-9520bbced960 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:35:12 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 299b7f21-b198-437b-9d5c-1269d5e9b7c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:35:12 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 63fad324-aac2-4d60-b4ce-a32a5736657d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:35:12 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:35:12 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:35:12 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b02ec16d-24a3-450d-858d-3ad302086ac3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:35:12 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 29b21191-c874-4ca8-bd4b-2df90a41ccab actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:35:12 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 4475f276-acc4-44f1-a5fa-6a7fb2165493 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:35:12 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 13:35:12 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 13:35:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG nova.compute.manager [req-c6185a4b-347c-4be4-b5e9-5784ce6d3e07 req-90bcdb74-d78a-413e-b294-bd1dea5d4599 service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Received event network-vif-plugged-d219916c-23c3-4319-ad8e-9d04e9399ab7 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c6185a4b-347c-4be4-b5e9-5784ce6d3e07 req-90bcdb74-d78a-413e-b294-bd1dea5d4599 service nova] Acquiring lock "4475f276-acc4-44f1-a5fa-6a7fb2165493-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c6185a4b-347c-4be4-b5e9-5784ce6d3e07 req-90bcdb74-d78a-413e-b294-bd1dea5d4599 service nova] Lock "4475f276-acc4-44f1-a5fa-6a7fb2165493-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c6185a4b-347c-4be4-b5e9-5784ce6d3e07 req-90bcdb74-d78a-413e-b294-bd1dea5d4599 service nova] Lock "4475f276-acc4-44f1-a5fa-6a7fb2165493-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG nova.compute.manager [req-c6185a4b-347c-4be4-b5e9-5784ce6d3e07 req-90bcdb74-d78a-413e-b294-bd1dea5d4599 service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] No waiting events found dispatching network-vif-plugged-d219916c-23c3-4319-ad8e-9d04e9399ab7 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:35:13 user nova-compute[231753]: WARNING nova.compute.manager [req-c6185a4b-347c-4be4-b5e9-5784ce6d3e07 req-90bcdb74-d78a-413e-b294-bd1dea5d4599 service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Received unexpected event network-vif-plugged-d219916c-23c3-4319-ad8e-9d04e9399ab7 for instance with vm_state active and task_state shelving_image_pending_upload.
Jul 29 13:35:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Acquiring lock "29b21191-c874-4ca8-bd4b-2df90a41ccab" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Lock "29b21191-c874-4ca8-bd4b-2df90a41ccab" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG nova.objects.instance [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Lazy-loading 'flavor' on Instance uuid 29b21191-c874-4ca8-bd4b-2df90a41ccab {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Lock "29b21191-c874-4ca8-bd4b-2df90a41ccab" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.131s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.877s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-b50d9409-12db-4fd4-8576-7327d336a2db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/disk /opt/stack/data/nova/instances/snapshots/tmpemmlu73a/3901ccaa8a444604931125de5eb96a8b" returned: 0 in 0.939s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.682s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:13 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-b50d9409-12db-4fd4-8576-7327d336a2db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Snapshot extracted, beginning image upload
Jul 29 13:35:13 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:35:13 user nova-compute[231753]: INFO nova.compute.claims [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Claim successful on node user
Jul 29 13:35:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Acquiring lock "29b21191-c874-4ca8-bd4b-2df90a41ccab" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Lock "29b21191-c874-4ca8-bd4b-2df90a41ccab" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:13 user nova-compute[231753]: INFO nova.compute.manager [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Attaching volume 55e89d6b-9f3a-4653-9230-5af0bc288411 to /dev/vdb
Jul 29 13:35:13 user nova-compute[231753]: DEBUG os_brick.utils [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[794a5ce1-5539-4b6f-a9a1-9edce437936b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[287ae193-4510-4b92-b25a-b230d420b683]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3524b773-65a6-4cf7-94fb-758767fa7af6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7e92bd9-5987-4f47-a657-cf5980f2a4ca]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:35:13 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:35:13 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8701ccfd-a6ac-409f-8984-148021776298]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG os_brick.utils [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] <== get_connector_properties: return (154ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Updating existing volume attachment record: 0809cec1-da9a-4c7c-aeb8-997882e4b72c {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.634s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG nova.compute.manager [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG nova.compute.manager [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:35:13 user nova-compute[231753]: DEBUG nova.network.neutron [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:35:13 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:35:13 user nova-compute[231753]: DEBUG nova.compute.manager [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:35:14 user nova-compute[231753]: DEBUG nova.policy [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '0f99f3a73b4e4831b25e63b2ef8362c9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '35a6a49685124aaf93030ca59169dde5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:35:14 user nova-compute[231753]: DEBUG nova.compute.manager [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:35:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:35:14 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Creating image(s)
Jul 29 13:35:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Acquiring lock "/opt/stack/data/nova/instances/3d25aef1-5ef1-42a9-be32-1e26077f7b74/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lock "/opt/stack/data/nova/instances/3d25aef1-5ef1-42a9-be32-1e26077f7b74/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lock "/opt/stack/data/nova/instances/3d25aef1-5ef1-42a9-be32-1e26077f7b74/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.155s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.170s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/3d25aef1-5ef1-42a9-be32-1e26077f7b74/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/3d25aef1-5ef1-42a9-be32-1e26077f7b74/disk 1073741824" returned: 0 in 0.055s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.233s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.187s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:14 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3d25aef1-5ef1-42a9-be32-1e26077f7b74/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:35:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d25aef1-5ef1-42a9-be32-1e26077f7b74/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d25aef1-5ef1-42a9-be32-1e26077f7b74/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:14 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Cannot resize image /opt/stack/data/nova/instances/3d25aef1-5ef1-42a9-be32-1e26077f7b74/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:35:14 user nova-compute[231753]: DEBUG nova.objects.instance [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lazy-loading 'migration_context' on Instance uuid 3d25aef1-5ef1-42a9-be32-1e26077f7b74 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:35:14 user nova-compute[231753]: DEBUG nova.network.neutron [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Successfully created port: 353d55fe-9e9d-49c7-81ef-d210995d1190 {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:35:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:35:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Ensure instance console log exists: /opt/stack/data/nova/instances/3d25aef1-5ef1-42a9-be32-1e26077f7b74/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:35:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:15 user nova-compute[231753]: DEBUG nova.network.neutron [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Successfully updated port: 353d55fe-9e9d-49c7-81ef-d210995d1190 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:35:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Acquiring lock "refresh_cache-3d25aef1-5ef1-42a9-be32-1e26077f7b74" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:35:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Acquired lock "refresh_cache-3d25aef1-5ef1-42a9-be32-1e26077f7b74" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:35:15 user nova-compute[231753]: DEBUG nova.network.neutron [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:35:15 user nova-compute[231753]: DEBUG nova.compute.manager [req-1143495f-975d-488c-b356-161ce7dd3e46 req-b10b90fd-9bf4-4b61-a7c9-13be1446fd96 service nova] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Received event network-changed-353d55fe-9e9d-49c7-81ef-d210995d1190 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:35:15 user nova-compute[231753]: DEBUG nova.compute.manager [req-1143495f-975d-488c-b356-161ce7dd3e46 req-b10b90fd-9bf4-4b61-a7c9-13be1446fd96 service nova] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Refreshing instance network info cache due to event network-changed-353d55fe-9e9d-49c7-81ef-d210995d1190. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:35:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-1143495f-975d-488c-b356-161ce7dd3e46 req-b10b90fd-9bf4-4b61-a7c9-13be1446fd96 service nova] Acquiring lock "refresh_cache-3d25aef1-5ef1-42a9-be32-1e26077f7b74" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:35:15 user nova-compute[231753]: DEBUG nova.network.neutron [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG nova.network.neutron [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Updating instance_info_cache with network_info: [{"id": "353d55fe-9e9d-49c7-81ef-d210995d1190", "address": "fa:16:3e:82:50:33", "network": {"id": "092d27a5-871f-4865-ac97-fbb701a5c807", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-907499567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a6a49685124aaf93030ca59169dde5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap353d55fe-9e", "ovs_interfaceid": "353d55fe-9e9d-49c7-81ef-d210995d1190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Releasing lock "refresh_cache-3d25aef1-5ef1-42a9-be32-1e26077f7b74" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG nova.compute.manager [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Instance network_info: |[{"id": "353d55fe-9e9d-49c7-81ef-d210995d1190", "address": "fa:16:3e:82:50:33", "network": {"id": "092d27a5-871f-4865-ac97-fbb701a5c807", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-907499567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a6a49685124aaf93030ca59169dde5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap353d55fe-9e", "ovs_interfaceid": "353d55fe-9e9d-49c7-81ef-d210995d1190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:35:16 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-b50d9409-12db-4fd4-8576-7327d336a2db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Snapshot image upload complete
Jul 29 13:35:16 user nova-compute[231753]: DEBUG nova.compute.manager [None req-b50d9409-12db-4fd4-8576-7327d336a2db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-1143495f-975d-488c-b356-161ce7dd3e46 req-b10b90fd-9bf4-4b61-a7c9-13be1446fd96 service nova] Acquired lock "refresh_cache-3d25aef1-5ef1-42a9-be32-1e26077f7b74" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG nova.network.neutron [req-1143495f-975d-488c-b356-161ce7dd3e46 req-b10b90fd-9bf4-4b61-a7c9-13be1446fd96 service nova] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Refreshing network info cache for port 353d55fe-9e9d-49c7-81ef-d210995d1190 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Start _get_guest_xml network_info=[{"id": "353d55fe-9e9d-49c7-81ef-d210995d1190", "address": "fa:16:3e:82:50:33", "network": {"id": "092d27a5-871f-4865-ac97-fbb701a5c807", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-907499567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a6a49685124aaf93030ca59169dde5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap353d55fe-9e", "ovs_interfaceid": "353d55fe-9e9d-49c7-81ef-d210995d1190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:35:16 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:35:16 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:35:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:35:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1229995759',display_name='tempest-ServersNegativeTestJSON-server-1229995759',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1229995759',id=11,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35a6a49685124aaf93030ca59169dde5',ramdisk_id='',reservation_id='r-is0sptb9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1215130688',owner_user_name='tempest-ServersNegativeTestJSON-1215130688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:35:14Z,user_data=None,user_id='0f99f3a73b4e4831b25e63b2ef8362c9',uuid=3d25aef1-5ef1-42a9-be32-1e26077f7b74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "353d55fe-9e9d-49c7-81ef-d210995d1190", "address": "fa:16:3e:82:50:33", "network": {"id": "092d27a5-871f-4865-ac97-fbb701a5c807", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-907499567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a6a49685124aaf93030ca59169dde5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap353d55fe-9e", "ovs_interfaceid": "353d55fe-9e9d-49c7-81ef-d210995d1190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Converting VIF {"id": "353d55fe-9e9d-49c7-81ef-d210995d1190", "address": "fa:16:3e:82:50:33", "network": {"id": "092d27a5-871f-4865-ac97-fbb701a5c807", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-907499567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a6a49685124aaf93030ca59169dde5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap353d55fe-9e", "ovs_interfaceid": "353d55fe-9e9d-49c7-81ef-d210995d1190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:50:33,bridge_name='br-int',has_traffic_filtering=True,id=353d55fe-9e9d-49c7-81ef-d210995d1190,network=Network(092d27a5-871f-4865-ac97-fbb701a5c807),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap353d55fe-9e') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG nova.objects.instance [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lazy-loading 'pci_devices' on Instance uuid 3d25aef1-5ef1-42a9-be32-1e26077f7b74 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:35:16 user nova-compute[231753]: INFO nova.compute.manager [None req-b50d9409-12db-4fd4-8576-7327d336a2db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Shelve offloading
Jul 29 13:35:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:35:16 user nova-compute[231753]:   <uuid>3d25aef1-5ef1-42a9-be32-1e26077f7b74</uuid>
Jul 29 13:35:16 user nova-compute[231753]:   <name>instance-0000000b</name>
Jul 29 13:35:16 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:35:16 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:35:16 user nova-compute[231753]:   <metadata>
Jul 29 13:35:16 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:35:16 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:35:16 user nova-compute[231753]:       <nova:name>tempest-ServersNegativeTestJSON-server-1229995759</nova:name>
Jul 29 13:35:16 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:35:16</nova:creationTime>
Jul 29 13:35:16 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:35:16 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:35:16 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:35:16 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:35:16 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:35:16 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:35:16 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:35:16 user nova-compute[231753]:       <nova:owner>
Jul 29 13:35:16 user nova-compute[231753]:         <nova:user uuid="0f99f3a73b4e4831b25e63b2ef8362c9">tempest-ServersNegativeTestJSON-1215130688-project-member</nova:user>
Jul 29 13:35:16 user nova-compute[231753]:         <nova:project uuid="35a6a49685124aaf93030ca59169dde5">tempest-ServersNegativeTestJSON-1215130688</nova:project>
Jul 29 13:35:16 user nova-compute[231753]:       </nova:owner>
Jul 29 13:35:16 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:35:16 user nova-compute[231753]:       <nova:ports>
Jul 29 13:35:16 user nova-compute[231753]:         <nova:port uuid="353d55fe-9e9d-49c7-81ef-d210995d1190">
Jul 29 13:35:16 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.10" ipVersion="4"/>
Jul 29 13:35:16 user nova-compute[231753]:         </nova:port>
Jul 29 13:35:16 user nova-compute[231753]:       </nova:ports>
Jul 29 13:35:16 user nova-compute[231753]:     </nova:instance>
Jul 29 13:35:16 user nova-compute[231753]:   </metadata>
Jul 29 13:35:16 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:35:16 user nova-compute[231753]:     <system>
Jul 29 13:35:16 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:35:16 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:35:16 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:35:16 user nova-compute[231753]:       <entry name="serial">3d25aef1-5ef1-42a9-be32-1e26077f7b74</entry>
Jul 29 13:35:16 user nova-compute[231753]:       <entry name="uuid">3d25aef1-5ef1-42a9-be32-1e26077f7b74</entry>
Jul 29 13:35:16 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:35:16 user nova-compute[231753]:     </system>
Jul 29 13:35:16 user nova-compute[231753]:   </sysinfo>
Jul 29 13:35:16 user nova-compute[231753]:   <os>
Jul 29 13:35:16 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:35:16 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:35:16 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:35:16 user nova-compute[231753]:   </os>
Jul 29 13:35:16 user nova-compute[231753]:   <features>
Jul 29 13:35:16 user nova-compute[231753]:     <acpi/>
Jul 29 13:35:16 user nova-compute[231753]:     <apic/>
Jul 29 13:35:16 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:35:16 user nova-compute[231753]:   </features>
Jul 29 13:35:16 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:35:16 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:35:16 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:35:16 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:35:16 user nova-compute[231753]:   </clock>
Jul 29 13:35:16 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:35:16 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:35:16 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:35:16 user nova-compute[231753]:   </cpu>
Jul 29 13:35:16 user nova-compute[231753]:   <devices>
Jul 29 13:35:16 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:35:16 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:35:16 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/3d25aef1-5ef1-42a9-be32-1e26077f7b74/disk"/>
Jul 29 13:35:16 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:35:16 user nova-compute[231753]:     </disk>
Jul 29 13:35:16 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:35:16 user nova-compute[231753]:       <mac address="fa:16:3e:82:50:33"/>
Jul 29 13:35:16 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:35:16 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:35:16 user nova-compute[231753]:       <target dev="tap353d55fe-9e"/>
Jul 29 13:35:16 user nova-compute[231753]:     </interface>
Jul 29 13:35:16 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:35:16 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/3d25aef1-5ef1-42a9-be32-1e26077f7b74/console.log" append="off"/>
Jul 29 13:35:16 user nova-compute[231753]:     </serial>
Jul 29 13:35:16 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:35:16 user nova-compute[231753]:     <video>
Jul 29 13:35:16 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:35:16 user nova-compute[231753]:     </video>
Jul 29 13:35:16 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:35:16 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:35:16 user nova-compute[231753]:     </rng>
Jul 29 13:35:16 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:35:16 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:35:16 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:35:16 user nova-compute[231753]:     </memballoon>
Jul 29 13:35:16 user nova-compute[231753]:   </devices>
Jul 29 13:35:16 user nova-compute[231753]: </domain>
Jul 29 13:35:16 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:35:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1229995759',display_name='tempest-ServersNegativeTestJSON-server-1229995759',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1229995759',id=11,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='35a6a49685124aaf93030ca59169dde5',ramdisk_id='',reservation_id='r-is0sptb9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServersNegativeTestJSON-1215130688',owner_user_name='tempest-ServersNegativeTestJSON-1215130688-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:35:14Z,user_data=None,user_id='0f99f3a73b4e4831b25e63b2ef8362c9',uuid=3d25aef1-5ef1-42a9-be32-1e26077f7b74,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "353d55fe-9e9d-49c7-81ef-d210995d1190", "address": "fa:16:3e:82:50:33", "network": {"id": "092d27a5-871f-4865-ac97-fbb701a5c807", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-907499567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a6a49685124aaf93030ca59169dde5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap353d55fe-9e", "ovs_interfaceid": "353d55fe-9e9d-49c7-81ef-d210995d1190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Converting VIF {"id": "353d55fe-9e9d-49c7-81ef-d210995d1190", "address": "fa:16:3e:82:50:33", "network": {"id": "092d27a5-871f-4865-ac97-fbb701a5c807", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-907499567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a6a49685124aaf93030ca59169dde5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap353d55fe-9e", "ovs_interfaceid": "353d55fe-9e9d-49c7-81ef-d210995d1190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:50:33,bridge_name='br-int',has_traffic_filtering=True,id=353d55fe-9e9d-49c7-81ef-d210995d1190,network=Network(092d27a5-871f-4865-ac97-fbb701a5c807),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap353d55fe-9e') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG os_vif [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:50:33,bridge_name='br-int',has_traffic_filtering=True,id=353d55fe-9e9d-49c7-81ef-d210995d1190,network=Network(092d27a5-871f-4865-ac97-fbb701a5c807),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap353d55fe-9e') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap353d55fe-9e, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap353d55fe-9e, col_values=(('external_ids', {'iface-id': '353d55fe-9e9d-49c7-81ef-d210995d1190', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:82:50:33', 'vm-uuid': '3d25aef1-5ef1-42a9-be32-1e26077f7b74'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:35:16 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Instance destroyed successfully.
Jul 29 13:35:16 user nova-compute[231753]: DEBUG nova.compute.manager [None req-b50d9409-12db-4fd4-8576-7327d336a2db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b50d9409-12db-4fd4-8576-7327d336a2db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "refresh_cache-4475f276-acc4-44f1-a5fa-6a7fb2165493" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b50d9409-12db-4fd4-8576-7327d336a2db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquired lock "refresh_cache-4475f276-acc4-44f1-a5fa-6a7fb2165493" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG nova.network.neutron [None req-b50d9409-12db-4fd4-8576-7327d336a2db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:16 user nova-compute[231753]: INFO os_vif [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:50:33,bridge_name='br-int',has_traffic_filtering=True,id=353d55fe-9e9d-49c7-81ef-d210995d1190,network=Network(092d27a5-871f-4865-ac97-fbb701a5c807),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap353d55fe-9e')
Jul 29 13:35:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] No VIF found with MAC fa:16:3e:82:50:33, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG nova.network.neutron [req-1143495f-975d-488c-b356-161ce7dd3e46 req-b10b90fd-9bf4-4b61-a7c9-13be1446fd96 service nova] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Updated VIF entry in instance network info cache for port 353d55fe-9e9d-49c7-81ef-d210995d1190. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG nova.network.neutron [req-1143495f-975d-488c-b356-161ce7dd3e46 req-b10b90fd-9bf4-4b61-a7c9-13be1446fd96 service nova] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Updating instance_info_cache with network_info: [{"id": "353d55fe-9e9d-49c7-81ef-d210995d1190", "address": "fa:16:3e:82:50:33", "network": {"id": "092d27a5-871f-4865-ac97-fbb701a5c807", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-907499567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a6a49685124aaf93030ca59169dde5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap353d55fe-9e", "ovs_interfaceid": "353d55fe-9e9d-49c7-81ef-d210995d1190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:35:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-1143495f-975d-488c-b356-161ce7dd3e46 req-b10b90fd-9bf4-4b61-a7c9-13be1446fd96 service nova] Releasing lock "refresh_cache-3d25aef1-5ef1-42a9-be32-1e26077f7b74" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:35:17 user nova-compute[231753]: DEBUG nova.network.neutron [None req-b50d9409-12db-4fd4-8576-7327d336a2db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Updating instance_info_cache with network_info: [{"id": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "address": "fa:16:3e:52:5c:6f", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd219916c-23", "ovs_interfaceid": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:35:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b50d9409-12db-4fd4-8576-7327d336a2db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Releasing lock "refresh_cache-4475f276-acc4-44f1-a5fa-6a7fb2165493" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:35:17 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:18 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Instance destroyed successfully.
Jul 29 13:35:18 user nova-compute[231753]: DEBUG nova.objects.instance [None req-b50d9409-12db-4fd4-8576-7327d336a2db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lazy-loading 'resources' on Instance uuid 4475f276-acc4-44f1-a5fa-6a7fb2165493 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:35:18 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-b50d9409-12db-4fd4-8576-7327d336a2db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1694184066',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1694184066',id=2,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYoEtzU6J31e2RMDk9uaA5VJrLaFlHisUcIiXf7P/keUQzM7WNyYfVc11sJPt9QSdUbn5KUqdeviscTZdrxZy5sAgJHvKAfcyE/2Hc8mSccY6dRh0JEfLln2dwNfX/9jw==',key_name='tempest-keypair-991697156',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:33:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d53ebbb5f2e440dfa0cf3950232b4853',ramdisk_id='',reservation_id='r-k5ymi4kt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-460717858',owner_user_name='tempest-AttachVolumeShelveTestJSON-460717858-project-member',shelved_at='2023-07-29T13:35:16.290848',shelved_host='user',shelved_image_id='8a35de86-8711-45d3-a18a-d1010e6aa412'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:35:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='932b5bd757f94be29d52035fd9f70293',uuid=4475f276-acc4-44f1-a5fa-6a7fb2165493,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "address": "fa:16:3e:52:5c:6f", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd219916c-23", "ovs_interfaceid": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:35:18 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b50d9409-12db-4fd4-8576-7327d336a2db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Converting VIF {"id": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "address": "fa:16:3e:52:5c:6f", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd219916c-23", "ovs_interfaceid": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:35:18 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b50d9409-12db-4fd4-8576-7327d336a2db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:5c:6f,bridge_name='br-int',has_traffic_filtering=True,id=d219916c-23c3-4319-ad8e-9d04e9399ab7,network=Network(9be19067-cc29-4c67-95a0-cf37f95f9fc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd219916c-23') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:35:18 user nova-compute[231753]: DEBUG os_vif [None req-b50d9409-12db-4fd4-8576-7327d336a2db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:5c:6f,bridge_name='br-int',has_traffic_filtering=True,id=d219916c-23c3-4319-ad8e-9d04e9399ab7,network=Network(9be19067-cc29-4c67-95a0-cf37f95f9fc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd219916c-23') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:35:18 user nova-compute[231753]: DEBUG nova.compute.manager [req-e09e01a2-1afb-411b-84ec-1228330f202f req-e85d1206-3260-4a86-9551-1511763ac284 service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Received event network-changed-d219916c-23c3-4319-ad8e-9d04e9399ab7 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:35:18 user nova-compute[231753]: DEBUG nova.compute.manager [req-e09e01a2-1afb-411b-84ec-1228330f202f req-e85d1206-3260-4a86-9551-1511763ac284 service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Refreshing instance network info cache due to event network-changed-d219916c-23c3-4319-ad8e-9d04e9399ab7. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:35:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e09e01a2-1afb-411b-84ec-1228330f202f req-e85d1206-3260-4a86-9551-1511763ac284 service nova] Acquiring lock "refresh_cache-4475f276-acc4-44f1-a5fa-6a7fb2165493" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:35:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e09e01a2-1afb-411b-84ec-1228330f202f req-e85d1206-3260-4a86-9551-1511763ac284 service nova] Acquired lock "refresh_cache-4475f276-acc4-44f1-a5fa-6a7fb2165493" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:35:18 user nova-compute[231753]: DEBUG nova.network.neutron [req-e09e01a2-1afb-411b-84ec-1228330f202f req-e85d1206-3260-4a86-9551-1511763ac284 service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Refreshing network info cache for port d219916c-23c3-4319-ad8e-9d04e9399ab7 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:35:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd219916c-23, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:35:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:35:18 user nova-compute[231753]: INFO os_vif [None req-b50d9409-12db-4fd4-8576-7327d336a2db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:5c:6f,bridge_name='br-int',has_traffic_filtering=True,id=d219916c-23c3-4319-ad8e-9d04e9399ab7,network=Network(9be19067-cc29-4c67-95a0-cf37f95f9fc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd219916c-23')
Jul 29 13:35:18 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-b50d9409-12db-4fd4-8576-7327d336a2db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Deleting instance files /opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493_del
Jul 29 13:35:18 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-b50d9409-12db-4fd4-8576-7327d336a2db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Deletion of /opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493_del complete
Jul 29 13:35:18 user nova-compute[231753]: DEBUG nova.compute.manager [req-7ae91d4f-1b52-446f-baf4-b03d81d216ed req-c957ab11-4284-440d-a4df-f8c7640cda3a service nova] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Received event network-vif-plugged-353d55fe-9e9d-49c7-81ef-d210995d1190 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:35:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7ae91d4f-1b52-446f-baf4-b03d81d216ed req-c957ab11-4284-440d-a4df-f8c7640cda3a service nova] Acquiring lock "3d25aef1-5ef1-42a9-be32-1e26077f7b74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7ae91d4f-1b52-446f-baf4-b03d81d216ed req-c957ab11-4284-440d-a4df-f8c7640cda3a service nova] Lock "3d25aef1-5ef1-42a9-be32-1e26077f7b74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7ae91d4f-1b52-446f-baf4-b03d81d216ed req-c957ab11-4284-440d-a4df-f8c7640cda3a service nova] Lock "3d25aef1-5ef1-42a9-be32-1e26077f7b74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:18 user nova-compute[231753]: DEBUG nova.compute.manager [req-7ae91d4f-1b52-446f-baf4-b03d81d216ed req-c957ab11-4284-440d-a4df-f8c7640cda3a service nova] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] No waiting events found dispatching network-vif-plugged-353d55fe-9e9d-49c7-81ef-d210995d1190 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:35:18 user nova-compute[231753]: WARNING nova.compute.manager [req-7ae91d4f-1b52-446f-baf4-b03d81d216ed req-c957ab11-4284-440d-a4df-f8c7640cda3a service nova] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Received unexpected event network-vif-plugged-353d55fe-9e9d-49c7-81ef-d210995d1190 for instance with vm_state building and task_state spawning.
Jul 29 13:35:18 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-b50d9409-12db-4fd4-8576-7327d336a2db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Checking UEFI support for host arch (x86_64) {{(pid=231753) supports_uefi /opt/stack/nova/nova/virt/libvirt/host.py:1751}}
Jul 29 13:35:18 user nova-compute[231753]: INFO nova.virt.libvirt.host [None req-b50d9409-12db-4fd4-8576-7327d336a2db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] UEFI support detected
Jul 29 13:35:18 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-b50d9409-12db-4fd4-8576-7327d336a2db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Deleted allocations for instance 4475f276-acc4-44f1-a5fa-6a7fb2165493
Jul 29 13:35:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b50d9409-12db-4fd4-8576-7327d336a2db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b50d9409-12db-4fd4-8576-7327d336a2db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:18 user nova-compute[231753]: DEBUG nova.objects.instance [None req-b50d9409-12db-4fd4-8576-7327d336a2db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lazy-loading 'numa_topology' on Instance uuid 4475f276-acc4-44f1-a5fa-6a7fb2165493 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:35:19 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-b50d9409-12db-4fd4-8576-7327d336a2db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:35:19 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-b50d9409-12db-4fd4-8576-7327d336a2db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:35:19 user nova-compute[231753]: DEBUG nova.network.neutron [req-e09e01a2-1afb-411b-84ec-1228330f202f req-e85d1206-3260-4a86-9551-1511763ac284 service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Updated VIF entry in instance network info cache for port d219916c-23c3-4319-ad8e-9d04e9399ab7. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:35:19 user nova-compute[231753]: DEBUG nova.network.neutron [req-e09e01a2-1afb-411b-84ec-1228330f202f req-e85d1206-3260-4a86-9551-1511763ac284 service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Updating instance_info_cache with network_info: [{"id": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "address": "fa:16:3e:52:5c:6f", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapd219916c-23", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:35:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e09e01a2-1afb-411b-84ec-1228330f202f req-e85d1206-3260-4a86-9551-1511763ac284 service nova] Releasing lock "refresh_cache-4475f276-acc4-44f1-a5fa-6a7fb2165493" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:35:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b50d9409-12db-4fd4-8576-7327d336a2db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.472s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b50d9409-12db-4fd4-8576-7327d336a2db tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "4475f276-acc4-44f1-a5fa-6a7fb2165493" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 9.049s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:20 user nova-compute[231753]: DEBUG nova.compute.manager [req-dd43cfdd-a1ef-4b26-b462-032e01f81f8c req-25b18a0a-3bfb-49c6-bdd1-04a3da3a2da9 service nova] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Received event network-changed-b66269be-ef4d-460f-9782-df3fc08e5450 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:35:20 user nova-compute[231753]: DEBUG nova.compute.manager [req-dd43cfdd-a1ef-4b26-b462-032e01f81f8c req-25b18a0a-3bfb-49c6-bdd1-04a3da3a2da9 service nova] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Refreshing instance network info cache due to event network-changed-b66269be-ef4d-460f-9782-df3fc08e5450. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:35:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-dd43cfdd-a1ef-4b26-b462-032e01f81f8c req-25b18a0a-3bfb-49c6-bdd1-04a3da3a2da9 service nova] Acquiring lock "refresh_cache-299b7f21-b198-437b-9d5c-1269d5e9b7c8" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:35:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-dd43cfdd-a1ef-4b26-b462-032e01f81f8c req-25b18a0a-3bfb-49c6-bdd1-04a3da3a2da9 service nova] Acquired lock "refresh_cache-299b7f21-b198-437b-9d5c-1269d5e9b7c8" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:35:20 user nova-compute[231753]: DEBUG nova.network.neutron [req-dd43cfdd-a1ef-4b26-b462-032e01f81f8c req-25b18a0a-3bfb-49c6-bdd1-04a3da3a2da9 service nova] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Refreshing network info cache for port b66269be-ef4d-460f-9782-df3fc08e5450 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:35:20 user nova-compute[231753]: DEBUG nova.compute.manager [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:35:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:35:20 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637720.605741, 3d25aef1-5ef1-42a9-be32-1e26077f7b74 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:35:20 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] VM Resumed (Lifecycle Event)
Jul 29 13:35:20 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Instance spawned successfully.
Jul 29 13:35:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:35:20 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:35:20 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:35:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:35:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:35:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:35:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:35:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:35:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:35:20 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:35:20 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637720.6059725, 3d25aef1-5ef1-42a9-be32-1e26077f7b74 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:35:20 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] VM Started (Lifecycle Event)
Jul 29 13:35:20 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:35:20 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:35:20 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:35:20 user nova-compute[231753]: DEBUG nova.compute.manager [req-ddf45284-ad17-4612-9036-cdba81144164 req-6c3a71e6-8c41-4462-91ee-aec763dcdc18 service nova] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Received event network-vif-plugged-353d55fe-9e9d-49c7-81ef-d210995d1190 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:35:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ddf45284-ad17-4612-9036-cdba81144164 req-6c3a71e6-8c41-4462-91ee-aec763dcdc18 service nova] Acquiring lock "3d25aef1-5ef1-42a9-be32-1e26077f7b74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ddf45284-ad17-4612-9036-cdba81144164 req-6c3a71e6-8c41-4462-91ee-aec763dcdc18 service nova] Lock "3d25aef1-5ef1-42a9-be32-1e26077f7b74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ddf45284-ad17-4612-9036-cdba81144164 req-6c3a71e6-8c41-4462-91ee-aec763dcdc18 service nova] Lock "3d25aef1-5ef1-42a9-be32-1e26077f7b74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:20 user nova-compute[231753]: DEBUG nova.compute.manager [req-ddf45284-ad17-4612-9036-cdba81144164 req-6c3a71e6-8c41-4462-91ee-aec763dcdc18 service nova] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] No waiting events found dispatching network-vif-plugged-353d55fe-9e9d-49c7-81ef-d210995d1190 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:35:20 user nova-compute[231753]: WARNING nova.compute.manager [req-ddf45284-ad17-4612-9036-cdba81144164 req-6c3a71e6-8c41-4462-91ee-aec763dcdc18 service nova] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Received unexpected event network-vif-plugged-353d55fe-9e9d-49c7-81ef-d210995d1190 for instance with vm_state building and task_state spawning.
Jul 29 13:35:20 user nova-compute[231753]: INFO nova.compute.manager [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Took 6.85 seconds to spawn the instance on the hypervisor.
Jul 29 13:35:20 user nova-compute[231753]: DEBUG nova.compute.manager [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:35:21 user nova-compute[231753]: DEBUG nova.network.neutron [req-dd43cfdd-a1ef-4b26-b462-032e01f81f8c req-25b18a0a-3bfb-49c6-bdd1-04a3da3a2da9 service nova] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Updated VIF entry in instance network info cache for port b66269be-ef4d-460f-9782-df3fc08e5450. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:35:21 user nova-compute[231753]: DEBUG nova.network.neutron [req-dd43cfdd-a1ef-4b26-b462-032e01f81f8c req-25b18a0a-3bfb-49c6-bdd1-04a3da3a2da9 service nova] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Updating instance_info_cache with network_info: [{"id": "b66269be-ef4d-460f-9782-df3fc08e5450", "address": "fa:16:3e:1f:36:42", "network": {"id": "2e7ef980-929c-4ea5-86b7-d69bcfa4a209", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1403711156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44867a8743214d32a94bca3506295e92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb66269be-ef", "ovs_interfaceid": "b66269be-ef4d-460f-9782-df3fc08e5450", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:35:21 user nova-compute[231753]: INFO nova.compute.manager [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Took 8.57 seconds to build instance.
Jul 29 13:35:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-dd43cfdd-a1ef-4b26-b462-032e01f81f8c req-25b18a0a-3bfb-49c6-bdd1-04a3da3a2da9 service nova] Releasing lock "refresh_cache-299b7f21-b198-437b-9d5c-1269d5e9b7c8" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:35:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2e639872-15d4-4847-87d6-793891700424 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lock "3d25aef1-5ef1-42a9-be32-1e26077f7b74" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.698s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kOAQPSKF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:35:22 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:35:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:35:22 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:35:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:35:22 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:35:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411 -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[307d9343-749f-48c8-92fb-78f485a59ee6]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:35:22 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411 -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0759322-2cfa-486f-a038-9129937dcc35]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411] added
Jul 29 13:35:22 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7800d3f9-5e88-4d58-8209-c504d8f0cd72]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c96eed1a-769b-4372-87a0-622bcbabeb33]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kOAQPSKF {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v kOAQPSKF" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[222c23ef-f1d9-4cce-8877-e0f2c734fd61]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'kOAQPSKF'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[1276a206-164f-46b1-93d1-d97c0d6ce4c8]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ab4531-0b2d-4383-a25d-bdb0ee59ddb8]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:35:22 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:35:22 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:35:22 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:35:22 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:35:22 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:35:22 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411 -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411 -p 172.16.0.220:3260 --login" returned: 0 in 0.075s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[df6dc060-a468-4462-ab4c-f56e453b0854]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411, portal: 172.16.0.220,3260]
Jul 29 13:35:22 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411, portal: 172.16.0.220,3260] successful.
Jul 29 13:35:22 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3464c84c-6aed-4ff1-bdb4-fdbb24653ca5]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[67dc1130-c0a7-40c4-9013-f1727c59256f]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:35:22 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:35:22 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:35:22 user nova-compute[231753]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411 (non-flash)
Jul 29 13:35:22 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:35:22 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:35:22 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:35:22 user nova-compute[231753]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411 (non-flash)
Jul 29 13:35:22 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.333s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] HCTL ('36', '-', '-', 0) found on session 5 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d06ae3-f114-4ce9-8b38-b5ebd5c00f47]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Searching for a device in session 5 and hctl ['36', '*', '*', 0] yield: sde {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kOAQPSKF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:35:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:23 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:35:23 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] <== connect_volume: return (1376ms) {'type': 'block', 'scsi_wwn': '23664636239656233', 'path': '/dev/sde'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:35:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23664636239656233', 'path': '/dev/sde'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:35:23 user nova-compute[231753]: DEBUG nova.objects.instance [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Lazy-loading 'flavor' on Instance uuid 29b21191-c874-4ca8-bd4b-2df90a41ccab {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:35:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 13:35:23 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:35:23 user nova-compute[231753]:   <source dev="/dev/sde"/>
Jul 29 13:35:23 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:35:23 user nova-compute[231753]:   <serial>55e89d6b-9f3a-4653-9230-5af0bc288411</serial>
Jul 29 13:35:23 user nova-compute[231753]: </disk>
Jul 29 13:35:23 user nova-compute[231753]:  {{(pid=231753) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 13:35:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:35:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] No BDM found with device name vdb, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:35:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] No VIF found with MAC fa:16:3e:64:b7:b5, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:35:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-a1911355-631a-4f5d-9bd2-70eacf7e57bc tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Lock "29b21191-c874-4ca8-bd4b-2df90a41ccab" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.783s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Acquiring lock "299b7f21-b198-437b-9d5c-1269d5e9b7c8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "299b7f21-b198-437b-9d5c-1269d5e9b7c8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:24 user nova-compute[231753]: DEBUG nova.objects.instance [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lazy-loading 'flavor' on Instance uuid 299b7f21-b198-437b-9d5c-1269d5e9b7c8 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:35:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "299b7f21-b198-437b-9d5c-1269d5e9b7c8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Acquiring lock "299b7f21-b198-437b-9d5c-1269d5e9b7c8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "299b7f21-b198-437b-9d5c-1269d5e9b7c8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:24 user nova-compute[231753]: INFO nova.compute.manager [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Attaching volume b126a577-46ad-404c-ad26-25c067bd81dc to /dev/vdb
Jul 29 13:35:24 user nova-compute[231753]: DEBUG os_brick.utils [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:35:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:24 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9936237-5f13-4208-8eb2-fc077d1a7391]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb946a1-0099-4bc8-9657-925427ccf14e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b65b43-57b2-4dcd-ab86-02a0605772ed]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4216b4a9-46a9-4e64-8f78-7146038f5339]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:35:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:35:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:35:25 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:35:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a69c921-0b76-4f41-ac64-56c7e7e9195e]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:35:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:35:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:35:25 user nova-compute[231753]: DEBUG os_brick.utils [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] <== get_connector_properties: return (213ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:35:25 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Updating existing volume attachment record: 5564327e-233b-4bd9-875f-bfefcd268bc3 {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:35:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Acquiring lock "29b21191-c874-4ca8-bd4b-2df90a41ccab" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Lock "29b21191-c874-4ca8-bd4b-2df90a41ccab" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Acquiring lock "29b21191-c874-4ca8-bd4b-2df90a41ccab-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Lock "29b21191-c874-4ca8-bd4b-2df90a41ccab-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Lock "29b21191-c874-4ca8-bd4b-2df90a41ccab-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:25 user nova-compute[231753]: INFO nova.compute.manager [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Terminating instance
Jul 29 13:35:25 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:35:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:26 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690637711.3115497, 4475f276-acc4-44f1-a5fa-6a7fb2165493 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:35:26 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] VM Stopped (Lifecycle Event)
Jul 29 13:35:26 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ed22dc58-5825-452e-a496-22858ee2a46f None None] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:35:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:26 user nova-compute[231753]: DEBUG nova.compute.manager [req-6749402a-c723-4de0-ab16-c0aaf4158a31 req-6adb75c8-a133-479c-8f16-b584c02dd31a service nova] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Received event network-vif-unplugged-8a79ae49-c97d-4110-bc3c-2d166db71e50 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:35:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6749402a-c723-4de0-ab16-c0aaf4158a31 req-6adb75c8-a133-479c-8f16-b584c02dd31a service nova] Acquiring lock "29b21191-c874-4ca8-bd4b-2df90a41ccab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6749402a-c723-4de0-ab16-c0aaf4158a31 req-6adb75c8-a133-479c-8f16-b584c02dd31a service nova] Lock "29b21191-c874-4ca8-bd4b-2df90a41ccab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6749402a-c723-4de0-ab16-c0aaf4158a31 req-6adb75c8-a133-479c-8f16-b584c02dd31a service nova] Lock "29b21191-c874-4ca8-bd4b-2df90a41ccab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:26 user nova-compute[231753]: DEBUG nova.compute.manager [req-6749402a-c723-4de0-ab16-c0aaf4158a31 req-6adb75c8-a133-479c-8f16-b584c02dd31a service nova] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] No waiting events found dispatching network-vif-unplugged-8a79ae49-c97d-4110-bc3c-2d166db71e50 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:35:26 user nova-compute[231753]: DEBUG nova.compute.manager [req-6749402a-c723-4de0-ab16-c0aaf4158a31 req-6adb75c8-a133-479c-8f16-b584c02dd31a service nova] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Received event network-vif-unplugged-8a79ae49-c97d-4110-bc3c-2d166db71e50 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:35:27 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Instance destroyed successfully.
Jul 29 13:35:27 user nova-compute[231753]: DEBUG nova.objects.instance [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Lazy-loading 'resources' on Instance uuid 29b21191-c874-4ca8-bd4b-2df90a41ccab {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:33:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-69582102',display_name='tempest-DeleteServersTestJSON-server-69582102',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-deleteserverstestjson-server-69582102',id=4,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:33:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='ce9dc2164ff54e37bb6ef76285c1a9ae',ramdisk_id='',reservation_id='r-o0moj0fr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-1837865141',owner_user_name='tempest-DeleteServersTestJSON-1837865141-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:33:35Z,user_data=None,user_id='3ccd0a728ae043b9b5448782692f56be',uuid=29b21191-c874-4ca8-bd4b-2df90a41ccab,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8a79ae49-c97d-4110-bc3c-2d166db71e50", "address": "fa:16:3e:64:b7:b5", "network": {"id": "de8c8e4e-6e79-4561-9e46-e50c218bcea7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-145029142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce9dc2164ff54e37bb6ef76285c1a9ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a79ae49-c9", "ovs_interfaceid": "8a79ae49-c97d-4110-bc3c-2d166db71e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Converting VIF {"id": "8a79ae49-c97d-4110-bc3c-2d166db71e50", "address": "fa:16:3e:64:b7:b5", "network": {"id": "de8c8e4e-6e79-4561-9e46-e50c218bcea7", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-145029142-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "ce9dc2164ff54e37bb6ef76285c1a9ae", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8a79ae49-c9", "ovs_interfaceid": "8a79ae49-c97d-4110-bc3c-2d166db71e50", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:64:b7:b5,bridge_name='br-int',has_traffic_filtering=True,id=8a79ae49-c97d-4110-bc3c-2d166db71e50,network=Network(de8c8e4e-6e79-4561-9e46-e50c218bcea7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a79ae49-c9') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG os_vif [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:b7:b5,bridge_name='br-int',has_traffic_filtering=True,id=8a79ae49-c97d-4110-bc3c-2d166db71e50,network=Network(de8c8e4e-6e79-4561-9e46-e50c218bcea7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a79ae49-c9') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8a79ae49-c9, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:35:27 user nova-compute[231753]: INFO os_vif [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:64:b7:b5,bridge_name='br-int',has_traffic_filtering=True,id=8a79ae49-c97d-4110-bc3c-2d166db71e50,network=Network(de8c8e4e-6e79-4561-9e46-e50c218bcea7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8a79ae49-c9')
Jul 29 13:35:27 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'kOAQPSKF', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:35:27 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:35:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c6da833-9df2-4267-bc46-33be408850d9]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:35:27 user nova-compute[231753]: No targets found.
Jul 29 13:35:27 user nova-compute[231753]: iSNS:
Jul 29 13:35:27 user nova-compute[231753]: No targets found.
Jul 29 13:35:27 user nova-compute[231753]: STATIC:
Jul 29 13:35:27 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008
Jul 29 13:35:27 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:35:27 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:35:27 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf
Jul 29 13:35:27 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:35:27 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:35:27 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411
Jul 29 13:35:27 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:35:27 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:35:27 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c
Jul 29 13:35:27 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:35:27 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:35:27 user nova-compute[231753]: FIRMWARE:
Jul 29 13:35:27 user nova-compute[231753]: No targets found.
Jul 29 13:35:27 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:35:27 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:35:27 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5686c9f9-f0d1-4bcd-b749-05a0c4277c2a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[52c65c21-47a7-42a5-8848-020ce9eb7f98]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)\ntcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:35:27 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:35:27 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:35:27 user nova-compute[231753]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411 (non-flash)
Jul 29 13:35:27 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:35:27 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:35:27 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:35:27 user nova-compute[231753]: tcp: [5] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411 (non-flash)
Jul 29 13:35:27 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c982ab1c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411'): ({'sde'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Removing single pathed devices sde {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b0ddb8-8ed7-4ce5-94a8-0387b523391e]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b69d59c0-879d-412e-b9ce-547f5a1ec35b]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Flushing IO for device /dev/sde {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.012s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[052364ff-89a0-4789-9fa3-81d2fa0b645f]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.035s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ba4cee-3969-40e4-a273-5932cff94ff2]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] SCSI volumes sde have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7114a7df-c24a-4ba0-a9b0-f486506fd63d]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411 -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411 -p 172.16.0.220:3260 --logout" returned: 0 in 0.084s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e8b2cae-1697-4408-ac91-ee5b80b331ac]: (4, ('Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411, portal: 172.16.0.220,3260]\nLogout of [sid: 5, target: iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411, portal: 172.16.0.220,3260]
Jul 29 13:35:27 user nova-compute[231753]: Logout of [sid: 5, target: iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411, portal: 172.16.0.220,3260] successful.
Jul 29 13:35:27 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411 -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55e89d6b-9f3a-4653-9230-5af0bc288411 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.027s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fbb1909-0201-48e7-85e5-6e914611de7c]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] <== disconnect_volume: return (332ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:35:27 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Deleting instance files /opt/stack/data/nova/instances/29b21191-c874-4ca8-bd4b-2df90a41ccab_del
Jul 29 13:35:27 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Deletion of /opt/stack/data/nova/instances/29b21191-c874-4ca8-bd4b-2df90a41ccab_del complete
Jul 29 13:35:27 user nova-compute[231753]: INFO nova.compute.manager [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Took 1.67 seconds to destroy the instance on the hypervisor.
Jul 29 13:35:27 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:35:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:28 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:35:28 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Took 0.84 seconds to deallocate network for instance.
Jul 29 13:35:28 user nova-compute[231753]: DEBUG nova.compute.manager [req-97c5f2dc-d7c3-4cf5-84db-7c96c0059123 req-587d9e8f-7c23-45c4-a3f3-60487a306075 service nova] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Received event network-vif-deleted-8a79ae49-c97d-4110-bc3c-2d166db71e50 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:35:28 user nova-compute[231753]: INFO nova.compute.manager [req-97c5f2dc-d7c3-4cf5-84db-7c96c0059123 req-587d9e8f-7c23-45c4-a3f3-60487a306075 service nova] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Neutron deleted interface 8a79ae49-c97d-4110-bc3c-2d166db71e50; detaching it from the instance and deleting it from the info cache
Jul 29 13:35:28 user nova-compute[231753]: DEBUG nova.network.neutron [req-97c5f2dc-d7c3-4cf5-84db-7c96c0059123 req-587d9e8f-7c23-45c4-a3f3-60487a306075 service nova] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:35:28 user nova-compute[231753]: DEBUG nova.compute.manager [req-97c5f2dc-d7c3-4cf5-84db-7c96c0059123 req-587d9e8f-7c23-45c4-a3f3-60487a306075 service nova] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Detach interface failed, port_id=8a79ae49-c97d-4110-bc3c-2d166db71e50, reason: Instance 29b21191-c874-4ca8-bd4b-2df90a41ccab could not be found. {{(pid=231753) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 13:35:28 user nova-compute[231753]: DEBUG nova.compute.manager [req-8fc9ab1d-9798-455d-add7-11a6fcbb441d req-15512e17-9f68-4f69-92fc-63d4626721a8 service nova] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Received event network-vif-plugged-8a79ae49-c97d-4110-bc3c-2d166db71e50 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:35:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8fc9ab1d-9798-455d-add7-11a6fcbb441d req-15512e17-9f68-4f69-92fc-63d4626721a8 service nova] Acquiring lock "29b21191-c874-4ca8-bd4b-2df90a41ccab-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8fc9ab1d-9798-455d-add7-11a6fcbb441d req-15512e17-9f68-4f69-92fc-63d4626721a8 service nova] Lock "29b21191-c874-4ca8-bd4b-2df90a41ccab-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8fc9ab1d-9798-455d-add7-11a6fcbb441d req-15512e17-9f68-4f69-92fc-63d4626721a8 service nova] Lock "29b21191-c874-4ca8-bd4b-2df90a41ccab-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:28 user nova-compute[231753]: DEBUG nova.compute.manager [req-8fc9ab1d-9798-455d-add7-11a6fcbb441d req-15512e17-9f68-4f69-92fc-63d4626721a8 service nova] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] No waiting events found dispatching network-vif-plugged-8a79ae49-c97d-4110-bc3c-2d166db71e50 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:35:28 user nova-compute[231753]: WARNING nova.compute.manager [req-8fc9ab1d-9798-455d-add7-11a6fcbb441d req-15512e17-9f68-4f69-92fc-63d4626721a8 service nova] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Received unexpected event network-vif-plugged-8a79ae49-c97d-4110-bc3c-2d166db71e50 for instance with vm_state active and task_state deleting.
Jul 29 13:35:29 user nova-compute[231753]: INFO nova.compute.manager [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Took 0.87 seconds to detach 1 volumes for instance.
Jul 29 13:35:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:29 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:35:29 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:35:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.351s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:29 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Deleted allocations for instance 29b21191-c874-4ca8-bd4b-2df90a41ccab
Jul 29 13:35:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ebdb4681-a27b-438c-ad7e-ee1a4654a9e2 tempest-DeleteServersTestJSON-1837865141 tempest-DeleteServersTestJSON-1837865141-project-member] Lock "29b21191-c874-4ca8-bd4b-2df90a41ccab" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.986s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YBlZgXGc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:35:33 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:35:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:35:33 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:35:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:35:33 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:35:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e9bb536-8fb6-4d88-8606-c01ad9f17187]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:35:33 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.027s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc6e5cd-95f5-45a0-8c9a-d572d156eefb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc] added
Jul 29 13:35:33 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ef46a69-d012-465e-bfa4-61b8329631ed]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[01308fe4-bb8f-47b9-b9bf-8a3c1cc506ca]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YBlZgXGc {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc -p 172.16.0.220:3260 --op update -n node.session.auth.username -v YBlZgXGc" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[944bd5a2-8744-49ba-a165-a5a89cb9313e]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'YBlZgXGc'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f16b5586-28ed-4115-85b7-72ca5913396c]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa644ca-f134-4f71-a7ba-55442d7bae44]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:35:33 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:35:33 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:35:33 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:35:33 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:35:33 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:35:33 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d96838a-9a75-4cf2-b4c5-f83bc4fe2288]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc, portal: 172.16.0.220,3260]
Jul 29 13:35:33 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc, portal: 172.16.0.220,3260] successful.
Jul 29 13:35:33 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b5d1c68-7526-49ea-a511-31764f9b7d42]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[488d4f67-b95e-4ac6-abf0-0cba8b2f6745]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:35:33 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:35:33 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:35:33 user nova-compute[231753]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc (non-flash)
Jul 29 13:35:33 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:35:33 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:35:33 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:35:33 user nova-compute[231753]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc (non-flash)
Jul 29 13:35:33 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.288s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] HCTL ('36', '-', '-', 0) found on session 6 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a462468-a925-4ae6-8cbf-5a9397fd5d66]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Searching for a device in session 6 and hctl ['36', '*', '*', 0] yield: sde {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:35:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YBlZgXGc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:35:34 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.321s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:35:34 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] <== connect_volume: return (1322ms) {'type': 'block', 'scsi_wwn': '26331346462306133', 'path': '/dev/sde'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:35:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26331346462306133', 'path': '/dev/sde'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:35:34 user nova-compute[231753]: DEBUG nova.objects.instance [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lazy-loading 'flavor' on Instance uuid 299b7f21-b198-437b-9d5c-1269d5e9b7c8 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:35:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 13:35:34 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:35:34 user nova-compute[231753]:   <source dev="/dev/sde"/>
Jul 29 13:35:34 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:35:34 user nova-compute[231753]:   <serial>b126a577-46ad-404c-ad26-25c067bd81dc</serial>
Jul 29 13:35:34 user nova-compute[231753]: </disk>
Jul 29 13:35:34 user nova-compute[231753]:  {{(pid=231753) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 13:35:35 user nova-compute[231753]: DEBUG nova.compute.manager [req-e0001447-a79f-4f7d-903a-476d111898fa req-d2d61067-daa1-4618-82a7-dd82265d6195 service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Received event network-changed-7881fb42-caac-4254-a8ef-16b49c754bf9 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:35:35 user nova-compute[231753]: DEBUG nova.compute.manager [req-e0001447-a79f-4f7d-903a-476d111898fa req-d2d61067-daa1-4618-82a7-dd82265d6195 service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Refreshing instance network info cache due to event network-changed-7881fb42-caac-4254-a8ef-16b49c754bf9. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:35:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e0001447-a79f-4f7d-903a-476d111898fa req-d2d61067-daa1-4618-82a7-dd82265d6195 service nova] Acquiring lock "refresh_cache-8822efe3-e17a-4511-b75f-37f6a83616aa" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:35:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e0001447-a79f-4f7d-903a-476d111898fa req-d2d61067-daa1-4618-82a7-dd82265d6195 service nova] Acquired lock "refresh_cache-8822efe3-e17a-4511-b75f-37f6a83616aa" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:35:35 user nova-compute[231753]: DEBUG nova.network.neutron [req-e0001447-a79f-4f7d-903a-476d111898fa req-d2d61067-daa1-4618-82a7-dd82265d6195 service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Refreshing network info cache for port 7881fb42-caac-4254-a8ef-16b49c754bf9 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:35:35 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:35:35 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] No BDM found with device name vdb, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:35:35 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] No VIF found with MAC fa:16:3e:1f:36:42, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:35:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4aaed2da-3724-458c-b105-9b42a174a0a0 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "299b7f21-b198-437b-9d5c-1269d5e9b7c8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.922s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:35 user nova-compute[231753]: DEBUG nova.network.neutron [req-e0001447-a79f-4f7d-903a-476d111898fa req-d2d61067-daa1-4618-82a7-dd82265d6195 service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Updated VIF entry in instance network info cache for port 7881fb42-caac-4254-a8ef-16b49c754bf9. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:35:35 user nova-compute[231753]: DEBUG nova.network.neutron [req-e0001447-a79f-4f7d-903a-476d111898fa req-d2d61067-daa1-4618-82a7-dd82265d6195 service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Updating instance_info_cache with network_info: [{"id": "7881fb42-caac-4254-a8ef-16b49c754bf9", "address": "fa:16:3e:3b:15:58", "network": {"id": "12eb887a-c8b0-4fa9-ad24-8dbd6632aa5b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1203369018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19ab44f715024188b10545aac4cbb675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7881fb42-ca", "ovs_interfaceid": "7881fb42-caac-4254-a8ef-16b49c754bf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:35:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e0001447-a79f-4f7d-903a-476d111898fa req-d2d61067-daa1-4618-82a7-dd82265d6195 service nova] Releasing lock "refresh_cache-8822efe3-e17a-4511-b75f-37f6a83616aa" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:35:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1df2573a-4540-4777-bdcf-9e7de4d51d5c tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Acquiring lock "interface-8822efe3-e17a-4511-b75f-37f6a83616aa-None" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1df2573a-4540-4777-bdcf-9e7de4d51d5c tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lock "interface-8822efe3-e17a-4511-b75f-37f6a83616aa-None" acquired by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:36 user nova-compute[231753]: DEBUG nova.objects.instance [None req-1df2573a-4540-4777-bdcf-9e7de4d51d5c tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lazy-loading 'flavor' on Instance uuid 8822efe3-e17a-4511-b75f-37f6a83616aa {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:35:36 user nova-compute[231753]: DEBUG nova.objects.instance [None req-1df2573a-4540-4777-bdcf-9e7de4d51d5c tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lazy-loading 'pci_requests' on Instance uuid 8822efe3-e17a-4511-b75f-37f6a83616aa {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:35:36 user nova-compute[231753]: DEBUG nova.network.neutron [None req-1df2573a-4540-4777-bdcf-9e7de4d51d5c tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:35:36 user nova-compute[231753]: DEBUG nova.policy [None req-1df2573a-4540-4777-bdcf-9e7de4d51d5c tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8de5c966bbb948499c560ea5ab63a960', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '19ab44f715024188b10545aac4cbb675', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:35:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:37 user nova-compute[231753]: DEBUG nova.network.neutron [None req-1df2573a-4540-4777-bdcf-9e7de4d51d5c tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Successfully created port: eb28874c-fe73-4b5c-a8b4-d352c32e08d5 {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:35:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c2061bb9-406f-4cfc-b177-f71c7a9d2e63 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Acquiring lock "299b7f21-b198-437b-9d5c-1269d5e9b7c8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c2061bb9-406f-4cfc-b177-f71c7a9d2e63 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "299b7f21-b198-437b-9d5c-1269d5e9b7c8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:37 user nova-compute[231753]: INFO nova.compute.manager [None req-c2061bb9-406f-4cfc-b177-f71c7a9d2e63 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Detaching volume b126a577-46ad-404c-ad26-25c067bd81dc
Jul 29 13:35:37 user nova-compute[231753]: INFO nova.virt.block_device [None req-c2061bb9-406f-4cfc-b177-f71c7a9d2e63 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Attempting to driver detach volume b126a577-46ad-404c-ad26-25c067bd81dc from mountpoint /dev/vdb
Jul 29 13:35:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c2061bb9-406f-4cfc-b177-f71c7a9d2e63 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Attempting to detach device vdb from instance 299b7f21-b198-437b-9d5c-1269d5e9b7c8 from the persistent domain config. {{(pid=231753) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 13:35:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-c2061bb9-406f-4cfc-b177-f71c7a9d2e63 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:35:37 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:35:37 user nova-compute[231753]:   <source dev="/dev/sde"/>
Jul 29 13:35:37 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:35:37 user nova-compute[231753]:   <serial>b126a577-46ad-404c-ad26-25c067bd81dc</serial>
Jul 29 13:35:37 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 13:35:37 user nova-compute[231753]: </disk>
Jul 29 13:35:37 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:35:37 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-c2061bb9-406f-4cfc-b177-f71c7a9d2e63 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Successfully detached device vdb from instance 299b7f21-b198-437b-9d5c-1269d5e9b7c8 from the persistent domain config.
Jul 29 13:35:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c2061bb9-406f-4cfc-b177-f71c7a9d2e63 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 299b7f21-b198-437b-9d5c-1269d5e9b7c8 from the live domain config. {{(pid=231753) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 13:35:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-c2061bb9-406f-4cfc-b177-f71c7a9d2e63 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:35:37 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:35:37 user nova-compute[231753]:   <source dev="/dev/sde"/>
Jul 29 13:35:37 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:35:37 user nova-compute[231753]:   <serial>b126a577-46ad-404c-ad26-25c067bd81dc</serial>
Jul 29 13:35:37 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 13:35:37 user nova-compute[231753]: </disk>
Jul 29 13:35:37 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:35:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Received event <DeviceRemovedEvent: 1690637737.9748302, 299b7f21-b198-437b-9d5c-1269d5e9b7c8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=231753) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 13:35:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c2061bb9-406f-4cfc-b177-f71c7a9d2e63 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 299b7f21-b198-437b-9d5c-1269d5e9b7c8 {{(pid=231753) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 13:35:37 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-c2061bb9-406f-4cfc-b177-f71c7a9d2e63 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Successfully detached device vdb from instance 299b7f21-b198-437b-9d5c-1269d5e9b7c8 from the live domain config.
Jul 29 13:35:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2061bb9-406f-4cfc-b177-f71c7a9d2e63 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:35:37 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2061bb9-406f-4cfc-b177-f71c7a9d2e63 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'YBlZgXGc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:35:37 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-c2061bb9-406f-4cfc-b177-f71c7a9d2e63 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:35:37 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-c2061bb9-406f-4cfc-b177-f71c7a9d2e63 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:35:37 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-c2061bb9-406f-4cfc-b177-f71c7a9d2e63 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:35:37 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d48ec0-399f-433a-93c9-b5aae8892e91]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:8f0deb31-afd4-4ece-b2be-625becfa3441\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2061bb9-406f-4cfc-b177-f71c7a9d2e63 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:35:38 user nova-compute[231753]: No targets found.
Jul 29 13:35:38 user nova-compute[231753]: iSNS:
Jul 29 13:35:38 user nova-compute[231753]: No targets found.
Jul 29 13:35:38 user nova-compute[231753]: STATIC:
Jul 29 13:35:38 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008
Jul 29 13:35:38 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:35:38 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:35:38 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf
Jul 29 13:35:38 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:35:38 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:35:38 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:8f0deb31-afd4-4ece-b2be-625becfa3441
Jul 29 13:35:38 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:35:38 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:35:38 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c
Jul 29 13:35:38 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:35:38 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:35:38 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc
Jul 29 13:35:38 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:35:38 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:35:38 user nova-compute[231753]: FIRMWARE:
Jul 29 13:35:38 user nova-compute[231753]: No targets found.
Jul 29 13:35:38 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2061bb9-406f-4cfc-b177-f71c7a9d2e63 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:35:38 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:35:38 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2061bb9-406f-4cfc-b177-f71c7a9d2e63 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG nova.network.neutron [None req-1df2573a-4540-4777-bdcf-9e7de4d51d5c tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Successfully updated port: eb28874c-fe73-4b5c-a8b4-d352c32e08d5 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1df2573a-4540-4777-bdcf-9e7de4d51d5c tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Acquiring lock "refresh_cache-8822efe3-e17a-4511-b75f-37f6a83616aa" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1df2573a-4540-4777-bdcf-9e7de4d51d5c tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Acquired lock "refresh_cache-8822efe3-e17a-4511-b75f-37f6a83616aa" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG nova.network.neutron [None req-1df2573a-4540-4777-bdcf-9e7de4d51d5c tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ca5bf3-bd33-4bce-98c9-a325f53b9886]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:8f0deb31-afd4-4ece-b2be-625becfa3441\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG nova.compute.manager [req-aff064b1-aeb9-468e-aadc-989b86170d05 req-24f42c99-c899-4adb-b4ec-2ec12c5deedb service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Received event network-changed-eb28874c-fe73-4b5c-a8b4-d352c32e08d5 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG nova.compute.manager [req-aff064b1-aeb9-468e-aadc-989b86170d05 req-24f42c99-c899-4adb-b4ec-2ec12c5deedb service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Refreshing instance network info cache due to event network-changed-eb28874c-fe73-4b5c-a8b4-d352c32e08d5. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-aff064b1-aeb9-468e-aadc-989b86170d05 req-24f42c99-c899-4adb-b4ec-2ec12c5deedb service nova] Acquiring lock "refresh_cache-8822efe3-e17a-4511-b75f-37f6a83616aa" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[549ab830-210a-4e97-859a-14bb8abc875a]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)\ntcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc (non-flash)\ntcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0deb31-afd4-4ece-b2be-625becfa3441 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2061bb9-406f-4cfc-b177-f71c7a9d2e63 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:35:38 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:35:38 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:35:38 user nova-compute[231753]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc (non-flash)
Jul 29 13:35:38 user nova-compute[231753]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0deb31-afd4-4ece-b2be-625becfa3441 (non-flash)
Jul 29 13:35:38 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2061bb9-406f-4cfc-b177-f71c7a9d2e63 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:35:38 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:35:38 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:35:38 user nova-compute[231753]: tcp: [6] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc (non-flash)
Jul 29 13:35:38 user nova-compute[231753]: tcp: [7] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:8f0deb31-afd4-4ece-b2be-625becfa3441 (non-flash)
Jul 29 13:35:38 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2061bb9-406f-4cfc-b177-f71c7a9d2e63 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c9832b0a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc'): ({'sde'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-c2061bb9-406f-4cfc-b177-f71c7a9d2e63 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Removing single pathed devices sde {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ccd3028-500a-4a25-9133-61c8faef601a]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[be4e777a-ccdf-481a-942d-f2fcb90dae0f]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-c2061bb9-406f-4cfc-b177-f71c7a9d2e63 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Flushing IO for device /dev/sde {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.014s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a6cb5d8-aac1-44ec-b8c4-617b4cf1144c]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-c2061bb9-406f-4cfc-b177-f71c7a9d2e63 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.055s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2ce241-ae7b-4b83-8e56-79e23e5d7626]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-c2061bb9-406f-4cfc-b177-f71c7a9d2e63 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-c2061bb9-406f-4cfc-b177-f71c7a9d2e63 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] SCSI volumes sde have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2061bb9-406f-4cfc-b177-f71c7a9d2e63 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[604505e5-2b51-4eca-9c3b-6d4796056803]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2061bb9-406f-4cfc-b177-f71c7a9d2e63 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[deddde2a-0a20-4fd6-a2b8-62c868ae7930]: (4, ('Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc, portal: 172.16.0.220,3260]\nLogout of [sid: 6, target: iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2061bb9-406f-4cfc-b177-f71c7a9d2e63 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc, portal: 172.16.0.220,3260]
Jul 29 13:35:38 user nova-compute[231753]: Logout of [sid: 6, target: iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc, portal: 172.16.0.220,3260] successful.
Jul 29 13:35:38 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b126a577-46ad-404c-ad26-25c067bd81dc -p 172.16.0.220:3260 --op delete" returned: 0 in 0.034s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[449cd21d-eb54-42f8-ae33-c68ccc975288]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2061bb9-406f-4cfc-b177-f71c7a9d2e63 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-c2061bb9-406f-4cfc-b177-f71c7a9d2e63 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.352s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2061bb9-406f-4cfc-b177-f71c7a9d2e63 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] <== disconnect_volume: return (353ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:35:38 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2061bb9-406f-4cfc-b177-f71c7a9d2e63 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:35:39 user nova-compute[231753]: DEBUG nova.objects.instance [None req-c2061bb9-406f-4cfc-b177-f71c7a9d2e63 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lazy-loading 'flavor' on Instance uuid 299b7f21-b198-437b-9d5c-1269d5e9b7c8 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:35:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c2061bb9-406f-4cfc-b177-f71c7a9d2e63 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "299b7f21-b198-437b-9d5c-1269d5e9b7c8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.828s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:39 user nova-compute[231753]: DEBUG nova.network.neutron [None req-1df2573a-4540-4777-bdcf-9e7de4d51d5c tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Updating instance_info_cache with network_info: [{"id": "7881fb42-caac-4254-a8ef-16b49c754bf9", "address": "fa:16:3e:3b:15:58", "network": {"id": "12eb887a-c8b0-4fa9-ad24-8dbd6632aa5b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1203369018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19ab44f715024188b10545aac4cbb675", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7881fb42-ca", "ovs_interfaceid": "7881fb42-caac-4254-a8ef-16b49c754bf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb28874c-fe73-4b5c-a8b4-d352c32e08d5", "address": "fa:16:3e:2a:1d:cc", "network": {"id": "5986b25c-ca33-46df-8954-3050d4e83f6c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-86069326", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "19ab44f715024188b10545aac4cbb675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb28874c-fe", "ovs_interfaceid": "eb28874c-fe73-4b5c-a8b4-d352c32e08d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:35:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1df2573a-4540-4777-bdcf-9e7de4d51d5c tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Releasing lock "refresh_cache-8822efe3-e17a-4511-b75f-37f6a83616aa" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:35:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-aff064b1-aeb9-468e-aadc-989b86170d05 req-24f42c99-c899-4adb-b4ec-2ec12c5deedb service nova] Acquired lock "refresh_cache-8822efe3-e17a-4511-b75f-37f6a83616aa" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:35:39 user nova-compute[231753]: DEBUG nova.network.neutron [req-aff064b1-aeb9-468e-aadc-989b86170d05 req-24f42c99-c899-4adb-b4ec-2ec12c5deedb service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Refreshing network info cache for port eb28874c-fe73-4b5c-a8b4-d352c32e08d5 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:35:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-1df2573a-4540-4777-bdcf-9e7de4d51d5c tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:33:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1148074335',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1148074335',id=7,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0HnOcJSL5x0Tr4fe2VLkk8m+fQM2IcJ8g4N204I22r+/diZGGnEBXWHFX48Vhdy9jagxGQAFJRzYCdQHRK29zwqPTQRGmMCigLgYVfxtAv5zkyNXnhJGzjicINXHWlNA==',key_name='tempest-keypair-833006828',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:33:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='19ab44f715024188b10545aac4cbb675',ramdisk_id='',reservation_id='r-z1bc9xqi',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1208246720',owner_user_name='tempest-TaggedAttachmentsTest-1208246720-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:33:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8de5c966bbb948499c560ea5ab63a960',uuid=8822efe3-e17a-4511-b75f-37f6a83616aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb28874c-fe73-4b5c-a8b4-d352c32e08d5", "address": "fa:16:3e:2a:1d:cc", "network": {"id": "5986b25c-ca33-46df-8954-3050d4e83f6c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-86069326", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "19ab44f715024188b10545aac4cbb675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb28874c-fe", "ovs_interfaceid": "eb28874c-fe73-4b5c-a8b4-d352c32e08d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:35:39 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-1df2573a-4540-4777-bdcf-9e7de4d51d5c tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Converting VIF {"id": "eb28874c-fe73-4b5c-a8b4-d352c32e08d5", "address": "fa:16:3e:2a:1d:cc", "network": {"id": "5986b25c-ca33-46df-8954-3050d4e83f6c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-86069326", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "19ab44f715024188b10545aac4cbb675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb28874c-fe", "ovs_interfaceid": "eb28874c-fe73-4b5c-a8b4-d352c32e08d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:35:39 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-1df2573a-4540-4777-bdcf-9e7de4d51d5c tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:1d:cc,bridge_name='br-int',has_traffic_filtering=True,id=eb28874c-fe73-4b5c-a8b4-d352c32e08d5,network=Network(5986b25c-ca33-46df-8954-3050d4e83f6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb28874c-fe') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:35:39 user nova-compute[231753]: DEBUG os_vif [None req-1df2573a-4540-4777-bdcf-9e7de4d51d5c tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:1d:cc,bridge_name='br-int',has_traffic_filtering=True,id=eb28874c-fe73-4b5c-a8b4-d352c32e08d5,network=Network(5986b25c-ca33-46df-8954-3050d4e83f6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb28874c-fe') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:35:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:35:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:35:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeb28874c-fe, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:35:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeb28874c-fe, col_values=(('external_ids', {'iface-id': 'eb28874c-fe73-4b5c-a8b4-d352c32e08d5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2a:1d:cc', 'vm-uuid': '8822efe3-e17a-4511-b75f-37f6a83616aa'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:35:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:35:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:39 user nova-compute[231753]: INFO os_vif [None req-1df2573a-4540-4777-bdcf-9e7de4d51d5c tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:1d:cc,bridge_name='br-int',has_traffic_filtering=True,id=eb28874c-fe73-4b5c-a8b4-d352c32e08d5,network=Network(5986b25c-ca33-46df-8954-3050d4e83f6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb28874c-fe')
Jul 29 13:35:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-1df2573a-4540-4777-bdcf-9e7de4d51d5c tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:33:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1148074335',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1148074335',id=7,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0HnOcJSL5x0Tr4fe2VLkk8m+fQM2IcJ8g4N204I22r+/diZGGnEBXWHFX48Vhdy9jagxGQAFJRzYCdQHRK29zwqPTQRGmMCigLgYVfxtAv5zkyNXnhJGzjicINXHWlNA==',key_name='tempest-keypair-833006828',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:33:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='19ab44f715024188b10545aac4cbb675',ramdisk_id='',reservation_id='r-z1bc9xqi',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1208246720',owner_user_name='tempest-TaggedAttachmentsTest-1208246720-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:33:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8de5c966bbb948499c560ea5ab63a960',uuid=8822efe3-e17a-4511-b75f-37f6a83616aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb28874c-fe73-4b5c-a8b4-d352c32e08d5", "address": "fa:16:3e:2a:1d:cc", "network": {"id": "5986b25c-ca33-46df-8954-3050d4e83f6c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-86069326", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "19ab44f715024188b10545aac4cbb675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb28874c-fe", "ovs_interfaceid": "eb28874c-fe73-4b5c-a8b4-d352c32e08d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:35:39 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-1df2573a-4540-4777-bdcf-9e7de4d51d5c tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Converting VIF {"id": "eb28874c-fe73-4b5c-a8b4-d352c32e08d5", "address": "fa:16:3e:2a:1d:cc", "network": {"id": "5986b25c-ca33-46df-8954-3050d4e83f6c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-86069326", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "19ab44f715024188b10545aac4cbb675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb28874c-fe", "ovs_interfaceid": "eb28874c-fe73-4b5c-a8b4-d352c32e08d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:35:39 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-1df2573a-4540-4777-bdcf-9e7de4d51d5c tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:1d:cc,bridge_name='br-int',has_traffic_filtering=True,id=eb28874c-fe73-4b5c-a8b4-d352c32e08d5,network=Network(5986b25c-ca33-46df-8954-3050d4e83f6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb28874c-fe') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:35:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-1df2573a-4540-4777-bdcf-9e7de4d51d5c tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] attach device xml: <interface type="ethernet">
Jul 29 13:35:39 user nova-compute[231753]:   <mac address="fa:16:3e:2a:1d:cc"/>
Jul 29 13:35:39 user nova-compute[231753]:   <model type="virtio"/>
Jul 29 13:35:39 user nova-compute[231753]:   <mtu size="1442"/>
Jul 29 13:35:39 user nova-compute[231753]:   <target dev="tapeb28874c-fe"/>
Jul 29 13:35:39 user nova-compute[231753]: </interface>
Jul 29 13:35:39 user nova-compute[231753]:  {{(pid=231753) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 13:35:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-1df2573a-4540-4777-bdcf-9e7de4d51d5c tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-1df2573a-4540-4777-bdcf-9e7de4d51d5c tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] No BDM found with device name hda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-1df2573a-4540-4777-bdcf-9e7de4d51d5c tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] No VIF found with MAC fa:16:3e:3b:15:58, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG nova.compute.manager [req-e8c36c58-e464-49d9-8c0d-1a6abc868e92 req-f4bf0d92-8c6c-4eaf-9dc2-546553c94aa0 service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Received event network-vif-plugged-eb28874c-fe73-4b5c-a8b4-d352c32e08d5 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e8c36c58-e464-49d9-8c0d-1a6abc868e92 req-f4bf0d92-8c6c-4eaf-9dc2-546553c94aa0 service nova] Acquiring lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e8c36c58-e464-49d9-8c0d-1a6abc868e92 req-f4bf0d92-8c6c-4eaf-9dc2-546553c94aa0 service nova] Lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e8c36c58-e464-49d9-8c0d-1a6abc868e92 req-f4bf0d92-8c6c-4eaf-9dc2-546553c94aa0 service nova] Lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG nova.compute.manager [req-e8c36c58-e464-49d9-8c0d-1a6abc868e92 req-f4bf0d92-8c6c-4eaf-9dc2-546553c94aa0 service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] No waiting events found dispatching network-vif-plugged-eb28874c-fe73-4b5c-a8b4-d352c32e08d5 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:35:40 user nova-compute[231753]: WARNING nova.compute.manager [req-e8c36c58-e464-49d9-8c0d-1a6abc868e92 req-f4bf0d92-8c6c-4eaf-9dc2-546553c94aa0 service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Received unexpected event network-vif-plugged-eb28874c-fe73-4b5c-a8b4-d352c32e08d5 for instance with vm_state active and task_state None.
Jul 29 13:35:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-1df2573a-4540-4777-bdcf-9e7de4d51d5c tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:35:40 user nova-compute[231753]:   <nova:package version="0.0.0"/>
Jul 29 13:35:40 user nova-compute[231753]:   <nova:name>tempest-device-tagging-server-1148074335</nova:name>
Jul 29 13:35:40 user nova-compute[231753]:   <nova:creationTime>2023-07-29 13:35:40</nova:creationTime>
Jul 29 13:35:40 user nova-compute[231753]:   <nova:flavor name="m1.tiny">
Jul 29 13:35:40 user nova-compute[231753]:     <nova:memory>512</nova:memory>
Jul 29 13:35:40 user nova-compute[231753]:     <nova:disk>1</nova:disk>
Jul 29 13:35:40 user nova-compute[231753]:     <nova:swap>0</nova:swap>
Jul 29 13:35:40 user nova-compute[231753]:     <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:35:40 user nova-compute[231753]:     <nova:vcpus>1</nova:vcpus>
Jul 29 13:35:40 user nova-compute[231753]:   </nova:flavor>
Jul 29 13:35:40 user nova-compute[231753]:   <nova:owner>
Jul 29 13:35:40 user nova-compute[231753]:     <nova:user uuid="8de5c966bbb948499c560ea5ab63a960">tempest-TaggedAttachmentsTest-1208246720-project-member</nova:user>
Jul 29 13:35:40 user nova-compute[231753]:     <nova:project uuid="19ab44f715024188b10545aac4cbb675">tempest-TaggedAttachmentsTest-1208246720</nova:project>
Jul 29 13:35:40 user nova-compute[231753]:   </nova:owner>
Jul 29 13:35:40 user nova-compute[231753]:   <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:35:40 user nova-compute[231753]:   <nova:ports>
Jul 29 13:35:40 user nova-compute[231753]:     <nova:port uuid="7881fb42-caac-4254-a8ef-16b49c754bf9">
Jul 29 13:35:40 user nova-compute[231753]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 29 13:35:40 user nova-compute[231753]:     </nova:port>
Jul 29 13:35:40 user nova-compute[231753]:     <nova:port uuid="eb28874c-fe73-4b5c-a8b4-d352c32e08d5">
Jul 29 13:35:40 user nova-compute[231753]:       <nova:ip type="fixed" address="10.10.10.152" ipVersion="4"/>
Jul 29 13:35:40 user nova-compute[231753]:     </nova:port>
Jul 29 13:35:40 user nova-compute[231753]:   </nova:ports>
Jul 29 13:35:40 user nova-compute[231753]: </nova:instance>
Jul 29 13:35:40 user nova-compute[231753]:  {{(pid=231753) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1df2573a-4540-4777-bdcf-9e7de4d51d5c tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lock "interface-8822efe3-e17a-4511-b75f-37f6a83616aa-None" "released" by "nova.compute.manager.ComputeManager.attach_interface.<locals>.do_attach_interface" :: held 4.153s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG nova.compute.manager [req-7b451a0f-08b9-4e6c-b072-72004a85ec37 req-29096f98-d3e2-49fe-8f18-69aaee93243a service nova] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Received event network-changed-c6299ccb-7770-4eaf-8e2e-ecea8da9f324 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG nova.compute.manager [req-7b451a0f-08b9-4e6c-b072-72004a85ec37 req-29096f98-d3e2-49fe-8f18-69aaee93243a service nova] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Refreshing instance network info cache due to event network-changed-c6299ccb-7770-4eaf-8e2e-ecea8da9f324. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7b451a0f-08b9-4e6c-b072-72004a85ec37 req-29096f98-d3e2-49fe-8f18-69aaee93243a service nova] Acquiring lock "refresh_cache-b02ec16d-24a3-450d-858d-3ad302086ac3" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7b451a0f-08b9-4e6c-b072-72004a85ec37 req-29096f98-d3e2-49fe-8f18-69aaee93243a service nova] Acquired lock "refresh_cache-b02ec16d-24a3-450d-858d-3ad302086ac3" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG nova.network.neutron [req-7b451a0f-08b9-4e6c-b072-72004a85ec37 req-29096f98-d3e2-49fe-8f18-69aaee93243a service nova] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Refreshing network info cache for port c6299ccb-7770-4eaf-8e2e-ecea8da9f324 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG nova.network.neutron [req-aff064b1-aeb9-468e-aadc-989b86170d05 req-24f42c99-c899-4adb-b4ec-2ec12c5deedb service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Updated VIF entry in instance network info cache for port eb28874c-fe73-4b5c-a8b4-d352c32e08d5. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG nova.network.neutron [req-aff064b1-aeb9-468e-aadc-989b86170d05 req-24f42c99-c899-4adb-b4ec-2ec12c5deedb service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Updating instance_info_cache with network_info: [{"id": "7881fb42-caac-4254-a8ef-16b49c754bf9", "address": "fa:16:3e:3b:15:58", "network": {"id": "12eb887a-c8b0-4fa9-ad24-8dbd6632aa5b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1203369018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19ab44f715024188b10545aac4cbb675", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7881fb42-ca", "ovs_interfaceid": "7881fb42-caac-4254-a8ef-16b49c754bf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "eb28874c-fe73-4b5c-a8b4-d352c32e08d5", "address": "fa:16:3e:2a:1d:cc", "network": {"id": "5986b25c-ca33-46df-8954-3050d4e83f6c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-86069326", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "19ab44f715024188b10545aac4cbb675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb28874c-fe", "ovs_interfaceid": "eb28874c-fe73-4b5c-a8b4-d352c32e08d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-aff064b1-aeb9-468e-aadc-989b86170d05 req-24f42c99-c899-4adb-b4ec-2ec12c5deedb service nova] Releasing lock "refresh_cache-8822efe3-e17a-4511-b75f-37f6a83616aa" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Acquiring lock "b02ec16d-24a3-450d-858d-3ad302086ac3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Lock "b02ec16d-24a3-450d-858d-3ad302086ac3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG nova.objects.instance [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Lazy-loading 'flavor' on Instance uuid b02ec16d-24a3-450d-858d-3ad302086ac3 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Lock "b02ec16d-24a3-450d-858d-3ad302086ac3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.079s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Acquiring lock "8822efe3-e17a-4511-b75f-37f6a83616aa" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lock "8822efe3-e17a-4511-b75f-37f6a83616aa" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG nova.objects.instance [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lazy-loading 'flavor' on Instance uuid 8822efe3-e17a-4511-b75f-37f6a83616aa {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lock "8822efe3-e17a-4511-b75f-37f6a83616aa" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Acquiring lock "b02ec16d-24a3-450d-858d-3ad302086ac3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Lock "b02ec16d-24a3-450d-858d-3ad302086ac3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:40 user nova-compute[231753]: INFO nova.compute.manager [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Attaching volume a8f01b66-d2ac-4dae-99f7-04556527fb6d to /dev/vdb
Jul 29 13:35:40 user nova-compute[231753]: DEBUG os_brick.utils [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Acquiring lock "8822efe3-e17a-4511-b75f-37f6a83616aa" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lock "8822efe3-e17a-4511-b75f-37f6a83616aa" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:40 user nova-compute[231753]: INFO nova.compute.manager [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Attaching volume 59f32c81-8bc1-426c-9f61-a1678ca599b6 to /dev/vdb
Jul 29 13:35:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[339d681a-3818-4fa1-a87d-6e3a94c87cd8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ad2f171-116b-4634-9a1b-14a8dc2b1c04]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba6308fc-621c-48ff-b672-f7cfaeb671c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0689ecde-046b-4fcf-85b7-5a2460087e4e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG os_brick.utils [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG nova.network.neutron [req-7b451a0f-08b9-4e6c-b072-72004a85ec37 req-29096f98-d3e2-49fe-8f18-69aaee93243a service nova] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Updated VIF entry in instance network info cache for port c6299ccb-7770-4eaf-8e2e-ecea8da9f324. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:35:40 user nova-compute[231753]: DEBUG nova.network.neutron [req-7b451a0f-08b9-4e6c-b072-72004a85ec37 req-29096f98-d3e2-49fe-8f18-69aaee93243a service nova] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Updating instance_info_cache with network_info: [{"id": "c6299ccb-7770-4eaf-8e2e-ecea8da9f324", "address": "fa:16:3e:8d:e7:c6", "network": {"id": "b41abe8c-4b7a-43eb-be54-286ef7161f43", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1689635352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8ee7b983944e2abe660fffe40b274c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6299ccb-77", "ovs_interfaceid": "c6299ccb-7770-4eaf-8e2e-ecea8da9f324", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:35:41 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:35:41 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:41 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7b451a0f-08b9-4e6c-b072-72004a85ec37 req-29096f98-d3e2-49fe-8f18-69aaee93243a service nova] Releasing lock "refresh_cache-b02ec16d-24a3-450d-858d-3ad302086ac3" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:35:41 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:41 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6415ce-59a5-4b16-87c3-19476a69555b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:41 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:41 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:35:41 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:35:41 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a40dcdf7-05fc-43aa-95e4-b07adc0688af]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:41 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:35:41 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:35:41 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:35:41 user nova-compute[231753]: DEBUG os_brick.utils [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:35:41 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Updating existing volume attachment record: d05a74f4-2359-4d47-9024-3c71a2c1c439 {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:35:41 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:41 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[37e3dc8b-c839-4036-a4dc-e95334f309d9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:41 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:41 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:41 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d7e1e71-fc6e-4b5e-a00e-b9ae73ef671d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:41 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[394559b1-586e-4b00-94fe-ae8732c58209]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:41 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:41 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:35:41 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:35:41 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:41 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:35:41 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:35:41 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0687d152-0d23-4456-871e-7a13b177e76b]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:41 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:35:41 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:35:41 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:35:41 user nova-compute[231753]: DEBUG os_brick.utils [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] <== get_connector_properties: return (138ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:35:41 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Updating existing volume attachment record: 16708d6d-8da3-496e-870b-466f88e17e5a {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:35:42 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690637727.024968, 29b21191-c874-4ca8-bd4b-2df90a41ccab => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:35:42 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] VM Stopped (Lifecycle Event)
Jul 29 13:35:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-82938514-5629-4511-a9a2-24fc4e0e70d3 None None] [instance: 29b21191-c874-4ca8-bd4b-2df90a41ccab] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:35:42 user nova-compute[231753]: DEBUG nova.compute.manager [req-e20ccdad-4e90-4dec-be8d-cdcd0836cd9a req-2db44623-8a02-4e57-bd70-e3473f2e6d60 service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Received event network-vif-plugged-eb28874c-fe73-4b5c-a8b4-d352c32e08d5 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:35:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e20ccdad-4e90-4dec-be8d-cdcd0836cd9a req-2db44623-8a02-4e57-bd70-e3473f2e6d60 service nova] Acquiring lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e20ccdad-4e90-4dec-be8d-cdcd0836cd9a req-2db44623-8a02-4e57-bd70-e3473f2e6d60 service nova] Lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e20ccdad-4e90-4dec-be8d-cdcd0836cd9a req-2db44623-8a02-4e57-bd70-e3473f2e6d60 service nova] Lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:42 user nova-compute[231753]: DEBUG nova.compute.manager [req-e20ccdad-4e90-4dec-be8d-cdcd0836cd9a req-2db44623-8a02-4e57-bd70-e3473f2e6d60 service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] No waiting events found dispatching network-vif-plugged-eb28874c-fe73-4b5c-a8b4-d352c32e08d5 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:35:42 user nova-compute[231753]: WARNING nova.compute.manager [req-e20ccdad-4e90-4dec-be8d-cdcd0836cd9a req-2db44623-8a02-4e57-bd70-e3473f2e6d60 service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Received unexpected event network-vif-plugged-eb28874c-fe73-4b5c-a8b4-d352c32e08d5 for instance with vm_state active and task_state None.
Jul 29 13:35:42 user nova-compute[231753]: DEBUG nova.compute.manager [req-b87d1d98-e049-46a4-9d92-fc457ff2dff6 req-47149a6f-cd68-4e4d-a54f-1705f128529a service nova] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Received event network-changed-123e72ae-5ed8-4181-bef2-28713da2545a {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:35:42 user nova-compute[231753]: DEBUG nova.compute.manager [req-b87d1d98-e049-46a4-9d92-fc457ff2dff6 req-47149a6f-cd68-4e4d-a54f-1705f128529a service nova] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Refreshing instance network info cache due to event network-changed-123e72ae-5ed8-4181-bef2-28713da2545a. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:35:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b87d1d98-e049-46a4-9d92-fc457ff2dff6 req-47149a6f-cd68-4e4d-a54f-1705f128529a service nova] Acquiring lock "refresh_cache-1be12e63-8803-4ffa-82e1-2fe38f6b5d2d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:35:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b87d1d98-e049-46a4-9d92-fc457ff2dff6 req-47149a6f-cd68-4e4d-a54f-1705f128529a service nova] Acquired lock "refresh_cache-1be12e63-8803-4ffa-82e1-2fe38f6b5d2d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:35:42 user nova-compute[231753]: DEBUG nova.network.neutron [req-b87d1d98-e049-46a4-9d92-fc457ff2dff6 req-47149a6f-cd68-4e4d-a54f-1705f128529a service nova] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Refreshing network info cache for port 123e72ae-5ed8-4181-bef2-28713da2545a {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:35:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:42 user nova-compute[231753]: DEBUG nova.network.neutron [req-b87d1d98-e049-46a4-9d92-fc457ff2dff6 req-47149a6f-cd68-4e4d-a54f-1705f128529a service nova] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Updated VIF entry in instance network info cache for port 123e72ae-5ed8-4181-bef2-28713da2545a. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:35:42 user nova-compute[231753]: DEBUG nova.network.neutron [req-b87d1d98-e049-46a4-9d92-fc457ff2dff6 req-47149a6f-cd68-4e4d-a54f-1705f128529a service nova] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Updating instance_info_cache with network_info: [{"id": "123e72ae-5ed8-4181-bef2-28713da2545a", "address": "fa:16:3e:bc:36:c7", "network": {"id": "be6b68b0-c543-441a-a338-deabdf4d97f6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1540506582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98859b41061e45e1a920f57c36b4479f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123e72ae-5e", "ovs_interfaceid": "123e72ae-5ed8-4181-bef2-28713da2545a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:35:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b87d1d98-e049-46a4-9d92-fc457ff2dff6 req-47149a6f-cd68-4e4d-a54f-1705f128529a service nova] Releasing lock "refresh_cache-1be12e63-8803-4ffa-82e1-2fe38f6b5d2d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:35:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Acquiring lock "1be12e63-8803-4ffa-82e1-2fe38f6b5d2d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Lock "1be12e63-8803-4ffa-82e1-2fe38f6b5d2d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:45 user nova-compute[231753]: DEBUG nova.objects.instance [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Lazy-loading 'flavor' on Instance uuid 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:35:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Lock "1be12e63-8803-4ffa-82e1-2fe38f6b5d2d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Acquiring lock "1be12e63-8803-4ffa-82e1-2fe38f6b5d2d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Lock "1be12e63-8803-4ffa-82e1-2fe38f6b5d2d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:46 user nova-compute[231753]: INFO nova.compute.manager [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Attaching volume 4bfc4bb7-4040-4e54-b579-0dce72c639c6 to /dev/sdc
Jul 29 13:35:46 user nova-compute[231753]: DEBUG os_brick.utils [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:35:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:46 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e728d5ea-6179-4df6-a229-dc349853fff1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:46 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4052d792-0d03-4d57-82bf-839b0a8d3ec7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:46 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4fc9da4-71bc-47a4-8b99-9a6315dcbeba]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:46 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[95dda47c-c360-4fbd-a4cc-6b6e3a782f37]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:35:46 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:35:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:35:46 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:35:46 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e6a3cbd-01f7-4f56-bbf8-8853c53a2395]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:46 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:35:46 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:35:46 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:35:46 user nova-compute[231753]: DEBUG os_brick.utils [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:35:46 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Updating existing volume attachment record: 1c815e42-0f96-4a09-9240-79d9822f77e9 {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:35:47 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:35:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SWZqXMbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:35:48 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:35:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:35:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:35:48 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:35:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:35:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:35:48 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:35:48 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:48 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:48 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9386d7b7-6ad1-49ca-8f63-d71c866e4ee7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:35:48 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:48 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e775316-937d-4955-b9c8-daf802736780]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d] added
Jul 29 13:35:49 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9040f250-7d63-4d5e-bb92-21aae9b257f5]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f78acf2-4920-4da6-b16c-648a0b1150d9]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SWZqXMbc {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SWZqXMbc" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[141c7df9-6c2b-4220-925c-a2128f594078]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SWZqXMbc'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b6b90f-4e1b-4719-ad76-707b0087c155]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e88bff6-336a-49fd-8145-cffb7b62c14d]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:35:49 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:35:49 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:35:49 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:35:49 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:35:49 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:35:49 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1aebc3-bb76-45ac-82a1-a038726808ed]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d, portal: 172.16.0.220,3260]
Jul 29 13:35:49 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d, portal: 172.16.0.220,3260] successful.
Jul 29 13:35:49 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[814b825a-0d60-4089-8fce-7b2f8bac9656]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee3bd72-efd9-42ec-8ed4-e29977d7b1f7]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:35:49 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:35:49 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:35:49 user nova-compute[231753]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)
Jul 29 13:35:49 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:35:49 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:35:49 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:35:49 user nova-compute[231753]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)
Jul 29 13:35:49 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.279s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] HCTL ('36', '-', '-', 0) found on session 8 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc6acc22-609c-42fe-af6f-da0845a1609f]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Searching for a device in session 8 and hctl ['36', '*', '*', 0] yield: None {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:35:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Searching for a device in session 8 and hctl ['36', '*', '*', 0] yield: sde {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SWZqXMbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23634366334306637', 'path': '/dev/sde'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634366334306637', 'path': '/dev/sde'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LrScQxda', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:35:50 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:35:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:35:50 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:35:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:35:50 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:35:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6 -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG nova.objects.instance [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Lazy-loading 'flavor' on Instance uuid b02ec16d-24a3-450d-858d-3ad302086ac3 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[39b76d21-21a1-4112-825b-64f93457b70a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:35:50 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6 -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 13:35:50 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:35:50 user nova-compute[231753]:   <source dev="/dev/sde"/>
Jul 29 13:35:50 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:35:50 user nova-compute[231753]:   <serial>a8f01b66-d2ac-4dae-99f7-04556527fb6d</serial>
Jul 29 13:35:50 user nova-compute[231753]: </disk>
Jul 29 13:35:50 user nova-compute[231753]:  {{(pid=231753) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f9c286-436c-4ad4-a9d9-383d077f71be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6] added
Jul 29 13:35:50 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[da052e5d-9246-444d-bb9e-76aa8b8d18e3]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[47eb0c69-8cbc-4e70-86d2-b42fc76abc95]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LrScQxda {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LrScQxda" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[caaf136d-f04f-413f-9d20-610022c4a644]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LrScQxda'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd822e1e-1ea8-4ae8-a548-f8a031e0f3f1]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[90ce7364-e61e-4f3c-bed1-ab68a689cddb]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:35:50 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:35:50 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:35:50 user nova-compute[231753]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)
Jul 29 13:35:50 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:35:50 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:35:50 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:35:50 user nova-compute[231753]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)
Jul 29 13:35:50 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6 -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6 -p 172.16.0.220:3260 --login" returned: 0 in 0.087s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa56488-b09e-477c-a7ed-52b4c843ff60]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6, portal: 172.16.0.220,3260]
Jul 29 13:35:50 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6, portal: 172.16.0.220,3260] successful.
Jul 29 13:35:50 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdff990b-2ffa-4e84-b4bf-95099726f913]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed9480b-4463-4def-a3e0-78e285efd1f6]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:35:50 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:35:50 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:35:50 user nova-compute[231753]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)
Jul 29 13:35:50 user nova-compute[231753]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6 (non-flash)
Jul 29 13:35:50 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:35:50 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:35:50 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:35:50 user nova-compute[231753]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)
Jul 29 13:35:50 user nova-compute[231753]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6 (non-flash)
Jul 29 13:35:50 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.331s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] HCTL ('37', '-', '-', 0) found on session 9 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf760ba-1daf-4f1a-bc80-c86696c0ba61]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Searching for a device in session 9 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LrScQxda', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] No BDM found with device name vdb, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] No VIF found with MAC fa:16:3e:8d:e7:c6, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:35:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-af1f518b-1315-4f84-945d-677fa6e2b8e8 tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Lock "b02ec16d-24a3-450d-858d-3ad302086ac3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.088s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:51 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.368s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:35:51 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] <== connect_volume: return (1369ms) {'type': 'block', 'scsi_wwn': '23930376361663033', 'path': '/dev/sdf'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:35:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23930376361663033', 'path': '/dev/sdf'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:35:51 user nova-compute[231753]: DEBUG nova.objects.instance [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lazy-loading 'flavor' on Instance uuid 8822efe3-e17a-4511-b75f-37f6a83616aa {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:35:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 13:35:51 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:35:51 user nova-compute[231753]:   <source dev="/dev/sdf"/>
Jul 29 13:35:51 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:35:51 user nova-compute[231753]:   <serial>59f32c81-8bc1-426c-9f61-a1678ca599b6</serial>
Jul 29 13:35:51 user nova-compute[231753]: </disk>
Jul 29 13:35:51 user nova-compute[231753]:  {{(pid=231753) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 13:35:52 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:35:52 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] No BDM found with device name hda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:35:52 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] No VIF found with MAC fa:16:3e:3b:15:58, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:35:52 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Acquiring lock "b02ec16d-24a3-450d-858d-3ad302086ac3" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:52 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Lock "b02ec16d-24a3-450d-858d-3ad302086ac3" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:52 user nova-compute[231753]: DEBUG os_brick.utils [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:35:52 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:52 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:52 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb30600f-3b41-4a79-a1ef-92d7f6e93b76]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:52 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:52 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:52 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[722f78c1-061c-49ec-9cdc-dcd3098a91db]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:52 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:52 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:52 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f8437d-bec9-4327-aaea-a78c06e33985]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:52 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5815961-a556-4c02-bd60-c20ee45d7494]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:52 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:52 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:35:52 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:35:52 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:52 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:35:52 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:35:52 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[20354918-be16-434d-81ae-494aa91027c7]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:52 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-cf8c63b5-2db3-4a5b-ad29-cdce346cc5e3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lock "8822efe3-e17a-4511-b75f-37f6a83616aa" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.375s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:52 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:35:52 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:35:52 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:35:52 user nova-compute[231753]: DEBUG os_brick.utils [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:35:52 user nova-compute[231753]: INFO nova.compute.manager [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Swapping volume a8f01b66-d2ac-4dae-99f7-04556527fb6d for 0ce5cc94-fc7d-45dd-a970-f73d9c853fdd
Jul 29 13:35:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b83a2c59-d740-4092-a3da-8ed3366dd826 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Acquiring lock "8822efe3-e17a-4511-b75f-37f6a83616aa" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b83a2c59-d740-4092-a3da-8ed3366dd826 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lock "8822efe3-e17a-4511-b75f-37f6a83616aa" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:53 user nova-compute[231753]: INFO nova.compute.manager [None req-b83a2c59-d740-4092-a3da-8ed3366dd826 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Detaching volume 59f32c81-8bc1-426c-9f61-a1678ca599b6
Jul 29 13:35:53 user nova-compute[231753]: INFO nova.virt.block_device [None req-b83a2c59-d740-4092-a3da-8ed3366dd826 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Attempting to driver detach volume 59f32c81-8bc1-426c-9f61-a1678ca599b6 from mountpoint /dev/vdb
Jul 29 13:35:53 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b83a2c59-d740-4092-a3da-8ed3366dd826 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Attempting to detach device vdb from instance 8822efe3-e17a-4511-b75f-37f6a83616aa from the persistent domain config. {{(pid=231753) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 13:35:53 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-b83a2c59-d740-4092-a3da-8ed3366dd826 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:35:53 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:35:53 user nova-compute[231753]:   <source dev="/dev/sdf"/>
Jul 29 13:35:53 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:35:53 user nova-compute[231753]:   <serial>59f32c81-8bc1-426c-9f61-a1678ca599b6</serial>
Jul 29 13:35:53 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 29 13:35:53 user nova-compute[231753]: </disk>
Jul 29 13:35:53 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:35:53 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-b83a2c59-d740-4092-a3da-8ed3366dd826 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Successfully detached device vdb from instance 8822efe3-e17a-4511-b75f-37f6a83616aa from the persistent domain config.
Jul 29 13:35:53 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b83a2c59-d740-4092-a3da-8ed3366dd826 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8822efe3-e17a-4511-b75f-37f6a83616aa from the live domain config. {{(pid=231753) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 13:35:53 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-b83a2c59-d740-4092-a3da-8ed3366dd826 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:35:53 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:35:53 user nova-compute[231753]:   <source dev="/dev/sdf"/>
Jul 29 13:35:53 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:35:53 user nova-compute[231753]:   <serial>59f32c81-8bc1-426c-9f61-a1678ca599b6</serial>
Jul 29 13:35:53 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 29 13:35:53 user nova-compute[231753]: </disk>
Jul 29 13:35:53 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Received event <DeviceRemovedEvent: 1690637754.0268414, 8822efe3-e17a-4511-b75f-37f6a83616aa => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=231753) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b83a2c59-d740-4092-a3da-8ed3366dd826 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8822efe3-e17a-4511-b75f-37f6a83616aa {{(pid=231753) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 13:35:54 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-b83a2c59-d740-4092-a3da-8ed3366dd826 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Successfully detached device vdb from instance 8822efe3-e17a-4511-b75f-37f6a83616aa from the live domain config.
Jul 29 13:35:54 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b83a2c59-d740-4092-a3da-8ed3366dd826 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83a2c59-d740-4092-a3da-8ed3366dd826 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LrScQxda', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:35:54 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-b83a2c59-d740-4092-a3da-8ed3366dd826 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-b83a2c59-d740-4092-a3da-8ed3366dd826 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-b83a2c59-d740-4092-a3da-8ed3366dd826 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcf041d5-3ec9-4fde-8667-4b0d6202aea0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83a2c59-d740-4092-a3da-8ed3366dd826 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:35:54 user nova-compute[231753]: No targets found.
Jul 29 13:35:54 user nova-compute[231753]: iSNS:
Jul 29 13:35:54 user nova-compute[231753]: No targets found.
Jul 29 13:35:54 user nova-compute[231753]: STATIC:
Jul 29 13:35:54 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d
Jul 29 13:35:54 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:35:54 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:35:54 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6
Jul 29 13:35:54 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:35:54 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:35:54 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008
Jul 29 13:35:54 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:35:54 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:35:54 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf
Jul 29 13:35:54 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:35:54 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:35:54 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c
Jul 29 13:35:54 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:35:54 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:35:54 user nova-compute[231753]: FIRMWARE:
Jul 29 13:35:54 user nova-compute[231753]: No targets found.
Jul 29 13:35:54 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83a2c59-d740-4092-a3da-8ed3366dd826 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:35:54 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:35:54 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83a2c59-d740-4092-a3da-8ed3366dd826 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[81daf708-a26d-486a-809e-66fe0c49f48a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ee09f7b-7aa4-4f44-b5c6-966466ad0e24]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)\ntcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83a2c59-d740-4092-a3da-8ed3366dd826 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:35:54 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:35:54 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:35:54 user nova-compute[231753]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)
Jul 29 13:35:54 user nova-compute[231753]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6 (non-flash)
Jul 29 13:35:54 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83a2c59-d740-4092-a3da-8ed3366dd826 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:35:54 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:35:54 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:35:54 user nova-compute[231753]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)
Jul 29 13:35:54 user nova-compute[231753]: tcp: [9] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6 (non-flash)
Jul 29 13:35:54 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83a2c59-d740-4092-a3da-8ed3366dd826 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ca02b9000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6'): ({'sdf'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-b83a2c59-d740-4092-a3da-8ed3366dd826 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Removing single pathed devices sdf {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[83351f3a-fc2c-45f0-88f4-d46ad35b95a8]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a7015ce-a01b-408f-a8ad-7757491b23af]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-b83a2c59-d740-4092-a3da-8ed3366dd826 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Flushing IO for device /dev/sdf {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c21668c3-fb04-41a0-af83-b3f41e2e71d5]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-b83a2c59-d740-4092-a3da-8ed3366dd826 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[04f9ca7c-1f0d-4d3c-9793-c1b419d3292e]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-b83a2c59-d740-4092-a3da-8ed3366dd826 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-b83a2c59-d740-4092-a3da-8ed3366dd826 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] SCSI volumes sdf have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83a2c59-d740-4092-a3da-8ed3366dd826 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[705ae502-b449-46ab-b28e-8ab94d4525d0]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83a2c59-d740-4092-a3da-8ed3366dd826 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6 -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c111a8-0118-4a8c-ab75-47f29a20d3ba]: (4, ('Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6, portal: 172.16.0.220,3260]\nLogout of [sid: 9, target: iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83a2c59-d740-4092-a3da-8ed3366dd826 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6, portal: 172.16.0.220,3260]
Jul 29 13:35:54 user nova-compute[231753]: Logout of [sid: 9, target: iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6, portal: 172.16.0.220,3260] successful.
Jul 29 13:35:54 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6 -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:59f32c81-8bc1-426c-9f61-a1678ca599b6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[225aa076-557d-40bf-9eee-ae34b14e7a8b]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83a2c59-d740-4092-a3da-8ed3366dd826 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-b83a2c59-d740-4092-a3da-8ed3366dd826 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b83a2c59-d740-4092-a3da-8ed3366dd826 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] <== disconnect_volume: return (336ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b83a2c59-d740-4092-a3da-8ed3366dd826 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tASToRKZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:35:54 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:35:54 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:35:54 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6 -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab0bd69a-db18-416b-ae00-af1cea2d1795]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:35:54 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6 -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cb733b8-24be-4f63-8a6c-599456cc189c]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6] added
Jul 29 13:35:54 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6476d783-ece0-4594-b288-e78582913ac1]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30520c7-2ecc-43d2-ad2e-da6aa3489fe7]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tASToRKZ {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tASToRKZ" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c086d4d-62c3-49ce-909f-fcf09a98c0af]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tASToRKZ'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[546754c3-c136-41d6-bde8-ffd4cbd38e72]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[df2d80a0-44f2-47b9-9b17-0d284569fb49]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:35:54 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:35:54 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:35:54 user nova-compute[231753]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)
Jul 29 13:35:54 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:35:54 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:35:54 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:35:54 user nova-compute[231753]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)
Jul 29 13:35:54 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6 -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6 -p 172.16.0.220:3260 --login" returned: 0 in 0.071s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[527b4853-096e-43f9-85c0-e3e024d35c3b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6, portal: 172.16.0.220,3260]
Jul 29 13:35:54 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6, portal: 172.16.0.220,3260] successful.
Jul 29 13:35:54 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3ed7b4-d933-4186-9378-300acfdf93e6]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[61020c1b-b277-48ae-9459-7d552cd9ed9e]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6 (non-flash)
Jul 29 13:35:54 user nova-compute[231753]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:35:54 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:35:54 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:35:54 user nova-compute[231753]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)
Jul 29 13:35:54 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6 (non-flash)
Jul 29 13:35:54 user nova-compute[231753]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:35:54 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:35:54 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:35:54 user nova-compute[231753]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)
Jul 29 13:35:54 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.300s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] HCTL ('37', '-', '-', 0) found on session 10 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2b155a-70e7-4931-9ca4-dbf019fc6309]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:54 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Searching for a device in session 10 and hctl ['37', '*', '*', 0] yield: None {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:35:55 user nova-compute[231753]: DEBUG nova.objects.instance [None req-b83a2c59-d740-4092-a3da-8ed3366dd826 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lazy-loading 'flavor' on Instance uuid 8822efe3-e17a-4511-b75f-37f6a83616aa {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:35:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b83a2c59-d740-4092-a3da-8ed3366dd826 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lock "8822efe3-e17a-4511-b75f-37f6a83616aa" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.757s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:55 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:55 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Searching for a device in session 10 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:35:55 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tASToRKZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:35:55 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:35:55 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] <== connect_volume: return (1332ms) {'type': 'block', 'scsi_wwn': '23561313532663031', 'path': '/dev/sdf'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:35:55 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23561313532663031', 'path': '/dev/sdf'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG nova.objects.instance [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Lazy-loading 'flavor' on Instance uuid 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 13:35:56 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:35:56 user nova-compute[231753]:   <source dev="/dev/sdf"/>
Jul 29 13:35:56 user nova-compute[231753]:   <target dev="sdc" bus="scsi"/>
Jul 29 13:35:56 user nova-compute[231753]:   <serial>4bfc4bb7-4040-4e54-b579-0dce72c639c6</serial>
Jul 29 13:35:56 user nova-compute[231753]:   <address type="drive" controller="0" unit="2"/>
Jul 29 13:35:56 user nova-compute[231753]: </disk>
Jul 29 13:35:56 user nova-compute[231753]:  {{(pid=231753) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8ed8e65f-ad63-4383-9884-02ebd13b43d3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Acquiring lock "interface-8822efe3-e17a-4511-b75f-37f6a83616aa-eb28874c-fe73-4b5c-a8b4-d352c32e08d5" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8ed8e65f-ad63-4383-9884-02ebd13b43d3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lock "interface-8822efe3-e17a-4511-b75f-37f6a83616aa-eb28874c-fe73-4b5c-a8b4-d352c32e08d5" acquired by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG nova.objects.instance [None req-8ed8e65f-ad63-4383-9884-02ebd13b43d3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lazy-loading 'flavor' on Instance uuid 8822efe3-e17a-4511-b75f-37f6a83616aa {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-8ed8e65f-ad63-4383-9884-02ebd13b43d3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:33:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1148074335',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1148074335',id=7,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0HnOcJSL5x0Tr4fe2VLkk8m+fQM2IcJ8g4N204I22r+/diZGGnEBXWHFX48Vhdy9jagxGQAFJRzYCdQHRK29zwqPTQRGmMCigLgYVfxtAv5zkyNXnhJGzjicINXHWlNA==',key_name='tempest-keypair-833006828',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:33:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='19ab44f715024188b10545aac4cbb675',ramdisk_id='',reservation_id='r-z1bc9xqi',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1208246720',owner_user_name='tempest-TaggedAttachmentsTest-1208246720-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:33:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8de5c966bbb948499c560ea5ab63a960',uuid=8822efe3-e17a-4511-b75f-37f6a83616aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb28874c-fe73-4b5c-a8b4-d352c32e08d5", "address": "fa:16:3e:2a:1d:cc", "network": {"id": "5986b25c-ca33-46df-8954-3050d4e83f6c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-86069326", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "19ab44f715024188b10545aac4cbb675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb28874c-fe", "ovs_interfaceid": "eb28874c-fe73-4b5c-a8b4-d352c32e08d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-8ed8e65f-ad63-4383-9884-02ebd13b43d3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Converting VIF {"id": "eb28874c-fe73-4b5c-a8b4-d352c32e08d5", "address": "fa:16:3e:2a:1d:cc", "network": {"id": "5986b25c-ca33-46df-8954-3050d4e83f6c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-86069326", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "19ab44f715024188b10545aac4cbb675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb28874c-fe", "ovs_interfaceid": "eb28874c-fe73-4b5c-a8b4-d352c32e08d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-8ed8e65f-ad63-4383-9884-02ebd13b43d3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:1d:cc,bridge_name='br-int',has_traffic_filtering=True,id=eb28874c-fe73-4b5c-a8b4-d352c32e08d5,network=Network(5986b25c-ca33-46df-8954-3050d4e83f6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb28874c-fe') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-8ed8e65f-ad63-4383-9884-02ebd13b43d3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:2a:1d:cc"/><model type="virtio"/><mtu size="1442"/><target dev="tapeb28874c-fe"/></interface> {{(pid=231753) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-8ed8e65f-ad63-4383-9884-02ebd13b43d3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:2a:1d:cc"/><model type="virtio"/><mtu size="1442"/><target dev="tapeb28874c-fe"/></interface> {{(pid=231753) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-8ed8e65f-ad63-4383-9884-02ebd13b43d3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Attempting to detach device tapeb28874c-fe from instance 8822efe3-e17a-4511-b75f-37f6a83616aa from the persistent domain config. {{(pid=231753) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-8ed8e65f-ad63-4383-9884-02ebd13b43d3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] detach device xml: <interface type="ethernet">
Jul 29 13:35:56 user nova-compute[231753]:   <mac address="fa:16:3e:2a:1d:cc"/>
Jul 29 13:35:56 user nova-compute[231753]:   <model type="virtio"/>
Jul 29 13:35:56 user nova-compute[231753]:   <mtu size="1442"/>
Jul 29 13:35:56 user nova-compute[231753]:   <target dev="tapeb28874c-fe"/>
Jul 29 13:35:56 user nova-compute[231753]: </interface>
Jul 29 13:35:56 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-8ed8e65f-ad63-4383-9884-02ebd13b43d3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:2a:1d:cc"/><model type="virtio"/><mtu size="1442"/><target dev="tapeb28874c-fe"/></interface> {{(pid=231753) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-8ed8e65f-ad63-4383-9884-02ebd13b43d3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:2a:1d:cc"/><model type="virtio"/><mtu size="1442"/><target dev="tapeb28874c-fe"/></interface>not found in domain: <domain type='kvm' id='7'>
Jul 29 13:35:56 user nova-compute[231753]:   <name>instance-00000007</name>
Jul 29 13:35:56 user nova-compute[231753]:   <uuid>8822efe3-e17a-4511-b75f-37f6a83616aa</uuid>
Jul 29 13:35:56 user nova-compute[231753]:   <metadata>
Jul 29 13:35:56 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:35:56 user nova-compute[231753]:   <nova:package version="0.0.0"/>
Jul 29 13:35:56 user nova-compute[231753]:   <nova:name>tempest-device-tagging-server-1148074335</nova:name>
Jul 29 13:35:56 user nova-compute[231753]:   <nova:creationTime>2023-07-29 13:35:40</nova:creationTime>
Jul 29 13:35:56 user nova-compute[231753]:   <nova:flavor name="m1.tiny">
Jul 29 13:35:56 user nova-compute[231753]:     <nova:memory>512</nova:memory>
Jul 29 13:35:56 user nova-compute[231753]:     <nova:disk>1</nova:disk>
Jul 29 13:35:56 user nova-compute[231753]:     <nova:swap>0</nova:swap>
Jul 29 13:35:56 user nova-compute[231753]:     <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:35:56 user nova-compute[231753]:     <nova:vcpus>1</nova:vcpus>
Jul 29 13:35:56 user nova-compute[231753]:   </nova:flavor>
Jul 29 13:35:56 user nova-compute[231753]:   <nova:owner>
Jul 29 13:35:56 user nova-compute[231753]:     <nova:user uuid="8de5c966bbb948499c560ea5ab63a960">tempest-TaggedAttachmentsTest-1208246720-project-member</nova:user>
Jul 29 13:35:56 user nova-compute[231753]:     <nova:project uuid="19ab44f715024188b10545aac4cbb675">tempest-TaggedAttachmentsTest-1208246720</nova:project>
Jul 29 13:35:56 user nova-compute[231753]:   </nova:owner>
Jul 29 13:35:56 user nova-compute[231753]:   <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:35:56 user nova-compute[231753]:   <nova:ports>
Jul 29 13:35:56 user nova-compute[231753]:     <nova:port uuid="7881fb42-caac-4254-a8ef-16b49c754bf9">
Jul 29 13:35:56 user nova-compute[231753]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 29 13:35:56 user nova-compute[231753]:     </nova:port>
Jul 29 13:35:56 user nova-compute[231753]:     <nova:port uuid="eb28874c-fe73-4b5c-a8b4-d352c32e08d5">
Jul 29 13:35:56 user nova-compute[231753]:       <nova:ip type="fixed" address="10.10.10.152" ipVersion="4"/>
Jul 29 13:35:56 user nova-compute[231753]:     </nova:port>
Jul 29 13:35:56 user nova-compute[231753]:   </nova:ports>
Jul 29 13:35:56 user nova-compute[231753]: </nova:instance>
Jul 29 13:35:56 user nova-compute[231753]:   </metadata>
Jul 29 13:35:56 user nova-compute[231753]:   <memory unit='KiB'>524288</memory>
Jul 29 13:35:56 user nova-compute[231753]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 29 13:35:56 user nova-compute[231753]:   <vcpu placement='static'>1</vcpu>
Jul 29 13:35:56 user nova-compute[231753]:   <resource>
Jul 29 13:35:56 user nova-compute[231753]:     <partition>/machine</partition>
Jul 29 13:35:56 user nova-compute[231753]:   </resource>
Jul 29 13:35:56 user nova-compute[231753]:   <sysinfo type='smbios'>
Jul 29 13:35:56 user nova-compute[231753]:     <system>
Jul 29 13:35:56 user nova-compute[231753]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 29 13:35:56 user nova-compute[231753]:       <entry name='product'>OpenStack Nova</entry>
Jul 29 13:35:56 user nova-compute[231753]:       <entry name='version'>0.0.0</entry>
Jul 29 13:35:56 user nova-compute[231753]:       <entry name='serial'>8822efe3-e17a-4511-b75f-37f6a83616aa</entry>
Jul 29 13:35:56 user nova-compute[231753]:       <entry name='uuid'>8822efe3-e17a-4511-b75f-37f6a83616aa</entry>
Jul 29 13:35:56 user nova-compute[231753]:       <entry name='family'>Virtual Machine</entry>
Jul 29 13:35:56 user nova-compute[231753]:     </system>
Jul 29 13:35:56 user nova-compute[231753]:   </sysinfo>
Jul 29 13:35:56 user nova-compute[231753]:   <os>
Jul 29 13:35:56 user nova-compute[231753]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 29 13:35:56 user nova-compute[231753]:     <boot dev='hd'/>
Jul 29 13:35:56 user nova-compute[231753]:     <smbios mode='sysinfo'/>
Jul 29 13:35:56 user nova-compute[231753]:   </os>
Jul 29 13:35:56 user nova-compute[231753]:   <features>
Jul 29 13:35:56 user nova-compute[231753]:     <acpi/>
Jul 29 13:35:56 user nova-compute[231753]:     <apic/>
Jul 29 13:35:56 user nova-compute[231753]:     <vmcoreinfo state='on'/>
Jul 29 13:35:56 user nova-compute[231753]:   </features>
Jul 29 13:35:56 user nova-compute[231753]:   <cpu mode='custom' match='exact' check='full'>
Jul 29 13:35:56 user nova-compute[231753]:     <model fallback='forbid'>Nehalem</model>
Jul 29 13:35:56 user nova-compute[231753]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 29 13:35:56 user nova-compute[231753]:     <feature policy='require' name='vme'/>
Jul 29 13:35:56 user nova-compute[231753]:     <feature policy='require' name='x2apic'/>
Jul 29 13:35:56 user nova-compute[231753]:     <feature policy='require' name='hypervisor'/>
Jul 29 13:35:56 user nova-compute[231753]:   </cpu>
Jul 29 13:35:56 user nova-compute[231753]:   <clock offset='utc'>
Jul 29 13:35:56 user nova-compute[231753]:     <timer name='pit' tickpolicy='delay'/>
Jul 29 13:35:56 user nova-compute[231753]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 29 13:35:56 user nova-compute[231753]:     <timer name='hpet' present='no'/>
Jul 29 13:35:56 user nova-compute[231753]:   </clock>
Jul 29 13:35:56 user nova-compute[231753]:   <on_poweroff>destroy</on_poweroff>
Jul 29 13:35:56 user nova-compute[231753]:   <on_reboot>restart</on_reboot>
Jul 29 13:35:56 user nova-compute[231753]:   <on_crash>destroy</on_crash>
Jul 29 13:35:56 user nova-compute[231753]:   <devices>
Jul 29 13:35:56 user nova-compute[231753]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 29 13:35:56 user nova-compute[231753]:     <disk type='file' device='disk'>
Jul 29 13:35:56 user nova-compute[231753]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 29 13:35:56 user nova-compute[231753]:       <source file='/opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa/disk' index='2'/>
Jul 29 13:35:56 user nova-compute[231753]:       <backingStore type='file' index='3'>
Jul 29 13:35:56 user nova-compute[231753]:         <format type='raw'/>
Jul 29 13:35:56 user nova-compute[231753]:         <source file='/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a'/>
Jul 29 13:35:56 user nova-compute[231753]:         <backingStore/>
Jul 29 13:35:56 user nova-compute[231753]:       </backingStore>
Jul 29 13:35:56 user nova-compute[231753]:       <target dev='vda' bus='virtio'/>
Jul 29 13:35:56 user nova-compute[231753]:       <alias name='virtio-disk0'/>
Jul 29 13:35:56 user nova-compute[231753]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 29 13:35:56 user nova-compute[231753]:     </disk>
Jul 29 13:35:56 user nova-compute[231753]:     <disk type='file' device='cdrom'>
Jul 29 13:35:56 user nova-compute[231753]:       <driver name='qemu' type='raw' cache='none'/>
Jul 29 13:35:56 user nova-compute[231753]:       <source file='/opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa/disk.config' index='1'/>
Jul 29 13:35:56 user nova-compute[231753]:       <backingStore/>
Jul 29 13:35:56 user nova-compute[231753]:       <target dev='hda' bus='ide'/>
Jul 29 13:35:56 user nova-compute[231753]:       <readonly/>
Jul 29 13:35:56 user nova-compute[231753]:       <alias name='ide0-0-0'/>
Jul 29 13:35:56 user nova-compute[231753]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 29 13:35:56 user nova-compute[231753]:     </disk>
Jul 29 13:35:56 user nova-compute[231753]:     <controller type='usb' index='0' model='none'>
Jul 29 13:35:56 user nova-compute[231753]:       <alias name='usb'/>
Jul 29 13:35:56 user nova-compute[231753]:     </controller>
Jul 29 13:35:56 user nova-compute[231753]:     <controller type='pci' index='0' model='pci-root'>
Jul 29 13:35:56 user nova-compute[231753]:       <alias name='pci.0'/>
Jul 29 13:35:56 user nova-compute[231753]:     </controller>
Jul 29 13:35:56 user nova-compute[231753]:     <controller type='ide' index='0'>
Jul 29 13:35:56 user nova-compute[231753]:       <alias name='ide'/>
Jul 29 13:35:56 user nova-compute[231753]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 29 13:35:56 user nova-compute[231753]:     </controller>
Jul 29 13:35:56 user nova-compute[231753]:     <interface type='ethernet'>
Jul 29 13:35:56 user nova-compute[231753]:       <mac address='fa:16:3e:3b:15:58'/>
Jul 29 13:35:56 user nova-compute[231753]:       <target dev='tap7881fb42-ca'/>
Jul 29 13:35:56 user nova-compute[231753]:       <model type='virtio'/>
Jul 29 13:35:56 user nova-compute[231753]:       <mtu size='1442'/>
Jul 29 13:35:56 user nova-compute[231753]:       <alias name='net0'/>
Jul 29 13:35:56 user nova-compute[231753]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 29 13:35:56 user nova-compute[231753]:     </interface>
Jul 29 13:35:56 user nova-compute[231753]:     <interface type='ethernet'>
Jul 29 13:35:56 user nova-compute[231753]:       <mac address='fa:16:3e:2a:1d:cc'/>
Jul 29 13:35:56 user nova-compute[231753]:       <target dev='tapeb28874c-fe'/>
Jul 29 13:35:56 user nova-compute[231753]:       <model type='virtio'/>
Jul 29 13:35:56 user nova-compute[231753]:       <mtu size='1442'/>
Jul 29 13:35:56 user nova-compute[231753]:       <alias name='net1'/>
Jul 29 13:35:56 user nova-compute[231753]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
Jul 29 13:35:56 user nova-compute[231753]:     </interface>
Jul 29 13:35:56 user nova-compute[231753]:     <serial type='pty'>
Jul 29 13:35:56 user nova-compute[231753]:       <source path='/dev/pts/8'/>
Jul 29 13:35:56 user nova-compute[231753]:       <log file='/opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa/console.log' append='off'/>
Jul 29 13:35:56 user nova-compute[231753]:       <target type='isa-serial' port='0'>
Jul 29 13:35:56 user nova-compute[231753]:         <model name='isa-serial'/>
Jul 29 13:35:56 user nova-compute[231753]:       </target>
Jul 29 13:35:56 user nova-compute[231753]:       <alias name='serial0'/>
Jul 29 13:35:56 user nova-compute[231753]:     </serial>
Jul 29 13:35:56 user nova-compute[231753]:     <console type='pty' tty='/dev/pts/8'>
Jul 29 13:35:56 user nova-compute[231753]:       <source path='/dev/pts/8'/>
Jul 29 13:35:56 user nova-compute[231753]:       <log file='/opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa/console.log' append='off'/>
Jul 29 13:35:56 user nova-compute[231753]:       <target type='serial' port='0'/>
Jul 29 13:35:56 user nova-compute[231753]:       <alias name='serial0'/>
Jul 29 13:35:56 user nova-compute[231753]:     </console>
Jul 29 13:35:56 user nova-compute[231753]:     <input type='mouse' bus='ps2'>
Jul 29 13:35:56 user nova-compute[231753]:       <alias name='input0'/>
Jul 29 13:35:56 user nova-compute[231753]:     </input>
Jul 29 13:35:56 user nova-compute[231753]:     <input type='keyboard' bus='ps2'>
Jul 29 13:35:56 user nova-compute[231753]:       <alias name='input1'/>
Jul 29 13:35:56 user nova-compute[231753]:     </input>
Jul 29 13:35:56 user nova-compute[231753]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Jul 29 13:35:56 user nova-compute[231753]:       <listen type='address' address='0.0.0.0'/>
Jul 29 13:35:56 user nova-compute[231753]:     </graphics>
Jul 29 13:35:56 user nova-compute[231753]:     <audio id='1' type='none'/>
Jul 29 13:35:56 user nova-compute[231753]:     <video>
Jul 29 13:35:56 user nova-compute[231753]:       <model type='virtio' heads='1' primary='yes'/>
Jul 29 13:35:56 user nova-compute[231753]:       <alias name='video0'/>
Jul 29 13:35:56 user nova-compute[231753]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 29 13:35:56 user nova-compute[231753]:     </video>
Jul 29 13:35:56 user nova-compute[231753]:     <memballoon model='virtio'>
Jul 29 13:35:56 user nova-compute[231753]:       <stats period='10'/>
Jul 29 13:35:56 user nova-compute[231753]:       <alias name='balloon0'/>
Jul 29 13:35:56 user nova-compute[231753]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 29 13:35:56 user nova-compute[231753]:     </memballoon>
Jul 29 13:35:56 user nova-compute[231753]:     <rng model='virtio'>
Jul 29 13:35:56 user nova-compute[231753]:       <backend model='random'>/dev/urandom</backend>
Jul 29 13:35:56 user nova-compute[231753]:       <alias name='rng0'/>
Jul 29 13:35:56 user nova-compute[231753]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 29 13:35:56 user nova-compute[231753]:     </rng>
Jul 29 13:35:56 user nova-compute[231753]:   </devices>
Jul 29 13:35:56 user nova-compute[231753]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 29 13:35:56 user nova-compute[231753]:     <label>libvirt-8822efe3-e17a-4511-b75f-37f6a83616aa</label>
Jul 29 13:35:56 user nova-compute[231753]:     <imagelabel>libvirt-8822efe3-e17a-4511-b75f-37f6a83616aa</imagelabel>
Jul 29 13:35:56 user nova-compute[231753]:   </seclabel>
Jul 29 13:35:56 user nova-compute[231753]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 29 13:35:56 user nova-compute[231753]:     <label>+64055:+108</label>
Jul 29 13:35:56 user nova-compute[231753]:     <imagelabel>+64055:+108</imagelabel>
Jul 29 13:35:56 user nova-compute[231753]:   </seclabel>
Jul 29 13:35:56 user nova-compute[231753]: </domain>
Jul 29 13:35:56 user nova-compute[231753]:  {{(pid=231753) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 29 13:35:56 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-8ed8e65f-ad63-4383-9884-02ebd13b43d3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Successfully detached device tapeb28874c-fe from instance 8822efe3-e17a-4511-b75f-37f6a83616aa from the persistent domain config.
Jul 29 13:35:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-8ed8e65f-ad63-4383-9884-02ebd13b43d3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] (1/8): Attempting to detach device tapeb28874c-fe with device alias net1 from instance 8822efe3-e17a-4511-b75f-37f6a83616aa from the live domain config. {{(pid=231753) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-8ed8e65f-ad63-4383-9884-02ebd13b43d3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] detach device xml: <interface type="ethernet">
Jul 29 13:35:56 user nova-compute[231753]:   <mac address="fa:16:3e:2a:1d:cc"/>
Jul 29 13:35:56 user nova-compute[231753]:   <model type="virtio"/>
Jul 29 13:35:56 user nova-compute[231753]:   <mtu size="1442"/>
Jul 29 13:35:56 user nova-compute[231753]:   <target dev="tapeb28874c-fe"/>
Jul 29 13:35:56 user nova-compute[231753]: </interface>
Jul 29 13:35:56 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Received event <DeviceRemovedEvent: 1690637756.5155895, 8822efe3-e17a-4511-b75f-37f6a83616aa => net1> from libvirt while the driver is waiting for it; dispatched. {{(pid=231753) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-8ed8e65f-ad63-4383-9884-02ebd13b43d3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Start waiting for the detach event from libvirt for device tapeb28874c-fe with device alias net1 for instance 8822efe3-e17a-4511-b75f-37f6a83616aa {{(pid=231753) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-8ed8e65f-ad63-4383-9884-02ebd13b43d3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] looking for interface given config: <interface type="ethernet"><mac address="fa:16:3e:2a:1d:cc"/><model type="virtio"/><mtu size="1442"/><target dev="tapeb28874c-fe"/></interface> {{(pid=231753) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:257}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-8ed8e65f-ad63-4383-9884-02ebd13b43d3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] interface for config: <interface type="ethernet"><mac address="fa:16:3e:2a:1d:cc"/><model type="virtio"/><mtu size="1442"/><target dev="tapeb28874c-fe"/></interface>not found in domain: <domain type='kvm' id='7'>
Jul 29 13:35:56 user nova-compute[231753]:   <name>instance-00000007</name>
Jul 29 13:35:56 user nova-compute[231753]:   <uuid>8822efe3-e17a-4511-b75f-37f6a83616aa</uuid>
Jul 29 13:35:56 user nova-compute[231753]:   <metadata>
Jul 29 13:35:56 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1" xmlns:instance="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:35:56 user nova-compute[231753]:   <nova:package version="0.0.0"/>
Jul 29 13:35:56 user nova-compute[231753]:   <nova:name>tempest-device-tagging-server-1148074335</nova:name>
Jul 29 13:35:56 user nova-compute[231753]:   <nova:creationTime>2023-07-29 13:35:40</nova:creationTime>
Jul 29 13:35:56 user nova-compute[231753]:   <nova:flavor name="m1.tiny">
Jul 29 13:35:56 user nova-compute[231753]:     <nova:memory>512</nova:memory>
Jul 29 13:35:56 user nova-compute[231753]:     <nova:disk>1</nova:disk>
Jul 29 13:35:56 user nova-compute[231753]:     <nova:swap>0</nova:swap>
Jul 29 13:35:56 user nova-compute[231753]:     <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:35:56 user nova-compute[231753]:     <nova:vcpus>1</nova:vcpus>
Jul 29 13:35:56 user nova-compute[231753]:   </nova:flavor>
Jul 29 13:35:56 user nova-compute[231753]:   <nova:owner>
Jul 29 13:35:56 user nova-compute[231753]:     <nova:user uuid="8de5c966bbb948499c560ea5ab63a960">tempest-TaggedAttachmentsTest-1208246720-project-member</nova:user>
Jul 29 13:35:56 user nova-compute[231753]:     <nova:project uuid="19ab44f715024188b10545aac4cbb675">tempest-TaggedAttachmentsTest-1208246720</nova:project>
Jul 29 13:35:56 user nova-compute[231753]:   </nova:owner>
Jul 29 13:35:56 user nova-compute[231753]:   <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:35:56 user nova-compute[231753]:   <nova:ports>
Jul 29 13:35:56 user nova-compute[231753]:     <nova:port uuid="7881fb42-caac-4254-a8ef-16b49c754bf9">
Jul 29 13:35:56 user nova-compute[231753]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 29 13:35:56 user nova-compute[231753]:     </nova:port>
Jul 29 13:35:56 user nova-compute[231753]:     <nova:port uuid="eb28874c-fe73-4b5c-a8b4-d352c32e08d5">
Jul 29 13:35:56 user nova-compute[231753]:       <nova:ip type="fixed" address="10.10.10.152" ipVersion="4"/>
Jul 29 13:35:56 user nova-compute[231753]:     </nova:port>
Jul 29 13:35:56 user nova-compute[231753]:   </nova:ports>
Jul 29 13:35:56 user nova-compute[231753]: </nova:instance>
Jul 29 13:35:56 user nova-compute[231753]:   </metadata>
Jul 29 13:35:56 user nova-compute[231753]:   <memory unit='KiB'>524288</memory>
Jul 29 13:35:56 user nova-compute[231753]:   <currentMemory unit='KiB'>524288</currentMemory>
Jul 29 13:35:56 user nova-compute[231753]:   <vcpu placement='static'>1</vcpu>
Jul 29 13:35:56 user nova-compute[231753]:   <resource>
Jul 29 13:35:56 user nova-compute[231753]:     <partition>/machine</partition>
Jul 29 13:35:56 user nova-compute[231753]:   </resource>
Jul 29 13:35:56 user nova-compute[231753]:   <sysinfo type='smbios'>
Jul 29 13:35:56 user nova-compute[231753]:     <system>
Jul 29 13:35:56 user nova-compute[231753]:       <entry name='manufacturer'>OpenStack Foundation</entry>
Jul 29 13:35:56 user nova-compute[231753]:       <entry name='product'>OpenStack Nova</entry>
Jul 29 13:35:56 user nova-compute[231753]:       <entry name='version'>0.0.0</entry>
Jul 29 13:35:56 user nova-compute[231753]:       <entry name='serial'>8822efe3-e17a-4511-b75f-37f6a83616aa</entry>
Jul 29 13:35:56 user nova-compute[231753]:       <entry name='uuid'>8822efe3-e17a-4511-b75f-37f6a83616aa</entry>
Jul 29 13:35:56 user nova-compute[231753]:       <entry name='family'>Virtual Machine</entry>
Jul 29 13:35:56 user nova-compute[231753]:     </system>
Jul 29 13:35:56 user nova-compute[231753]:   </sysinfo>
Jul 29 13:35:56 user nova-compute[231753]:   <os>
Jul 29 13:35:56 user nova-compute[231753]:     <type arch='x86_64' machine='pc-i440fx-6.2'>hvm</type>
Jul 29 13:35:56 user nova-compute[231753]:     <boot dev='hd'/>
Jul 29 13:35:56 user nova-compute[231753]:     <smbios mode='sysinfo'/>
Jul 29 13:35:56 user nova-compute[231753]:   </os>
Jul 29 13:35:56 user nova-compute[231753]:   <features>
Jul 29 13:35:56 user nova-compute[231753]:     <acpi/>
Jul 29 13:35:56 user nova-compute[231753]:     <apic/>
Jul 29 13:35:56 user nova-compute[231753]:     <vmcoreinfo state='on'/>
Jul 29 13:35:56 user nova-compute[231753]:   </features>
Jul 29 13:35:56 user nova-compute[231753]:   <cpu mode='custom' match='exact' check='full'>
Jul 29 13:35:56 user nova-compute[231753]:     <model fallback='forbid'>Nehalem</model>
Jul 29 13:35:56 user nova-compute[231753]:     <topology sockets='1' dies='1' cores='1' threads='1'/>
Jul 29 13:35:56 user nova-compute[231753]:     <feature policy='require' name='vme'/>
Jul 29 13:35:56 user nova-compute[231753]:     <feature policy='require' name='x2apic'/>
Jul 29 13:35:56 user nova-compute[231753]:     <feature policy='require' name='hypervisor'/>
Jul 29 13:35:56 user nova-compute[231753]:   </cpu>
Jul 29 13:35:56 user nova-compute[231753]:   <clock offset='utc'>
Jul 29 13:35:56 user nova-compute[231753]:     <timer name='pit' tickpolicy='delay'/>
Jul 29 13:35:56 user nova-compute[231753]:     <timer name='rtc' tickpolicy='catchup'/>
Jul 29 13:35:56 user nova-compute[231753]:     <timer name='hpet' present='no'/>
Jul 29 13:35:56 user nova-compute[231753]:   </clock>
Jul 29 13:35:56 user nova-compute[231753]:   <on_poweroff>destroy</on_poweroff>
Jul 29 13:35:56 user nova-compute[231753]:   <on_reboot>restart</on_reboot>
Jul 29 13:35:56 user nova-compute[231753]:   <on_crash>destroy</on_crash>
Jul 29 13:35:56 user nova-compute[231753]:   <devices>
Jul 29 13:35:56 user nova-compute[231753]:     <emulator>/usr/bin/qemu-system-x86_64</emulator>
Jul 29 13:35:56 user nova-compute[231753]:     <disk type='file' device='disk'>
Jul 29 13:35:56 user nova-compute[231753]:       <driver name='qemu' type='qcow2' cache='none'/>
Jul 29 13:35:56 user nova-compute[231753]:       <source file='/opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa/disk' index='2'/>
Jul 29 13:35:56 user nova-compute[231753]:       <backingStore type='file' index='3'>
Jul 29 13:35:56 user nova-compute[231753]:         <format type='raw'/>
Jul 29 13:35:56 user nova-compute[231753]:         <source file='/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a'/>
Jul 29 13:35:56 user nova-compute[231753]:         <backingStore/>
Jul 29 13:35:56 user nova-compute[231753]:       </backingStore>
Jul 29 13:35:56 user nova-compute[231753]:       <target dev='vda' bus='virtio'/>
Jul 29 13:35:56 user nova-compute[231753]:       <alias name='virtio-disk0'/>
Jul 29 13:35:56 user nova-compute[231753]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
Jul 29 13:35:56 user nova-compute[231753]:     </disk>
Jul 29 13:35:56 user nova-compute[231753]:     <disk type='file' device='cdrom'>
Jul 29 13:35:56 user nova-compute[231753]:       <driver name='qemu' type='raw' cache='none'/>
Jul 29 13:35:56 user nova-compute[231753]:       <source file='/opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa/disk.config' index='1'/>
Jul 29 13:35:56 user nova-compute[231753]:       <backingStore/>
Jul 29 13:35:56 user nova-compute[231753]:       <target dev='hda' bus='ide'/>
Jul 29 13:35:56 user nova-compute[231753]:       <readonly/>
Jul 29 13:35:56 user nova-compute[231753]:       <alias name='ide0-0-0'/>
Jul 29 13:35:56 user nova-compute[231753]:       <address type='drive' controller='0' bus='0' target='0' unit='0'/>
Jul 29 13:35:56 user nova-compute[231753]:     </disk>
Jul 29 13:35:56 user nova-compute[231753]:     <controller type='usb' index='0' model='none'>
Jul 29 13:35:56 user nova-compute[231753]:       <alias name='usb'/>
Jul 29 13:35:56 user nova-compute[231753]:     </controller>
Jul 29 13:35:56 user nova-compute[231753]:     <controller type='pci' index='0' model='pci-root'>
Jul 29 13:35:56 user nova-compute[231753]:       <alias name='pci.0'/>
Jul 29 13:35:56 user nova-compute[231753]:     </controller>
Jul 29 13:35:56 user nova-compute[231753]:     <controller type='ide' index='0'>
Jul 29 13:35:56 user nova-compute[231753]:       <alias name='ide'/>
Jul 29 13:35:56 user nova-compute[231753]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
Jul 29 13:35:56 user nova-compute[231753]:     </controller>
Jul 29 13:35:56 user nova-compute[231753]:     <interface type='ethernet'>
Jul 29 13:35:56 user nova-compute[231753]:       <mac address='fa:16:3e:3b:15:58'/>
Jul 29 13:35:56 user nova-compute[231753]:       <target dev='tap7881fb42-ca'/>
Jul 29 13:35:56 user nova-compute[231753]:       <model type='virtio'/>
Jul 29 13:35:56 user nova-compute[231753]:       <mtu size='1442'/>
Jul 29 13:35:56 user nova-compute[231753]:       <alias name='net0'/>
Jul 29 13:35:56 user nova-compute[231753]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
Jul 29 13:35:56 user nova-compute[231753]:     </interface>
Jul 29 13:35:56 user nova-compute[231753]:     <serial type='pty'>
Jul 29 13:35:56 user nova-compute[231753]:       <source path='/dev/pts/8'/>
Jul 29 13:35:56 user nova-compute[231753]:       <log file='/opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa/console.log' append='off'/>
Jul 29 13:35:56 user nova-compute[231753]:       <target type='isa-serial' port='0'>
Jul 29 13:35:56 user nova-compute[231753]:         <model name='isa-serial'/>
Jul 29 13:35:56 user nova-compute[231753]:       </target>
Jul 29 13:35:56 user nova-compute[231753]:       <alias name='serial0'/>
Jul 29 13:35:56 user nova-compute[231753]:     </serial>
Jul 29 13:35:56 user nova-compute[231753]:     <console type='pty' tty='/dev/pts/8'>
Jul 29 13:35:56 user nova-compute[231753]:       <source path='/dev/pts/8'/>
Jul 29 13:35:56 user nova-compute[231753]:       <log file='/opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa/console.log' append='off'/>
Jul 29 13:35:56 user nova-compute[231753]:       <target type='serial' port='0'/>
Jul 29 13:35:56 user nova-compute[231753]:       <alias name='serial0'/>
Jul 29 13:35:56 user nova-compute[231753]:     </console>
Jul 29 13:35:56 user nova-compute[231753]:     <input type='mouse' bus='ps2'>
Jul 29 13:35:56 user nova-compute[231753]:       <alias name='input0'/>
Jul 29 13:35:56 user nova-compute[231753]:     </input>
Jul 29 13:35:56 user nova-compute[231753]:     <input type='keyboard' bus='ps2'>
Jul 29 13:35:56 user nova-compute[231753]:       <alias name='input1'/>
Jul 29 13:35:56 user nova-compute[231753]:     </input>
Jul 29 13:35:56 user nova-compute[231753]:     <graphics type='vnc' port='5906' autoport='yes' listen='0.0.0.0'>
Jul 29 13:35:56 user nova-compute[231753]:       <listen type='address' address='0.0.0.0'/>
Jul 29 13:35:56 user nova-compute[231753]:     </graphics>
Jul 29 13:35:56 user nova-compute[231753]:     <audio id='1' type='none'/>
Jul 29 13:35:56 user nova-compute[231753]:     <video>
Jul 29 13:35:56 user nova-compute[231753]:       <model type='virtio' heads='1' primary='yes'/>
Jul 29 13:35:56 user nova-compute[231753]:       <alias name='video0'/>
Jul 29 13:35:56 user nova-compute[231753]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
Jul 29 13:35:56 user nova-compute[231753]:     </video>
Jul 29 13:35:56 user nova-compute[231753]:     <memballoon model='virtio'>
Jul 29 13:35:56 user nova-compute[231753]:       <stats period='10'/>
Jul 29 13:35:56 user nova-compute[231753]:       <alias name='balloon0'/>
Jul 29 13:35:56 user nova-compute[231753]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0'/>
Jul 29 13:35:56 user nova-compute[231753]:     </memballoon>
Jul 29 13:35:56 user nova-compute[231753]:     <rng model='virtio'>
Jul 29 13:35:56 user nova-compute[231753]:       <backend model='random'>/dev/urandom</backend>
Jul 29 13:35:56 user nova-compute[231753]:       <alias name='rng0'/>
Jul 29 13:35:56 user nova-compute[231753]:       <address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
Jul 29 13:35:56 user nova-compute[231753]:     </rng>
Jul 29 13:35:56 user nova-compute[231753]:   </devices>
Jul 29 13:35:56 user nova-compute[231753]:   <seclabel type='dynamic' model='apparmor' relabel='yes'>
Jul 29 13:35:56 user nova-compute[231753]:     <label>libvirt-8822efe3-e17a-4511-b75f-37f6a83616aa</label>
Jul 29 13:35:56 user nova-compute[231753]:     <imagelabel>libvirt-8822efe3-e17a-4511-b75f-37f6a83616aa</imagelabel>
Jul 29 13:35:56 user nova-compute[231753]:   </seclabel>
Jul 29 13:35:56 user nova-compute[231753]:   <seclabel type='dynamic' model='dac' relabel='yes'>
Jul 29 13:35:56 user nova-compute[231753]:     <label>+64055:+108</label>
Jul 29 13:35:56 user nova-compute[231753]:     <imagelabel>+64055:+108</imagelabel>
Jul 29 13:35:56 user nova-compute[231753]:   </seclabel>
Jul 29 13:35:56 user nova-compute[231753]: </domain>
Jul 29 13:35:56 user nova-compute[231753]:  {{(pid=231753) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:282}}
Jul 29 13:35:56 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-8ed8e65f-ad63-4383-9884-02ebd13b43d3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Successfully detached device tapeb28874c-fe from instance 8822efe3-e17a-4511-b75f-37f6a83616aa from the live domain config.
Jul 29 13:35:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-8ed8e65f-ad63-4383-9884-02ebd13b43d3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:33:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1148074335',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1148074335',id=7,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0HnOcJSL5x0Tr4fe2VLkk8m+fQM2IcJ8g4N204I22r+/diZGGnEBXWHFX48Vhdy9jagxGQAFJRzYCdQHRK29zwqPTQRGmMCigLgYVfxtAv5zkyNXnhJGzjicINXHWlNA==',key_name='tempest-keypair-833006828',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:33:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='19ab44f715024188b10545aac4cbb675',ramdisk_id='',reservation_id='r-z1bc9xqi',resources=<?>,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1208246720',owner_user_name='tempest-TaggedAttachmentsTest-1208246720-project-member'},tags=<?>,task_state=None,terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:33:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8de5c966bbb948499c560ea5ab63a960',uuid=8822efe3-e17a-4511-b75f-37f6a83616aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eb28874c-fe73-4b5c-a8b4-d352c32e08d5", "address": "fa:16:3e:2a:1d:cc", "network": {"id": "5986b25c-ca33-46df-8954-3050d4e83f6c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-86069326", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "19ab44f715024188b10545aac4cbb675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb28874c-fe", "ovs_interfaceid": "eb28874c-fe73-4b5c-a8b4-d352c32e08d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-8ed8e65f-ad63-4383-9884-02ebd13b43d3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Converting VIF {"id": "eb28874c-fe73-4b5c-a8b4-d352c32e08d5", "address": "fa:16:3e:2a:1d:cc", "network": {"id": "5986b25c-ca33-46df-8954-3050d4e83f6c", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-86069326", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.152", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.10.10.1"}}], "meta": {"injected": false, "tenant_id": "19ab44f715024188b10545aac4cbb675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeb28874c-fe", "ovs_interfaceid": "eb28874c-fe73-4b5c-a8b4-d352c32e08d5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-8ed8e65f-ad63-4383-9884-02ebd13b43d3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2a:1d:cc,bridge_name='br-int',has_traffic_filtering=True,id=eb28874c-fe73-4b5c-a8b4-d352c32e08d5,network=Network(5986b25c-ca33-46df-8954-3050d4e83f6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb28874c-fe') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG os_vif [None req-8ed8e65f-ad63-4383-9884-02ebd13b43d3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:1d:cc,bridge_name='br-int',has_traffic_filtering=True,id=eb28874c-fe73-4b5c-a8b4-d352c32e08d5,network=Network(5986b25c-ca33-46df-8954-3050d4e83f6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb28874c-fe') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeb28874c-fe, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:56 user nova-compute[231753]: INFO os_vif [None req-8ed8e65f-ad63-4383-9884-02ebd13b43d3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2a:1d:cc,bridge_name='br-int',has_traffic_filtering=True,id=eb28874c-fe73-4b5c-a8b4-d352c32e08d5,network=Network(5986b25c-ca33-46df-8954-3050d4e83f6c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeb28874c-fe')
Jul 29 13:35:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-8ed8e65f-ad63-4383-9884-02ebd13b43d3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] set metadata xml: <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:35:56 user nova-compute[231753]:   <nova:package version="0.0.0"/>
Jul 29 13:35:56 user nova-compute[231753]:   <nova:name>tempest-device-tagging-server-1148074335</nova:name>
Jul 29 13:35:56 user nova-compute[231753]:   <nova:creationTime>2023-07-29 13:35:56</nova:creationTime>
Jul 29 13:35:56 user nova-compute[231753]:   <nova:flavor name="m1.tiny">
Jul 29 13:35:56 user nova-compute[231753]:     <nova:memory>512</nova:memory>
Jul 29 13:35:56 user nova-compute[231753]:     <nova:disk>1</nova:disk>
Jul 29 13:35:56 user nova-compute[231753]:     <nova:swap>0</nova:swap>
Jul 29 13:35:56 user nova-compute[231753]:     <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:35:56 user nova-compute[231753]:     <nova:vcpus>1</nova:vcpus>
Jul 29 13:35:56 user nova-compute[231753]:   </nova:flavor>
Jul 29 13:35:56 user nova-compute[231753]:   <nova:owner>
Jul 29 13:35:56 user nova-compute[231753]:     <nova:user uuid="8de5c966bbb948499c560ea5ab63a960">tempest-TaggedAttachmentsTest-1208246720-project-member</nova:user>
Jul 29 13:35:56 user nova-compute[231753]:     <nova:project uuid="19ab44f715024188b10545aac4cbb675">tempest-TaggedAttachmentsTest-1208246720</nova:project>
Jul 29 13:35:56 user nova-compute[231753]:   </nova:owner>
Jul 29 13:35:56 user nova-compute[231753]:   <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:35:56 user nova-compute[231753]:   <nova:ports>
Jul 29 13:35:56 user nova-compute[231753]:     <nova:port uuid="7881fb42-caac-4254-a8ef-16b49c754bf9">
Jul 29 13:35:56 user nova-compute[231753]:       <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 29 13:35:56 user nova-compute[231753]:     </nova:port>
Jul 29 13:35:56 user nova-compute[231753]:   </nova:ports>
Jul 29 13:35:56 user nova-compute[231753]: </nova:instance>
Jul 29 13:35:56 user nova-compute[231753]:  {{(pid=231753) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:359}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] No BDM found with device name sda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] No BDM found with device name sdb, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] No BDM found with device name sdc, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] No VIF found with MAC fa:16:3e:bc:36:c7, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG nova.compute.manager [req-a43bf019-4041-4849-8765-9a9f952213dc req-b27aa827-07ec-4f9c-a911-ea7d63eabf3e service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Received event network-vif-unplugged-eb28874c-fe73-4b5c-a8b4-d352c32e08d5 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a43bf019-4041-4849-8765-9a9f952213dc req-b27aa827-07ec-4f9c-a911-ea7d63eabf3e service nova] Acquiring lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a43bf019-4041-4849-8765-9a9f952213dc req-b27aa827-07ec-4f9c-a911-ea7d63eabf3e service nova] Lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a43bf019-4041-4849-8765-9a9f952213dc req-b27aa827-07ec-4f9c-a911-ea7d63eabf3e service nova] Lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:56 user nova-compute[231753]: DEBUG nova.compute.manager [req-a43bf019-4041-4849-8765-9a9f952213dc req-b27aa827-07ec-4f9c-a911-ea7d63eabf3e service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] No waiting events found dispatching network-vif-unplugged-eb28874c-fe73-4b5c-a8b4-d352c32e08d5 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:35:56 user nova-compute[231753]: WARNING nova.compute.manager [req-a43bf019-4041-4849-8765-9a9f952213dc req-b27aa827-07ec-4f9c-a911-ea7d63eabf3e service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Received unexpected event network-vif-unplugged-eb28874c-fe73-4b5c-a8b4-d352c32e08d5 for instance with vm_state active and task_state None.
Jul 29 13:35:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-24b47b70-cd2a-46d2-ab28-e69919f3cfdf tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Lock "1be12e63-8803-4ffa-82e1-2fe38f6b5d2d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.583s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8ed8e65f-ad63-4383-9884-02ebd13b43d3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Acquiring lock "refresh_cache-8822efe3-e17a-4511-b75f-37f6a83616aa" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:35:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8ed8e65f-ad63-4383-9884-02ebd13b43d3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Acquired lock "refresh_cache-8822efe3-e17a-4511-b75f-37f6a83616aa" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:35:57 user nova-compute[231753]: DEBUG nova.network.neutron [None req-8ed8e65f-ad63-4383-9884-02ebd13b43d3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:35:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8d6a7bcb-fffd-445d-a3e6-fc1bea1ae6fd tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Acquiring lock "1be12e63-8803-4ffa-82e1-2fe38f6b5d2d" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8d6a7bcb-fffd-445d-a3e6-fc1bea1ae6fd tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Lock "1be12e63-8803-4ffa-82e1-2fe38f6b5d2d" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:57 user nova-compute[231753]: INFO nova.compute.manager [None req-8d6a7bcb-fffd-445d-a3e6-fc1bea1ae6fd tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Detaching volume 4bfc4bb7-4040-4e54-b579-0dce72c639c6
Jul 29 13:35:57 user nova-compute[231753]: INFO nova.virt.block_device [None req-8d6a7bcb-fffd-445d-a3e6-fc1bea1ae6fd tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Attempting to driver detach volume 4bfc4bb7-4040-4e54-b579-0dce72c639c6 from mountpoint /dev/sdc
Jul 29 13:35:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-8d6a7bcb-fffd-445d-a3e6-fc1bea1ae6fd tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Attempting to detach device sdc from instance 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d from the persistent domain config. {{(pid=231753) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 13:35:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-8d6a7bcb-fffd-445d-a3e6-fc1bea1ae6fd tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:35:57 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:35:57 user nova-compute[231753]:   <source dev="/dev/sdf"/>
Jul 29 13:35:57 user nova-compute[231753]:   <target dev="sdc" bus="scsi"/>
Jul 29 13:35:57 user nova-compute[231753]:   <serial>4bfc4bb7-4040-4e54-b579-0dce72c639c6</serial>
Jul 29 13:35:57 user nova-compute[231753]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 29 13:35:57 user nova-compute[231753]: </disk>
Jul 29 13:35:57 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:35:57 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-8d6a7bcb-fffd-445d-a3e6-fc1bea1ae6fd tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Successfully detached device sdc from instance 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d from the persistent domain config.
Jul 29 13:35:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-8d6a7bcb-fffd-445d-a3e6-fc1bea1ae6fd tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] (1/8): Attempting to detach device sdc with device alias scsi0-0-0-2 from instance 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d from the live domain config. {{(pid=231753) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 13:35:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-8d6a7bcb-fffd-445d-a3e6-fc1bea1ae6fd tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:35:57 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:35:57 user nova-compute[231753]:   <source dev="/dev/sdf"/>
Jul 29 13:35:57 user nova-compute[231753]:   <target dev="sdc" bus="scsi"/>
Jul 29 13:35:57 user nova-compute[231753]:   <serial>4bfc4bb7-4040-4e54-b579-0dce72c639c6</serial>
Jul 29 13:35:57 user nova-compute[231753]:   <address type="drive" controller="0" bus="0" target="0" unit="2"/>
Jul 29 13:35:57 user nova-compute[231753]: </disk>
Jul 29 13:35:57 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:35:57 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Received event <DeviceRemovedEvent: 1690637758.1280947, 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d => scsi0-0-0-2> from libvirt while the driver is waiting for it; dispatched. {{(pid=231753) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-8d6a7bcb-fffd-445d-a3e6-fc1bea1ae6fd tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Start waiting for the detach event from libvirt for device sdc with device alias scsi0-0-0-2 for instance 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d {{(pid=231753) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 13:35:58 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-8d6a7bcb-fffd-445d-a3e6-fc1bea1ae6fd tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Successfully detached device sdc from instance 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d from the live domain config.
Jul 29 13:35:58 user nova-compute[231753]: INFO nova.network.neutron [None req-8ed8e65f-ad63-4383-9884-02ebd13b43d3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Port eb28874c-fe73-4b5c-a8b4-d352c32e08d5 from network info_cache is no longer associated with instance in Neutron. Removing from network info_cache.
Jul 29 13:35:58 user nova-compute[231753]: DEBUG nova.network.neutron [None req-8ed8e65f-ad63-4383-9884-02ebd13b43d3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Updating instance_info_cache with network_info: [{"id": "7881fb42-caac-4254-a8ef-16b49c754bf9", "address": "fa:16:3e:3b:15:58", "network": {"id": "12eb887a-c8b0-4fa9-ad24-8dbd6632aa5b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1203369018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19ab44f715024188b10545aac4cbb675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7881fb42-ca", "ovs_interfaceid": "7881fb42-caac-4254-a8ef-16b49c754bf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d6a7bcb-fffd-445d-a3e6-fc1bea1ae6fd tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6a7bcb-fffd-445d-a3e6-fc1bea1ae6fd tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tASToRKZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:35:58 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-8d6a7bcb-fffd-445d-a3e6-fc1bea1ae6fd tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:35:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-8d6a7bcb-fffd-445d-a3e6-fc1bea1ae6fd tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-8d6a7bcb-fffd-445d-a3e6-fc1bea1ae6fd tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8ed8e65f-ad63-4383-9884-02ebd13b43d3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Releasing lock "refresh_cache-8822efe3-e17a-4511-b75f-37f6a83616aa" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[376a7f51-a856-49db-bef1-472cce114101]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6a7bcb-fffd-445d-a3e6-fc1bea1ae6fd tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:35:58 user nova-compute[231753]: No targets found.
Jul 29 13:35:58 user nova-compute[231753]: iSNS:
Jul 29 13:35:58 user nova-compute[231753]: No targets found.
Jul 29 13:35:58 user nova-compute[231753]: STATIC:
Jul 29 13:35:58 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d
Jul 29 13:35:58 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:35:58 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:35:58 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6
Jul 29 13:35:58 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:35:58 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:35:58 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008
Jul 29 13:35:58 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:35:58 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:35:58 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf
Jul 29 13:35:58 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:35:58 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:35:58 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c
Jul 29 13:35:58 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:35:58 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:35:58 user nova-compute[231753]: FIRMWARE:
Jul 29 13:35:58 user nova-compute[231753]: No targets found.
Jul 29 13:35:58 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6a7bcb-fffd-445d-a3e6-fc1bea1ae6fd tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:35:58 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:35:58 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6a7bcb-fffd-445d-a3e6-fc1bea1ae6fd tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3592ccca-0a36-4abf-8619-423202f35eb8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8ed8e65f-ad63-4383-9884-02ebd13b43d3 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lock "interface-8822efe3-e17a-4511-b75f-37f6a83616aa-eb28874c-fe73-4b5c-a8b4-d352c32e08d5" "released" by "nova.compute.manager.ComputeManager.detach_interface.<locals>.do_detach_interface" :: held 2.100s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e219b61-7d5c-4d67-bbf5-76584160d760]: (4, ('tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6 (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6a7bcb-fffd-445d-a3e6-fc1bea1ae6fd tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6 (non-flash)
Jul 29 13:35:58 user nova-compute[231753]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:35:58 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:35:58 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:35:58 user nova-compute[231753]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)
Jul 29 13:35:58 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6a7bcb-fffd-445d-a3e6-fc1bea1ae6fd tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] iscsi session list stdout=tcp: [10] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6 (non-flash)
Jul 29 13:35:58 user nova-compute[231753]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:35:58 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:35:58 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:35:58 user nova-compute[231753]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)
Jul 29 13:35:58 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6a7bcb-fffd-445d-a3e6-fc1bea1ae6fd tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c982a8940>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6'): ({'sdf'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-8d6a7bcb-fffd-445d-a3e6-fc1bea1ae6fd tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Removing single pathed devices sdf {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6eddff67-10d4-4f32-b7f3-6591a2f04ca3]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2eda0cb-d072-4304-ab0d-129d8f51a962]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-8d6a7bcb-fffd-445d-a3e6-fc1bea1ae6fd tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Flushing IO for device /dev/sdf {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a48e9281-3b91-476e-b4c3-22aedc4a568c]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-8d6a7bcb-fffd-445d-a3e6-fc1bea1ae6fd tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.038s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8274a23d-db5f-41bb-80fc-0656ef7ccc0b]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-8d6a7bcb-fffd-445d-a3e6-fc1bea1ae6fd tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-8d6a7bcb-fffd-445d-a3e6-fc1bea1ae6fd tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] SCSI volumes sdf have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6a7bcb-fffd-445d-a3e6-fc1bea1ae6fd tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[092c02cc-85ff-4975-aabb-4dedf0fec0b5]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6a7bcb-fffd-445d-a3e6-fc1bea1ae6fd tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6 -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0be82e3a-3ddc-467a-86e1-241d151b82f6]: (4, ('Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6, portal: 172.16.0.220,3260]\nLogout of [sid: 10, target: iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6a7bcb-fffd-445d-a3e6-fc1bea1ae6fd tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6, portal: 172.16.0.220,3260]
Jul 29 13:35:58 user nova-compute[231753]: Logout of [sid: 10, target: iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6, portal: 172.16.0.220,3260] successful.
Jul 29 13:35:58 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6 -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4bfc4bb7-4040-4e54-b579-0dce72c639c6 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66377e0-2b02-4993-9f65-8becf4785aa9]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6a7bcb-fffd-445d-a3e6-fc1bea1ae6fd tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-8d6a7bcb-fffd-445d-a3e6-fc1bea1ae6fd tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8d6a7bcb-fffd-445d-a3e6-fc1bea1ae6fd tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] <== disconnect_volume: return (333ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8d6a7bcb-fffd-445d-a3e6-fc1bea1ae6fd tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG nova.compute.manager [req-58ca238e-ee25-4e6a-9d3c-98a03802020b req-daac9fae-e67c-4d01-83cb-f4a7cee04e27 service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Received event network-vif-plugged-eb28874c-fe73-4b5c-a8b4-d352c32e08d5 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-58ca238e-ee25-4e6a-9d3c-98a03802020b req-daac9fae-e67c-4d01-83cb-f4a7cee04e27 service nova] Acquiring lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-58ca238e-ee25-4e6a-9d3c-98a03802020b req-daac9fae-e67c-4d01-83cb-f4a7cee04e27 service nova] Lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-58ca238e-ee25-4e6a-9d3c-98a03802020b req-daac9fae-e67c-4d01-83cb-f4a7cee04e27 service nova] Lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:35:58 user nova-compute[231753]: DEBUG nova.compute.manager [req-58ca238e-ee25-4e6a-9d3c-98a03802020b req-daac9fae-e67c-4d01-83cb-f4a7cee04e27 service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] No waiting events found dispatching network-vif-plugged-eb28874c-fe73-4b5c-a8b4-d352c32e08d5 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:35:58 user nova-compute[231753]: WARNING nova.compute.manager [req-58ca238e-ee25-4e6a-9d3c-98a03802020b req-daac9fae-e67c-4d01-83cb-f4a7cee04e27 service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Received unexpected event network-vif-plugged-eb28874c-fe73-4b5c-a8b4-d352c32e08d5 for instance with vm_state active and task_state None.
Jul 29 13:35:58 user nova-compute[231753]: DEBUG nova.compute.manager [req-58ca238e-ee25-4e6a-9d3c-98a03802020b req-daac9fae-e67c-4d01-83cb-f4a7cee04e27 service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Received event network-vif-deleted-eb28874c-fe73-4b5c-a8b4-d352c32e08d5 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:35:59 user nova-compute[231753]: DEBUG nova.objects.instance [None req-8d6a7bcb-fffd-445d-a3e6-fc1bea1ae6fd tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Lazy-loading 'flavor' on Instance uuid 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:35:59 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8d6a7bcb-fffd-445d-a3e6-fc1bea1ae6fd tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Lock "1be12e63-8803-4ffa-82e1-2fe38f6b5d2d" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.801s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-12b07580-acc3-41df-9082-2a248705279c tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Acquiring lock "1be12e63-8803-4ffa-82e1-2fe38f6b5d2d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-12b07580-acc3-41df-9082-2a248705279c tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Lock "1be12e63-8803-4ffa-82e1-2fe38f6b5d2d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-12b07580-acc3-41df-9082-2a248705279c tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Acquiring lock "1be12e63-8803-4ffa-82e1-2fe38f6b5d2d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-12b07580-acc3-41df-9082-2a248705279c tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Lock "1be12e63-8803-4ffa-82e1-2fe38f6b5d2d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-12b07580-acc3-41df-9082-2a248705279c tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Lock "1be12e63-8803-4ffa-82e1-2fe38f6b5d2d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:00 user nova-compute[231753]: INFO nova.compute.manager [None req-12b07580-acc3-41df-9082-2a248705279c tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Terminating instance
Jul 29 13:36:00 user nova-compute[231753]: DEBUG nova.compute.manager [None req-12b07580-acc3-41df-9082-2a248705279c tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:36:00 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:00 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:00 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:00 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:00 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:00 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:00 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Instance destroyed successfully.
Jul 29 13:36:00 user nova-compute[231753]: DEBUG nova.objects.instance [None req-12b07580-acc3-41df-9082-2a248705279c tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Lazy-loading 'resources' on Instance uuid 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:36:00 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-12b07580-acc3-41df-9082-2a248705279c tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:33:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-390597877',display_name='tempest-AttachSCSIVolumeTestJSON-server-390597877',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachscsivolumetestjson-server-390597877',id=9,image_ref='ca3d141d-365c-43bb-be22-68278e6218f0',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBItVTl19j+M7mYQMrxcBhRQHJF1v1vD+/v5ngMDQaPt0tKmniO5U24VkZNpAw5j5yXAQh88t9PCCvHOm6I44Jbe0n4KhUwuVD2V05FAaEfph4uZ3b5soZeQ/N+qvNr64EA==',key_name='tempest-keypair-1894886950',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:34:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='98859b41061e45e1a920f57c36b4479f',ramdisk_id='',reservation_id='r-ulg7fbel',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='ca3d141d-365c-43bb-be22-68278e6218f0',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-316015273',owner_user_name='tempest-AttachSCSIVolumeTestJSON-316015273-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:34:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='b6a2294e0c674f2d83dcbbfbc208964a',uuid=1be12e63-8803-4ffa-82e1-2fe38f6b5d2d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "123e72ae-5ed8-4181-bef2-28713da2545a", "address": "fa:16:3e:bc:36:c7", "network": {"id": "be6b68b0-c543-441a-a338-deabdf4d97f6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1540506582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98859b41061e45e1a920f57c36b4479f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123e72ae-5e", "ovs_interfaceid": "123e72ae-5ed8-4181-bef2-28713da2545a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:36:00 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-12b07580-acc3-41df-9082-2a248705279c tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Converting VIF {"id": "123e72ae-5ed8-4181-bef2-28713da2545a", "address": "fa:16:3e:bc:36:c7", "network": {"id": "be6b68b0-c543-441a-a338-deabdf4d97f6", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1540506582-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.247", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "98859b41061e45e1a920f57c36b4479f", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap123e72ae-5e", "ovs_interfaceid": "123e72ae-5ed8-4181-bef2-28713da2545a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:36:00 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-12b07580-acc3-41df-9082-2a248705279c tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:bc:36:c7,bridge_name='br-int',has_traffic_filtering=True,id=123e72ae-5ed8-4181-bef2-28713da2545a,network=Network(be6b68b0-c543-441a-a338-deabdf4d97f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap123e72ae-5e') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:36:00 user nova-compute[231753]: DEBUG os_vif [None req-12b07580-acc3-41df-9082-2a248705279c tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:36:c7,bridge_name='br-int',has_traffic_filtering=True,id=123e72ae-5ed8-4181-bef2-28713da2545a,network=Network(be6b68b0-c543-441a-a338-deabdf4d97f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap123e72ae-5e') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:36:00 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:00 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap123e72ae-5e, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:36:00 user nova-compute[231753]: DEBUG nova.compute.manager [req-d75071b7-ea84-43b9-a5b0-6c40bae548c3 req-32f81951-7e2f-4bd7-a764-ae8cea68f132 service nova] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Received event network-vif-unplugged-123e72ae-5ed8-4181-bef2-28713da2545a {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d75071b7-ea84-43b9-a5b0-6c40bae548c3 req-32f81951-7e2f-4bd7-a764-ae8cea68f132 service nova] Acquiring lock "1be12e63-8803-4ffa-82e1-2fe38f6b5d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d75071b7-ea84-43b9-a5b0-6c40bae548c3 req-32f81951-7e2f-4bd7-a764-ae8cea68f132 service nova] Lock "1be12e63-8803-4ffa-82e1-2fe38f6b5d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d75071b7-ea84-43b9-a5b0-6c40bae548c3 req-32f81951-7e2f-4bd7-a764-ae8cea68f132 service nova] Lock "1be12e63-8803-4ffa-82e1-2fe38f6b5d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:00 user nova-compute[231753]: DEBUG nova.compute.manager [req-d75071b7-ea84-43b9-a5b0-6c40bae548c3 req-32f81951-7e2f-4bd7-a764-ae8cea68f132 service nova] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] No waiting events found dispatching network-vif-unplugged-123e72ae-5ed8-4181-bef2-28713da2545a {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:36:00 user nova-compute[231753]: DEBUG nova.compute.manager [req-d75071b7-ea84-43b9-a5b0-6c40bae548c3 req-32f81951-7e2f-4bd7-a764-ae8cea68f132 service nova] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Received event network-vif-unplugged-123e72ae-5ed8-4181-bef2-28713da2545a for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:36:00 user nova-compute[231753]: DEBUG nova.compute.manager [req-d75071b7-ea84-43b9-a5b0-6c40bae548c3 req-32f81951-7e2f-4bd7-a764-ae8cea68f132 service nova] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Received event network-vif-plugged-123e72ae-5ed8-4181-bef2-28713da2545a {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d75071b7-ea84-43b9-a5b0-6c40bae548c3 req-32f81951-7e2f-4bd7-a764-ae8cea68f132 service nova] Acquiring lock "1be12e63-8803-4ffa-82e1-2fe38f6b5d2d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d75071b7-ea84-43b9-a5b0-6c40bae548c3 req-32f81951-7e2f-4bd7-a764-ae8cea68f132 service nova] Lock "1be12e63-8803-4ffa-82e1-2fe38f6b5d2d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d75071b7-ea84-43b9-a5b0-6c40bae548c3 req-32f81951-7e2f-4bd7-a764-ae8cea68f132 service nova] Lock "1be12e63-8803-4ffa-82e1-2fe38f6b5d2d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:00 user nova-compute[231753]: DEBUG nova.compute.manager [req-d75071b7-ea84-43b9-a5b0-6c40bae548c3 req-32f81951-7e2f-4bd7-a764-ae8cea68f132 service nova] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] No waiting events found dispatching network-vif-plugged-123e72ae-5ed8-4181-bef2-28713da2545a {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:36:00 user nova-compute[231753]: WARNING nova.compute.manager [req-d75071b7-ea84-43b9-a5b0-6c40bae548c3 req-32f81951-7e2f-4bd7-a764-ae8cea68f132 service nova] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Received unexpected event network-vif-plugged-123e72ae-5ed8-4181-bef2-28713da2545a for instance with vm_state active and task_state deleting.
Jul 29 13:36:00 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:00 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:36:00 user nova-compute[231753]: INFO os_vif [None req-12b07580-acc3-41df-9082-2a248705279c tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:bc:36:c7,bridge_name='br-int',has_traffic_filtering=True,id=123e72ae-5ed8-4181-bef2-28713da2545a,network=Network(be6b68b0-c543-441a-a338-deabdf4d97f6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap123e72ae-5e')
Jul 29 13:36:00 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-12b07580-acc3-41df-9082-2a248705279c tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Deleting instance files /opt/stack/data/nova/instances/1be12e63-8803-4ffa-82e1-2fe38f6b5d2d_del
Jul 29 13:36:00 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-12b07580-acc3-41df-9082-2a248705279c tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Deletion of /opt/stack/data/nova/instances/1be12e63-8803-4ffa-82e1-2fe38f6b5d2d_del complete
Jul 29 13:36:00 user nova-compute[231753]: INFO nova.compute.manager [None req-12b07580-acc3-41df-9082-2a248705279c tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 29 13:36:00 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-12b07580-acc3-41df-9082-2a248705279c tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:36:00 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:36:00 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:36:00 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG nova.compute.manager [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RgCoJrvq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b02ec16d-24a3-450d-858d-3ad302086ac3', 'attached_at': '', 'detached_at': '', 'volume_id': '0ce5cc94-fc7d-45dd-a970-f73d9c853fdd', 'serial': '0ce5cc94-fc7d-45dd-a970-f73d9c853fdd'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SWZqXMbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'b02ec16d-24a3-450d-858d-3ad302086ac3', 'attached_at': '', 'detached_at': '', 'volume_id': 'a8f01b66-d2ac-4dae-99f7-04556527fb6d', 'serial'} {{(pid=231753) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Jul 29 13:36:02 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Took 1.75 seconds to deallocate network for instance.
Jul 29 13:36:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RgCoJrvq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:36:02 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:36:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:36:02 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:36:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:36:02 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:36:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[58744c68-a13f-4985-a0da-6f592e9a6e3e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:36:02 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-12b07580-acc3-41df-9082-2a248705279c tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-12b07580-acc3-41df-9082-2a248705279c tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[24d12263-b785-4c6b-98e9-afdb452fc9ff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd] added
Jul 29 13:36:02 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[276426cb-1be6-4af1-973b-53a7e11cf6a1]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cb5b287-2068-4f01-a355-3e7a2d529400]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RgCoJrvq {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v RgCoJrvq" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f08b1ad-b4c2-4036-a11b-9d1d9789b1ad]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'RgCoJrvq'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[aae91dec-69c6-42a5-8b49-72f7d853cef1]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG nova.compute.manager [req-38d0f63b-4647-4218-9d2e-83de8e678628 req-1eb94b72-1135-4af3-8cbd-503f6c344e6a service nova] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Received event network-vif-deleted-123e72ae-5ed8-4181-bef2-28713da2545a {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.038s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f600edb6-61b9-4e97-8ad1-897e8e3b3489]: (4, ('tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:36:02 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:36:02 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:36:02 user nova-compute[231753]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)
Jul 29 13:36:02 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] iscsi session list stdout=tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:36:02 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:36:02 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:36:02 user nova-compute[231753]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)
Jul 29 13:36:02 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:36:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:03 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:03 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6033830c-37ee-4c33-bd30-76e5f7cf4e90]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:03 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd, portal: 172.16.0.220,3260]
Jul 29 13:36:03 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd, portal: 172.16.0.220,3260] successful.
Jul 29 13:36:03 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:36:03 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:03 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:03 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[24de75b4-25ad-4a4d-ac91-123942652610]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:03 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:36:03 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:03 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-12b07580-acc3-41df-9082-2a248705279c tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:36:03 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:03 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbf22355-ddcb-41e5-b92a-79180851c83c]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:03 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd (non-flash)
Jul 29 13:36:03 user nova-compute[231753]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:36:03 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:36:03 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:36:03 user nova-compute[231753]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)
Jul 29 13:36:03 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:36:03 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd (non-flash)
Jul 29 13:36:03 user nova-compute[231753]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:36:03 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:36:03 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:36:03 user nova-compute[231753]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)
Jul 29 13:36:03 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:36:03 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.403s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:36:03 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:36:03 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] HCTL ('37', '-', '-', 0) found on session 11 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:36:03 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Scanning host 37 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:36:03 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-12b07580-acc3-41df-9082-2a248705279c tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:36:03 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:03 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:03 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3990b9-a75d-4509-9609-b58ed16ce664]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:03 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Searching for a device in session 11 and hctl ['37', '*', '*', 0] yield: None {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:36:03 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-12b07580-acc3-41df-9082-2a248705279c tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.397s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:03 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-12b07580-acc3-41df-9082-2a248705279c tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Deleted allocations for instance 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d
Jul 29 13:36:03 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-12b07580-acc3-41df-9082-2a248705279c tempest-AttachSCSIVolumeTestJSON-316015273 tempest-AttachSCSIVolumeTestJSON-316015273-project-member] Lock "1be12e63-8803-4ffa-82e1-2fe38f6b5d2d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.260s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:04 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Searching for a device in session 11 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:36:04 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RgCoJrvq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:36:04 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.431s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:36:04 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] <== connect_volume: return (1432ms) {'type': 'block', 'scsi_wwn': '23962656536623166', 'path': '/dev/sdf'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:36:04 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23962656536623166', 'path': '/dev/sdf'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:36:04 user nova-compute[231753]: DEBUG nova.objects.instance [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Lazy-loading 'flavor' on Instance uuid b02ec16d-24a3-450d-858d-3ad302086ac3 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:36:04 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=231753) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 13:36:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] COPY block job progress, current cursor: 192937984 final cursor: 1073741824 {{(pid=231753) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 13:36:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] COPY block job progress, current cursor: 327155712 final cursor: 1073741824 {{(pid=231753) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 13:36:05 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] COPY block job progress, current cursor: 443547648 final cursor: 1073741824 {{(pid=231753) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 13:36:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] COPY block job progress, current cursor: 525336576 final cursor: 1073741824 {{(pid=231753) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 13:36:07 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] COPY block job progress, current cursor: 697303040 final cursor: 1073741824 {{(pid=231753) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 13:36:07 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] COPY block job progress, current cursor: 839909376 final cursor: 1073741824 {{(pid=231753) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 13:36:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:08 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] COPY block job progress, current cursor: 950009856 final cursor: 1073741824 {{(pid=231753) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 13:36:08 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] COPY block job progress, current cursor: 1065353216 final cursor: 1073741824 {{(pid=231753) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=231753) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SWZqXMbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:36:09 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:36:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff0e0db-fd73-401f-b7af-9d4657bc178b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:36:09 user nova-compute[231753]: No targets found.
Jul 29 13:36:09 user nova-compute[231753]: iSNS:
Jul 29 13:36:09 user nova-compute[231753]: No targets found.
Jul 29 13:36:09 user nova-compute[231753]: STATIC:
Jul 29 13:36:09 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d
Jul 29 13:36:09 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:36:09 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:36:09 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008
Jul 29 13:36:09 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:36:09 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:36:09 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf
Jul 29 13:36:09 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:36:09 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:36:09 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c
Jul 29 13:36:09 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:36:09 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:36:09 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd
Jul 29 13:36:09 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:36:09 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:36:09 user nova-compute[231753]: FIRMWARE:
Jul 29 13:36:09 user nova-compute[231753]: No targets found.
Jul 29 13:36:09 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:36:09 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:36:09 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[438652df-a83f-40d8-b7c9-456c47d04b10]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aee83a4-3aa1-4ebb-94c6-0f7925ff5ab3]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)\ntcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd (non-flash)
Jul 29 13:36:09 user nova-compute[231753]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:36:09 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:36:09 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:36:09 user nova-compute[231753]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)
Jul 29 13:36:09 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd (non-flash)
Jul 29 13:36:09 user nova-compute[231753]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:36:09 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:36:09 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:36:09 user nova-compute[231753]: tcp: [8] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)
Jul 29 13:36:09 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ca683f250>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d'): ({'sde'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Removing single pathed devices sde {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcc9564-fe51-4c58-affb-13a34d979411]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dd8c28a-5068-4ba3-a1ed-3b365be7e1aa]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Flushing IO for device /dev/sde {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92aaff2-fc7f-4666-8767-c47f975b7fa8]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1f0c851-6dab-42d0-a7b2-0b6e4200b671]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Checking to see if SCSI volumes sde have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] SCSI volumes sde have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d83f64e-899b-454d-a78e-e9f9ac98dc47]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --logout" returned: 0 in 0.073s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e110fb11-49ca-4ccb-bced-04136a373177]: (4, ('Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d, portal: 172.16.0.220,3260]\nLogout of [sid: 8, target: iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d, portal: 172.16.0.220,3260]
Jul 29 13:36:09 user nova-compute[231753]: Logout of [sid: 8, target: iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d, portal: 172.16.0.220,3260] successful.
Jul 29 13:36:09 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb8cb0d-b8ed-4ec8-b926-24f209c6b8f4]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] <== disconnect_volume: return (325ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG nova.compute.manager [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RgCoJrvq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, 'status': 'reserved', 'instance': 'b02ec16d-24a3-450d-858d-3ad302086ac3', 'attached_at': '', 'detached_at': '', 'volume_id': '0ce5cc94-fc7d-45dd-a970-f73d9c853fdd', 'serial'} {{(pid=231753) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Jul 29 13:36:09 user nova-compute[231753]: DEBUG nova.compute.manager [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] swap_volume: removing Cinder connection for volume a8f01b66-d2ac-4dae-99f7-04556527fb6d {{(pid=231753) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Jul 29 13:36:10 user nova-compute[231753]: DEBUG nova.compute.manager [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] swap_volume: Updating volume a8f01b66-d2ac-4dae-99f7-04556527fb6d BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "RgCoJrvq", "auth_password": "LX84EQi0gouOcV", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sdf", "volume_id": "0ce5cc94-fc7d-45dd-a970-f73d9c853fdd"}, "status": "reserved", "instance": "b02ec16d-24a3-450d-858d-3ad302086ac3", "attached_at": "", "detached_at": "", "volume_id": "0ce5cc94-fc7d-45dd-a970-f73d9c853fdd", "serial": "0ce5cc94-fc7d-45dd-a970-f73d9c853fdd"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': '0ce5cc94-fc7d-45dd-a970-f73d9c853fdd', 'no_device': None, 'attachment_id': '10867460-0f52-4fd0-a53f-0722b1b8e040'} {{(pid=231753) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Jul 29 13:36:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-26fdf759-fa75-489f-b059-dd45870c78c2 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Lock "b02ec16d-24a3-450d-858d-3ad302086ac3" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 18.331s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Acquiring lock "b02ec16d-24a3-450d-858d-3ad302086ac3" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Lock "b02ec16d-24a3-450d-858d-3ad302086ac3" acquired by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:12 user nova-compute[231753]: DEBUG os_brick.utils [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:36:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:12 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[de37144e-ae52-41ec-b311-4c6c38ac36e4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:12 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b343883-d9b5-4af7-b289-8d82fe1450a8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:12 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d2bb7d9-dc72-4d53-b337-62cccc6b8beb]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:12 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c0ec5e-221c-4f1d-a743-c5df4860205f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:36:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:36:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:36:12 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:36:12 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b377b5b5-3073-4297-b1cc-231830822354]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:36:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:36:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:36:12 user nova-compute[231753]: DEBUG os_brick.utils [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] <== get_connector_properties: return (112ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:36:12 user nova-compute[231753]: INFO nova.compute.manager [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Swapping volume 0ce5cc94-fc7d-45dd-a970-f73d9c853fdd for a8f01b66-d2ac-4dae-99f7-04556527fb6d
Jul 29 13:36:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:13 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:36:13 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:36:13 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 13:36:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "refresh_cache-3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:36:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquired lock "refresh_cache-3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:36:13 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Forcefully refreshing network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 13:36:13 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Updating instance_info_cache with network_info: [{"id": "2a7981fb-647d-4610-9da2-3b162f366dfe", "address": "fa:16:3e:0c:e3:a3", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7981fb-64", "ovs_interfaceid": "2a7981fb-647d-4610-9da2-3b162f366dfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:36:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Releasing lock "refresh_cache-3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:36:13 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Updated the network info_cache for instance {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 13:36:13 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:36:13 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:36:13 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:36:13 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:36:13 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:36:13 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:36:13 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 13:36:13 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:36:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 13:36:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02ec16d-24a3-450d-858d-3ad302086ac3/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02ec16d-24a3-450d-858d-3ad302086ac3/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02ec16d-24a3-450d-858d-3ad302086ac3/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02ec16d-24a3-450d-858d-3ad302086ac3/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:36:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d25aef1-5ef1-42a9-be32-1e26077f7b74/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d25aef1-5ef1-42a9-be32-1e26077f7b74/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d25aef1-5ef1-42a9-be32-1e26077f7b74/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3d25aef1-5ef1-42a9-be32-1e26077f7b74/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:15 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690637760.8410506, 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:36:15 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] VM Stopped (Lifecycle Event)
Jul 29 13:36:15 user nova-compute[231753]: DEBUG nova.compute.manager [None req-8c1876a2-a450-46e5-92d0-d68a9efa3006 None None] [instance: 1be12e63-8803-4ffa-82e1-2fe38f6b5d2d] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:36:15 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Acquiring lock "3fed0e1e-c8a7-43cc-bef6-14410111d3cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "3fed0e1e-c8a7-43cc-bef6-14410111d3cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:16 user nova-compute[231753]: DEBUG nova.compute.manager [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:36:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:36:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:36:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdd (vdc) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:36:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:16 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:36:16 user nova-compute[231753]: INFO nova.compute.claims [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Claim successful on node user
Jul 29 13:36:16 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:36:16 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:36:16 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=7292MB free_disk=25.53377914428711GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 13:36:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.910s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG nova.compute.manager [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.357s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG nova.compute.manager [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG nova.network.neutron [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:36:17 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:36:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 63fad324-aac2-4d60-b4ce-a32a5736657d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b67b98f8-a7b3-499e-ba32-9520bbced960 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 299b7f21-b198-437b-9d5c-1269d5e9b7c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8822efe3-e17a-4511-b75f-37f6a83616aa actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b02ec16d-24a3-450d-858d-3ad302086ac3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 5127f26d-e912-49a4-b8ae-6157f0055270 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 3d25aef1-5ef1-42a9-be32-1e26077f7b74 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 3fed0e1e-c8a7-43cc-bef6-14410111d3cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG nova.compute.manager [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG nova.policy [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2c57d05306648e786200a93a121966e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd0f16e49ef48ff99752b6aec718358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG nova.compute.manager [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:36:17 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Creating image(s)
Jul 29 13:36:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Acquiring lock "/opt/stack/data/nova/instances/3fed0e1e-c8a7-43cc-bef6-14410111d3cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "/opt/stack/data/nova/instances/3fed0e1e-c8a7-43cc-bef6-14410111d3cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "/opt/stack/data/nova/instances/3fed0e1e-c8a7-43cc-bef6-14410111d3cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.144s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.529s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.143s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/3fed0e1e-c8a7-43cc-bef6-14410111d3cb/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/3fed0e1e-c8a7-43cc-bef6-14410111d3cb/disk 1073741824" returned: 0 in 0.055s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.204s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.157s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3fed0e1e-c8a7-43cc-bef6-14410111d3cb/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:36:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fed0e1e-c8a7-43cc-bef6-14410111d3cb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:18 user nova-compute[231753]: DEBUG nova.network.neutron [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Successfully created port: 47c9a3cb-360f-4fd1-8233-37b32039d047 {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:36:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fed0e1e-c8a7-43cc-bef6-14410111d3cb/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:18 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Cannot resize image /opt/stack/data/nova/instances/3fed0e1e-c8a7-43cc-bef6-14410111d3cb/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:36:18 user nova-compute[231753]: DEBUG nova.objects.instance [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lazy-loading 'migration_context' on Instance uuid 3fed0e1e-c8a7-43cc-bef6-14410111d3cb {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:36:18 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:36:18 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Ensure instance console log exists: /opt/stack/data/nova/instances/3fed0e1e-c8a7-43cc-bef6-14410111d3cb/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:36:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:18 user nova-compute[231753]: DEBUG nova.network.neutron [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Successfully updated port: 47c9a3cb-360f-4fd1-8233-37b32039d047 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:36:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Acquiring lock "refresh_cache-3fed0e1e-c8a7-43cc-bef6-14410111d3cb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:36:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Acquired lock "refresh_cache-3fed0e1e-c8a7-43cc-bef6-14410111d3cb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:36:18 user nova-compute[231753]: DEBUG nova.network.neutron [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG nova.compute.manager [req-d6b298c5-5995-4787-9f8c-5a12e2c91610 req-13f0f652-f25a-474b-8ad8-3f509a93d476 service nova] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Received event network-changed-47c9a3cb-360f-4fd1-8233-37b32039d047 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG nova.compute.manager [req-d6b298c5-5995-4787-9f8c-5a12e2c91610 req-13f0f652-f25a-474b-8ad8-3f509a93d476 service nova] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Refreshing instance network info cache due to event network-changed-47c9a3cb-360f-4fd1-8233-37b32039d047. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d6b298c5-5995-4787-9f8c-5a12e2c91610 req-13f0f652-f25a-474b-8ad8-3f509a93d476 service nova] Acquiring lock "refresh_cache-3fed0e1e-c8a7-43cc-bef6-14410111d3cb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG nova.network.neutron [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG nova.network.neutron [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Updating instance_info_cache with network_info: [{"id": "47c9a3cb-360f-4fd1-8233-37b32039d047", "address": "fa:16:3e:3a:d8:c5", "network": {"id": "7f0a516e-a6d1-4198-b7f7-d1eef96625cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-408682612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd0f16e49ef48ff99752b6aec718358", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9a3cb-36", "ovs_interfaceid": "47c9a3cb-360f-4fd1-8233-37b32039d047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Releasing lock "refresh_cache-3fed0e1e-c8a7-43cc-bef6-14410111d3cb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG nova.compute.manager [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Instance network_info: |[{"id": "47c9a3cb-360f-4fd1-8233-37b32039d047", "address": "fa:16:3e:3a:d8:c5", "network": {"id": "7f0a516e-a6d1-4198-b7f7-d1eef96625cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-408682612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd0f16e49ef48ff99752b6aec718358", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9a3cb-36", "ovs_interfaceid": "47c9a3cb-360f-4fd1-8233-37b32039d047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d6b298c5-5995-4787-9f8c-5a12e2c91610 req-13f0f652-f25a-474b-8ad8-3f509a93d476 service nova] Acquired lock "refresh_cache-3fed0e1e-c8a7-43cc-bef6-14410111d3cb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG nova.network.neutron [req-d6b298c5-5995-4787-9f8c-5a12e2c91610 req-13f0f652-f25a-474b-8ad8-3f509a93d476 service nova] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Refreshing network info cache for port 47c9a3cb-360f-4fd1-8233-37b32039d047 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Start _get_guest_xml network_info=[{"id": "47c9a3cb-360f-4fd1-8233-37b32039d047", "address": "fa:16:3e:3a:d8:c5", "network": {"id": "7f0a516e-a6d1-4198-b7f7-d1eef96625cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-408682612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd0f16e49ef48ff99752b6aec718358", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9a3cb-36", "ovs_interfaceid": "47c9a3cb-360f-4fd1-8233-37b32039d047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:36:19 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:36:19 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:36:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:36:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-419127703',display_name='tempest-VolumesSnapshotTestJSON-instance-419127703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-419127703',id=12,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLp6Tu8K5Li96rC4eNYyNiNAtpqSGs51gz7XazH8kj/NOjG3aF9D7QBdi49hAu60ul/kKxnft+Ede0aTga4NmR6aY/XLPtopmQiM5VHpn4A3rb+HLAy9/DnuD7bjGStuCw==',key_name='tempest-keypair-365750693',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cdd0f16e49ef48ff99752b6aec718358',ramdisk_id='',reservation_id='r-qei4cl08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-563591119',owner_user_name='tempest-VolumesSnapshotTestJSON-563591119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:36:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2c57d05306648e786200a93a121966e',uuid=3fed0e1e-c8a7-43cc-bef6-14410111d3cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47c9a3cb-360f-4fd1-8233-37b32039d047", "address": "fa:16:3e:3a:d8:c5", "network": {"id": "7f0a516e-a6d1-4198-b7f7-d1eef96625cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-408682612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd0f16e49ef48ff99752b6aec718358", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9a3cb-36", "ovs_interfaceid": "47c9a3cb-360f-4fd1-8233-37b32039d047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Converting VIF {"id": "47c9a3cb-360f-4fd1-8233-37b32039d047", "address": "fa:16:3e:3a:d8:c5", "network": {"id": "7f0a516e-a6d1-4198-b7f7-d1eef96625cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-408682612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd0f16e49ef48ff99752b6aec718358", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9a3cb-36", "ovs_interfaceid": "47c9a3cb-360f-4fd1-8233-37b32039d047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:d8:c5,bridge_name='br-int',has_traffic_filtering=True,id=47c9a3cb-360f-4fd1-8233-37b32039d047,network=Network(7f0a516e-a6d1-4198-b7f7-d1eef96625cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c9a3cb-36') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG nova.objects.instance [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lazy-loading 'pci_devices' on Instance uuid 3fed0e1e-c8a7-43cc-bef6-14410111d3cb {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:36:19 user nova-compute[231753]:   <uuid>3fed0e1e-c8a7-43cc-bef6-14410111d3cb</uuid>
Jul 29 13:36:19 user nova-compute[231753]:   <name>instance-0000000c</name>
Jul 29 13:36:19 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:36:19 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:36:19 user nova-compute[231753]:   <metadata>
Jul 29 13:36:19 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:36:19 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:36:19 user nova-compute[231753]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-419127703</nova:name>
Jul 29 13:36:19 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:36:19</nova:creationTime>
Jul 29 13:36:19 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:36:19 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:36:19 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:36:19 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:36:19 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:36:19 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:36:19 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:36:19 user nova-compute[231753]:       <nova:owner>
Jul 29 13:36:19 user nova-compute[231753]:         <nova:user uuid="a2c57d05306648e786200a93a121966e">tempest-VolumesSnapshotTestJSON-563591119-project-member</nova:user>
Jul 29 13:36:19 user nova-compute[231753]:         <nova:project uuid="cdd0f16e49ef48ff99752b6aec718358">tempest-VolumesSnapshotTestJSON-563591119</nova:project>
Jul 29 13:36:19 user nova-compute[231753]:       </nova:owner>
Jul 29 13:36:19 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:36:19 user nova-compute[231753]:       <nova:ports>
Jul 29 13:36:19 user nova-compute[231753]:         <nova:port uuid="47c9a3cb-360f-4fd1-8233-37b32039d047">
Jul 29 13:36:19 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 29 13:36:19 user nova-compute[231753]:         </nova:port>
Jul 29 13:36:19 user nova-compute[231753]:       </nova:ports>
Jul 29 13:36:19 user nova-compute[231753]:     </nova:instance>
Jul 29 13:36:19 user nova-compute[231753]:   </metadata>
Jul 29 13:36:19 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:36:19 user nova-compute[231753]:     <system>
Jul 29 13:36:19 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:36:19 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:36:19 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:36:19 user nova-compute[231753]:       <entry name="serial">3fed0e1e-c8a7-43cc-bef6-14410111d3cb</entry>
Jul 29 13:36:19 user nova-compute[231753]:       <entry name="uuid">3fed0e1e-c8a7-43cc-bef6-14410111d3cb</entry>
Jul 29 13:36:19 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:36:19 user nova-compute[231753]:     </system>
Jul 29 13:36:19 user nova-compute[231753]:   </sysinfo>
Jul 29 13:36:19 user nova-compute[231753]:   <os>
Jul 29 13:36:19 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:36:19 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:36:19 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:36:19 user nova-compute[231753]:   </os>
Jul 29 13:36:19 user nova-compute[231753]:   <features>
Jul 29 13:36:19 user nova-compute[231753]:     <acpi/>
Jul 29 13:36:19 user nova-compute[231753]:     <apic/>
Jul 29 13:36:19 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:36:19 user nova-compute[231753]:   </features>
Jul 29 13:36:19 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:36:19 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:36:19 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:36:19 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:36:19 user nova-compute[231753]:   </clock>
Jul 29 13:36:19 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:36:19 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:36:19 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:36:19 user nova-compute[231753]:   </cpu>
Jul 29 13:36:19 user nova-compute[231753]:   <devices>
Jul 29 13:36:19 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:36:19 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:36:19 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/3fed0e1e-c8a7-43cc-bef6-14410111d3cb/disk"/>
Jul 29 13:36:19 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:36:19 user nova-compute[231753]:     </disk>
Jul 29 13:36:19 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:36:19 user nova-compute[231753]:       <mac address="fa:16:3e:3a:d8:c5"/>
Jul 29 13:36:19 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:36:19 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:36:19 user nova-compute[231753]:       <target dev="tap47c9a3cb-36"/>
Jul 29 13:36:19 user nova-compute[231753]:     </interface>
Jul 29 13:36:19 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:36:19 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/3fed0e1e-c8a7-43cc-bef6-14410111d3cb/console.log" append="off"/>
Jul 29 13:36:19 user nova-compute[231753]:     </serial>
Jul 29 13:36:19 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:36:19 user nova-compute[231753]:     <video>
Jul 29 13:36:19 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:36:19 user nova-compute[231753]:     </video>
Jul 29 13:36:19 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:36:19 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:36:19 user nova-compute[231753]:     </rng>
Jul 29 13:36:19 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:36:19 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:36:19 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:36:19 user nova-compute[231753]:     </memballoon>
Jul 29 13:36:19 user nova-compute[231753]:   </devices>
Jul 29 13:36:19 user nova-compute[231753]: </domain>
Jul 29 13:36:19 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:36:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-419127703',display_name='tempest-VolumesSnapshotTestJSON-instance-419127703',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-419127703',id=12,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLp6Tu8K5Li96rC4eNYyNiNAtpqSGs51gz7XazH8kj/NOjG3aF9D7QBdi49hAu60ul/kKxnft+Ede0aTga4NmR6aY/XLPtopmQiM5VHpn4A3rb+HLAy9/DnuD7bjGStuCw==',key_name='tempest-keypair-365750693',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cdd0f16e49ef48ff99752b6aec718358',ramdisk_id='',reservation_id='r-qei4cl08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-563591119',owner_user_name='tempest-VolumesSnapshotTestJSON-563591119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:36:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2c57d05306648e786200a93a121966e',uuid=3fed0e1e-c8a7-43cc-bef6-14410111d3cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "47c9a3cb-360f-4fd1-8233-37b32039d047", "address": "fa:16:3e:3a:d8:c5", "network": {"id": "7f0a516e-a6d1-4198-b7f7-d1eef96625cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-408682612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd0f16e49ef48ff99752b6aec718358", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9a3cb-36", "ovs_interfaceid": "47c9a3cb-360f-4fd1-8233-37b32039d047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Converting VIF {"id": "47c9a3cb-360f-4fd1-8233-37b32039d047", "address": "fa:16:3e:3a:d8:c5", "network": {"id": "7f0a516e-a6d1-4198-b7f7-d1eef96625cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-408682612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd0f16e49ef48ff99752b6aec718358", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9a3cb-36", "ovs_interfaceid": "47c9a3cb-360f-4fd1-8233-37b32039d047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:d8:c5,bridge_name='br-int',has_traffic_filtering=True,id=47c9a3cb-360f-4fd1-8233-37b32039d047,network=Network(7f0a516e-a6d1-4198-b7f7-d1eef96625cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c9a3cb-36') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG os_vif [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:d8:c5,bridge_name='br-int',has_traffic_filtering=True,id=47c9a3cb-360f-4fd1-8233-37b32039d047,network=Network(7f0a516e-a6d1-4198-b7f7-d1eef96625cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c9a3cb-36') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap47c9a3cb-36, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap47c9a3cb-36, col_values=(('external_ids', {'iface-id': '47c9a3cb-360f-4fd1-8233-37b32039d047', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:d8:c5', 'vm-uuid': '3fed0e1e-c8a7-43cc-bef6-14410111d3cb'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:19 user nova-compute[231753]: INFO os_vif [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:d8:c5,bridge_name='br-int',has_traffic_filtering=True,id=47c9a3cb-360f-4fd1-8233-37b32039d047,network=Network(7f0a516e-a6d1-4198-b7f7-d1eef96625cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c9a3cb-36')
Jul 29 13:36:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] No VIF found with MAC fa:16:3e:3a:d8:c5, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG nova.network.neutron [req-d6b298c5-5995-4787-9f8c-5a12e2c91610 req-13f0f652-f25a-474b-8ad8-3f509a93d476 service nova] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Updated VIF entry in instance network info cache for port 47c9a3cb-360f-4fd1-8233-37b32039d047. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG nova.network.neutron [req-d6b298c5-5995-4787-9f8c-5a12e2c91610 req-13f0f652-f25a-474b-8ad8-3f509a93d476 service nova] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Updating instance_info_cache with network_info: [{"id": "47c9a3cb-360f-4fd1-8233-37b32039d047", "address": "fa:16:3e:3a:d8:c5", "network": {"id": "7f0a516e-a6d1-4198-b7f7-d1eef96625cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-408682612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd0f16e49ef48ff99752b6aec718358", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9a3cb-36", "ovs_interfaceid": "47c9a3cb-360f-4fd1-8233-37b32039d047", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:36:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d6b298c5-5995-4787-9f8c-5a12e2c91610 req-13f0f652-f25a-474b-8ad8-3f509a93d476 service nova] Releasing lock "refresh_cache-3fed0e1e-c8a7-43cc-bef6-14410111d3cb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG nova.compute.manager [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] swap_volume: Calling driver volume swap with connection infos: new: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SWZqXMbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b02ec16d-24a3-450d-858d-3ad302086ac3', 'attached_at': '', 'detached_at': '', 'volume_id': 'a8f01b66-d2ac-4dae-99f7-04556527fb6d', 'serial': 'a8f01b66-d2ac-4dae-99f7-04556527fb6d'}; old: {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RgCoJrvq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '0ce5cc94-fc7d-45dd-a970-f73d9c853fdd'}, 'status': 'reserved', 'instance': 'b02ec16d-24a3-450d-858d-3ad302086ac3', 'attached_at': '', 'detached_at': '', 'volume_id': '0ce5cc94-fc7d-45dd-a970-f73d9c853fdd', 'serial'} {{(pid=231753) _swap_volume /opt/stack/nova/nova/compute/manager.py:7702}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SWZqXMbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:36:20 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:36:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:36:20 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:36:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:36:20 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:36:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[35c41e5b-6190-4d87-960b-d09e3a38c760]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:36:20 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c9598b-e273-4359-94d0-800050c69dff]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d] added
Jul 29 13:36:20 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[211c0624-0f1a-419a-b7b1-244832261cc3]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9574247-ce0d-4a4c-b775-2c128462d64d]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SWZqXMbc {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v SWZqXMbc" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb7d74a-0834-4c5b-a9e8-e25ba3c182f5]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'SWZqXMbc'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4250b18-2c65-40ca-8492-4ff404a5e314]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c96e81-9cc9-4b76-9f71-8fdb465f8545]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd (non-flash)
Jul 29 13:36:20 user nova-compute[231753]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:36:20 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:36:20 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:36:20 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd (non-flash)
Jul 29 13:36:20 user nova-compute[231753]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:36:20 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:36:20 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:36:20 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG nova.compute.manager [req-68cfcd98-a0b9-464c-8567-de5aacd6c2f1 req-f5bb71c6-99a7-4d4f-bf16-1f1aa8bc1a5b service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-changed-f6babf7d-a012-411a-a2cc-134c92ac26d8 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG nova.compute.manager [req-68cfcd98-a0b9-464c-8567-de5aacd6c2f1 req-f5bb71c6-99a7-4d4f-bf16-1f1aa8bc1a5b service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Refreshing instance network info cache due to event network-changed-f6babf7d-a012-411a-a2cc-134c92ac26d8. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-68cfcd98-a0b9-464c-8567-de5aacd6c2f1 req-f5bb71c6-99a7-4d4f-bf16-1f1aa8bc1a5b service nova] Acquiring lock "refresh_cache-5127f26d-e912-49a4-b8ae-6157f0055270" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-68cfcd98-a0b9-464c-8567-de5aacd6c2f1 req-f5bb71c6-99a7-4d4f-bf16-1f1aa8bc1a5b service nova] Acquired lock "refresh_cache-5127f26d-e912-49a4-b8ae-6157f0055270" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG nova.network.neutron [req-68cfcd98-a0b9-464c-8567-de5aacd6c2f1 req-f5bb71c6-99a7-4d4f-bf16-1f1aa8bc1a5b service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Refreshing network info cache for port f6babf7d-a012-411a-a2cc-134c92ac26d8 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eada47f-acc5-4561-b912-87b0ce7d6e11]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d, portal: 172.16.0.220,3260]
Jul 29 13:36:20 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d, portal: 172.16.0.220,3260] successful.
Jul 29 13:36:20 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fc3fe0-6c3e-440b-ac84-2ac77ccf4b4a]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a3b6de4-7adb-422f-975e-dd0ca4ecf215]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd (non-flash)
Jul 29 13:36:20 user nova-compute[231753]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)
Jul 29 13:36:20 user nova-compute[231753]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:36:20 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:36:20 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:36:20 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd (non-flash)
Jul 29 13:36:20 user nova-compute[231753]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)
Jul 29 13:36:20 user nova-compute[231753]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:36:20 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:36:20 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:36:20 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.347s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] HCTL ('36', '-', '-', 0) found on session 12 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Scanning host 36 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.015s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9354ffb-616f-449d-88c4-a248b8fe6f99]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Searching for a device in session 12 and hctl ['36', '*', '*', 0] yield: None {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:21 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Searching for a device in session 12 and hctl ['36', '*', '*', 0] yield: sde {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:36:21 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SWZqXMbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:36:21 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.377s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:36:21 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] <== connect_volume: return (1379ms) {'type': 'block', 'scsi_wwn': '23634366334306637', 'path': '/dev/sde'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:36:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23634366334306637', 'path': '/dev/sde'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:36:21 user nova-compute[231753]: DEBUG nova.objects.instance [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Lazy-loading 'flavor' on Instance uuid b02ec16d-24a3-450d-858d-3ad302086ac3 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:36:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:21 user nova-compute[231753]: DEBUG nova.network.neutron [req-68cfcd98-a0b9-464c-8567-de5aacd6c2f1 req-f5bb71c6-99a7-4d4f-bf16-1f1aa8bc1a5b service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Updated VIF entry in instance network info cache for port f6babf7d-a012-411a-a2cc-134c92ac26d8. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:36:21 user nova-compute[231753]: DEBUG nova.network.neutron [req-68cfcd98-a0b9-464c-8567-de5aacd6c2f1 req-f5bb71c6-99a7-4d4f-bf16-1f1aa8bc1a5b service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Updating instance_info_cache with network_info: [{"id": "f6babf7d-a012-411a-a2cc-134c92ac26d8", "address": "fa:16:3e:0f:55:20", "network": {"id": "506f7783-e44a-4de3-8c0d-aa1177c2eef6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-998637392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6babf7d-a0", "ovs_interfaceid": "f6babf7d-a012-411a-a2cc-134c92ac26d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c652fd6e-0d41-4593-8d73-893962490f30", "address": "fa:16:3e:45:ca:0a", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652fd6e-0d", "ovs_interfaceid": "c652fd6e-0d41-4593-8d73-893962490f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e106a9dd-3d36-4bea-953b-fe65ba4747a5", "address": "fa:16:3e:6a:51:5c", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106a9dd-3d", "ovs_interfaceid": "e106a9dd-3d36-4bea-953b-fe65ba4747a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28d91bef-df2e-469a-b449-10e27e352ee8", "address": "fa:16:3e:d4:e9:c0", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d91bef-df", "ovs_interfaceid": "28d91bef-df2e-469a-b449-10e27e352ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "7a1e3eda-8abb-49ca-a495-aa7f584a9252", "address": "fa:16:3e:30:08:c1", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1e3eda-8a", "ovs_interfaceid": "7a1e3eda-8abb-49ca-a495-aa7f584a9252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0dd83ad9-c54b-4c90-981a-8982501e36cf", "address": "fa:16:3e:cb:c0:08", "network": {"id": "70108ad7-d95b-4b71-a4b1-d6750a3d30cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-155167949", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dd83ad9-c5", "ovs_interfaceid": "0dd83ad9-c54b-4c90-981a-8982501e36cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "713bc8f5-df03-42c3-8250-ff7ed4e07f4e", "address": "fa:16:3e:22:fe:88", "network": {"id": "70108ad7-d95b-4b71-a4b1-d6750a3d30cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-155167949", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap713bc8f5-df", "ovs_interfaceid": "713bc8f5-df03-42c3-8250-ff7ed4e07f4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:36:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-68cfcd98-a0b9-464c-8567-de5aacd6c2f1 req-f5bb71c6-99a7-4d4f-bf16-1f1aa8bc1a5b service nova] Releasing lock "refresh_cache-5127f26d-e912-49a4-b8ae-6157f0055270" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:36:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] COPY block job progress, current cursor: 0 final cursor: 1073741824 {{(pid=231753) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 13:36:22 user nova-compute[231753]: DEBUG nova.compute.manager [req-6b49f494-09a9-4323-be38-231f5071f6e1 req-c8c95e2e-f6cc-430f-95d2-097f6d6b4b75 service nova] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Received event network-vif-plugged-47c9a3cb-360f-4fd1-8233-37b32039d047 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6b49f494-09a9-4323-be38-231f5071f6e1 req-c8c95e2e-f6cc-430f-95d2-097f6d6b4b75 service nova] Acquiring lock "3fed0e1e-c8a7-43cc-bef6-14410111d3cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6b49f494-09a9-4323-be38-231f5071f6e1 req-c8c95e2e-f6cc-430f-95d2-097f6d6b4b75 service nova] Lock "3fed0e1e-c8a7-43cc-bef6-14410111d3cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6b49f494-09a9-4323-be38-231f5071f6e1 req-c8c95e2e-f6cc-430f-95d2-097f6d6b4b75 service nova] Lock "3fed0e1e-c8a7-43cc-bef6-14410111d3cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:22 user nova-compute[231753]: DEBUG nova.compute.manager [req-6b49f494-09a9-4323-be38-231f5071f6e1 req-c8c95e2e-f6cc-430f-95d2-097f6d6b4b75 service nova] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] No waiting events found dispatching network-vif-plugged-47c9a3cb-360f-4fd1-8233-37b32039d047 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:36:22 user nova-compute[231753]: WARNING nova.compute.manager [req-6b49f494-09a9-4323-be38-231f5071f6e1 req-c8c95e2e-f6cc-430f-95d2-097f6d6b4b75 service nova] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Received unexpected event network-vif-plugged-47c9a3cb-360f-4fd1-8233-37b32039d047 for instance with vm_state building and task_state spawning.
Jul 29 13:36:22 user nova-compute[231753]: DEBUG nova.compute.manager [req-6b49f494-09a9-4323-be38-231f5071f6e1 req-c8c95e2e-f6cc-430f-95d2-097f6d6b4b75 service nova] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Received event network-vif-plugged-47c9a3cb-360f-4fd1-8233-37b32039d047 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6b49f494-09a9-4323-be38-231f5071f6e1 req-c8c95e2e-f6cc-430f-95d2-097f6d6b4b75 service nova] Acquiring lock "3fed0e1e-c8a7-43cc-bef6-14410111d3cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6b49f494-09a9-4323-be38-231f5071f6e1 req-c8c95e2e-f6cc-430f-95d2-097f6d6b4b75 service nova] Lock "3fed0e1e-c8a7-43cc-bef6-14410111d3cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6b49f494-09a9-4323-be38-231f5071f6e1 req-c8c95e2e-f6cc-430f-95d2-097f6d6b4b75 service nova] Lock "3fed0e1e-c8a7-43cc-bef6-14410111d3cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:22 user nova-compute[231753]: DEBUG nova.compute.manager [req-6b49f494-09a9-4323-be38-231f5071f6e1 req-c8c95e2e-f6cc-430f-95d2-097f6d6b4b75 service nova] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] No waiting events found dispatching network-vif-plugged-47c9a3cb-360f-4fd1-8233-37b32039d047 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:36:22 user nova-compute[231753]: WARNING nova.compute.manager [req-6b49f494-09a9-4323-be38-231f5071f6e1 req-c8c95e2e-f6cc-430f-95d2-097f6d6b4b75 service nova] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Received unexpected event network-vif-plugged-47c9a3cb-360f-4fd1-8233-37b32039d047 for instance with vm_state building and task_state spawning.
Jul 29 13:36:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] COPY block job progress, current cursor: 113246208 final cursor: 1073741824 {{(pid=231753) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 13:36:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] COPY block job progress, current cursor: 276824064 final cursor: 1073741824 {{(pid=231753) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 13:36:23 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637783.7190273, 3fed0e1e-c8a7-43cc-bef6-14410111d3cb => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:36:23 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] VM Resumed (Lifecycle Event)
Jul 29 13:36:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:36:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:36:23 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Instance spawned successfully.
Jul 29 13:36:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:36:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:36:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:36:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:36:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:36:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:36:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:36:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:36:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:36:23 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:36:23 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637783.7241235, 3fed0e1e-c8a7-43cc-bef6-14410111d3cb => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:36:23 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] VM Started (Lifecycle Event)
Jul 29 13:36:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:36:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:36:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] COPY block job progress, current cursor: 450887680 final cursor: 1073741824 {{(pid=231753) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 13:36:23 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:36:23 user nova-compute[231753]: INFO nova.compute.manager [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Took 6.45 seconds to spawn the instance on the hypervisor.
Jul 29 13:36:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:36:24 user nova-compute[231753]: INFO nova.compute.manager [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Took 7.84 seconds to build instance.
Jul 29 13:36:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-73cde027-5743-41e2-b032-941e436b9ad5 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "3fed0e1e-c8a7-43cc-bef6-14410111d3cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.957s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Acquiring lock "5127f26d-e912-49a4-b8ae-6157f0055270" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Lock "5127f26d-e912-49a4-b8ae-6157f0055270" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Acquiring lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:24 user nova-compute[231753]: INFO nova.compute.manager [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Terminating instance
Jul 29 13:36:24 user nova-compute[231753]: DEBUG nova.compute.manager [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:36:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] COPY block job progress, current cursor: 588251136 final cursor: 1073741824 {{(pid=231753) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 13:36:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] COPY block job progress, current cursor: 720371712 final cursor: 1073741824 {{(pid=231753) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 13:36:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:24 user nova-compute[231753]: DEBUG nova.compute.manager [req-4621dec0-89aa-4507-b2cc-a9a892cf5241 req-058305f8-6134-4af8-b53c-368b4118c81f service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-unplugged-f6babf7d-a012-411a-a2cc-134c92ac26d8 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4621dec0-89aa-4507-b2cc-a9a892cf5241 req-058305f8-6134-4af8-b53c-368b4118c81f service nova] Acquiring lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4621dec0-89aa-4507-b2cc-a9a892cf5241 req-058305f8-6134-4af8-b53c-368b4118c81f service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4621dec0-89aa-4507-b2cc-a9a892cf5241 req-058305f8-6134-4af8-b53c-368b4118c81f service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:24 user nova-compute[231753]: DEBUG nova.compute.manager [req-4621dec0-89aa-4507-b2cc-a9a892cf5241 req-058305f8-6134-4af8-b53c-368b4118c81f service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] No waiting events found dispatching network-vif-unplugged-f6babf7d-a012-411a-a2cc-134c92ac26d8 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:36:24 user nova-compute[231753]: DEBUG nova.compute.manager [req-4621dec0-89aa-4507-b2cc-a9a892cf5241 req-058305f8-6134-4af8-b53c-368b4118c81f service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-unplugged-f6babf7d-a012-411a-a2cc-134c92ac26d8 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:36:25 user nova-compute[231753]: DEBUG nova.compute.manager [req-f9c18866-6437-4685-b54d-58510f340a51 req-0855d74c-049c-4526-bcd4-38aea6ef602a service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-unplugged-c652fd6e-0d41-4593-8d73-893962490f30 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-f9c18866-6437-4685-b54d-58510f340a51 req-0855d74c-049c-4526-bcd4-38aea6ef602a service nova] Acquiring lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-f9c18866-6437-4685-b54d-58510f340a51 req-0855d74c-049c-4526-bcd4-38aea6ef602a service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-f9c18866-6437-4685-b54d-58510f340a51 req-0855d74c-049c-4526-bcd4-38aea6ef602a service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:25 user nova-compute[231753]: DEBUG nova.compute.manager [req-f9c18866-6437-4685-b54d-58510f340a51 req-0855d74c-049c-4526-bcd4-38aea6ef602a service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] No waiting events found dispatching network-vif-unplugged-c652fd6e-0d41-4593-8d73-893962490f30 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:36:25 user nova-compute[231753]: DEBUG nova.compute.manager [req-f9c18866-6437-4685-b54d-58510f340a51 req-0855d74c-049c-4526-bcd4-38aea6ef602a service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-unplugged-c652fd6e-0d41-4593-8d73-893962490f30 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:36:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:25 user nova-compute[231753]: DEBUG nova.compute.manager [req-6acfbb78-ec69-4c40-858e-c9ab787d3976 req-8fe3ec24-9303-4bdd-8c9d-a8cf15392686 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-unplugged-28d91bef-df2e-469a-b449-10e27e352ee8 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6acfbb78-ec69-4c40-858e-c9ab787d3976 req-8fe3ec24-9303-4bdd-8c9d-a8cf15392686 service nova] Acquiring lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6acfbb78-ec69-4c40-858e-c9ab787d3976 req-8fe3ec24-9303-4bdd-8c9d-a8cf15392686 service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6acfbb78-ec69-4c40-858e-c9ab787d3976 req-8fe3ec24-9303-4bdd-8c9d-a8cf15392686 service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.004s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:25 user nova-compute[231753]: DEBUG nova.compute.manager [req-6acfbb78-ec69-4c40-858e-c9ab787d3976 req-8fe3ec24-9303-4bdd-8c9d-a8cf15392686 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] No waiting events found dispatching network-vif-unplugged-28d91bef-df2e-469a-b449-10e27e352ee8 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:36:25 user nova-compute[231753]: DEBUG nova.compute.manager [req-6acfbb78-ec69-4c40-858e-c9ab787d3976 req-8fe3ec24-9303-4bdd-8c9d-a8cf15392686 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-unplugged-28d91bef-df2e-469a-b449-10e27e352ee8 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:36:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] COPY block job progress, current cursor: 877658112 final cursor: 1073741824 {{(pid=231753) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 13:36:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] COPY block job progress, current cursor: 1024458752 final cursor: 1073741824 {{(pid=231753) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:26 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Instance destroyed successfully.
Jul 29 13:36:26 user nova-compute[231753]: DEBUG nova.objects.instance [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Lazy-loading 'resources' on Instance uuid 5127f26d-e912-49a4-b8ae-6157f0055270 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:34:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-193231798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-193231798',id=10,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnjgLufIx9AcHRLY1+xFOFrurx8FQrjKmAFitYyIVkA0E/XFblcb7deXyn7s807fFsDqkhMPJXSw7WsvI3EyPFy9AaTFOnoPnOc9y58HRuKN2BV9abvk9+1sjgea9bM1A==',key_name='tempest-keypair-2063282615',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:35:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='195f27dc9cac4e53b96830a5f5168711',ramdisk_id='',reservation_id='r-97j3f17v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2120010551',owner_user_name='tempest-TaggedBootDevicesTest-2120010551-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:35:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcfae116c60144ef84c15680f8936de3',uuid=5127f26d-e912-49a4-b8ae-6157f0055270,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f6babf7d-a012-411a-a2cc-134c92ac26d8", "address": "fa:16:3e:0f:55:20", "network": {"id": "506f7783-e44a-4de3-8c0d-aa1177c2eef6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-998637392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6babf7d-a0", "ovs_interfaceid": "f6babf7d-a012-411a-a2cc-134c92ac26d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converting VIF {"id": "f6babf7d-a012-411a-a2cc-134c92ac26d8", "address": "fa:16:3e:0f:55:20", "network": {"id": "506f7783-e44a-4de3-8c0d-aa1177c2eef6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-998637392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6babf7d-a0", "ovs_interfaceid": "f6babf7d-a012-411a-a2cc-134c92ac26d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0f:55:20,bridge_name='br-int',has_traffic_filtering=True,id=f6babf7d-a012-411a-a2cc-134c92ac26d8,network=Network(506f7783-e44a-4de3-8c0d-aa1177c2eef6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6babf7d-a0') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG os_vif [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:55:20,bridge_name='br-int',has_traffic_filtering=True,id=f6babf7d-a012-411a-a2cc-134c92ac26d8,network=Network(506f7783-e44a-4de3-8c0d-aa1177c2eef6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6babf7d-a0') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf6babf7d-a0, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:26 user nova-compute[231753]: INFO os_vif [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0f:55:20,bridge_name='br-int',has_traffic_filtering=True,id=f6babf7d-a012-411a-a2cc-134c92ac26d8,network=Network(506f7783-e44a-4de3-8c0d-aa1177c2eef6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf6babf7d-a0')
Jul 29 13:36:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:34:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-193231798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-193231798',id=10,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnjgLufIx9AcHRLY1+xFOFrurx8FQrjKmAFitYyIVkA0E/XFblcb7deXyn7s807fFsDqkhMPJXSw7WsvI3EyPFy9AaTFOnoPnOc9y58HRuKN2BV9abvk9+1sjgea9bM1A==',key_name='tempest-keypair-2063282615',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:35:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='195f27dc9cac4e53b96830a5f5168711',ramdisk_id='',reservation_id='r-97j3f17v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2120010551',owner_user_name='tempest-TaggedBootDevicesTest-2120010551-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:35:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcfae116c60144ef84c15680f8936de3',uuid=5127f26d-e912-49a4-b8ae-6157f0055270,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c652fd6e-0d41-4593-8d73-893962490f30", "address": "fa:16:3e:45:ca:0a", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652fd6e-0d", "ovs_interfaceid": "c652fd6e-0d41-4593-8d73-893962490f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converting VIF {"id": "c652fd6e-0d41-4593-8d73-893962490f30", "address": "fa:16:3e:45:ca:0a", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652fd6e-0d", "ovs_interfaceid": "c652fd6e-0d41-4593-8d73-893962490f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:45:ca:0a,bridge_name='br-int',has_traffic_filtering=True,id=c652fd6e-0d41-4593-8d73-893962490f30,network=Network(fc93cbb9-0614-404f-bbdf-ea3ae231e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc652fd6e-0d') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG os_vif [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:ca:0a,bridge_name='br-int',has_traffic_filtering=True,id=c652fd6e-0d41-4593-8d73-893962490f30,network=Network(fc93cbb9-0614-404f-bbdf-ea3ae231e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc652fd6e-0d') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc652fd6e-0d, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] COPY block job progress, current cursor: 1073741824 final cursor: 1073741824 {{(pid=231753) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:26 user nova-compute[231753]: INFO os_vif [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:45:ca:0a,bridge_name='br-int',has_traffic_filtering=True,id=c652fd6e-0d41-4593-8d73-893962490f30,network=Network(fc93cbb9-0614-404f-bbdf-ea3ae231e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapc652fd6e-0d')
Jul 29 13:36:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:34:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-193231798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-193231798',id=10,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnjgLufIx9AcHRLY1+xFOFrurx8FQrjKmAFitYyIVkA0E/XFblcb7deXyn7s807fFsDqkhMPJXSw7WsvI3EyPFy9AaTFOnoPnOc9y58HRuKN2BV9abvk9+1sjgea9bM1A==',key_name='tempest-keypair-2063282615',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:35:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='195f27dc9cac4e53b96830a5f5168711',ramdisk_id='',reservation_id='r-97j3f17v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2120010551',owner_user_name='tempest-TaggedBootDevicesTest-2120010551-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:35:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcfae116c60144ef84c15680f8936de3',uuid=5127f26d-e912-49a4-b8ae-6157f0055270,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e106a9dd-3d36-4bea-953b-fe65ba4747a5", "address": "fa:16:3e:6a:51:5c", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106a9dd-3d", "ovs_interfaceid": "e106a9dd-3d36-4bea-953b-fe65ba4747a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converting VIF {"id": "e106a9dd-3d36-4bea-953b-fe65ba4747a5", "address": "fa:16:3e:6a:51:5c", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106a9dd-3d", "ovs_interfaceid": "e106a9dd-3d36-4bea-953b-fe65ba4747a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:51:5c,bridge_name='br-int',has_traffic_filtering=True,id=e106a9dd-3d36-4bea-953b-fe65ba4747a5,network=Network(fc93cbb9-0614-404f-bbdf-ea3ae231e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape106a9dd-3d') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG os_vif [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:51:5c,bridge_name='br-int',has_traffic_filtering=True,id=e106a9dd-3d36-4bea-953b-fe65ba4747a5,network=Network(fc93cbb9-0614-404f-bbdf-ea3ae231e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape106a9dd-3d') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape106a9dd-3d, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:26 user nova-compute[231753]: INFO os_vif [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:51:5c,bridge_name='br-int',has_traffic_filtering=True,id=e106a9dd-3d36-4bea-953b-fe65ba4747a5,network=Network(fc93cbb9-0614-404f-bbdf-ea3ae231e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tape106a9dd-3d')
Jul 29 13:36:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:34:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-193231798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-193231798',id=10,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnjgLufIx9AcHRLY1+xFOFrurx8FQrjKmAFitYyIVkA0E/XFblcb7deXyn7s807fFsDqkhMPJXSw7WsvI3EyPFy9AaTFOnoPnOc9y58HRuKN2BV9abvk9+1sjgea9bM1A==',key_name='tempest-keypair-2063282615',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:35:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='195f27dc9cac4e53b96830a5f5168711',ramdisk_id='',reservation_id='r-97j3f17v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2120010551',owner_user_name='tempest-TaggedBootDevicesTest-2120010551-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:35:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcfae116c60144ef84c15680f8936de3',uuid=5127f26d-e912-49a4-b8ae-6157f0055270,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "28d91bef-df2e-469a-b449-10e27e352ee8", "address": "fa:16:3e:d4:e9:c0", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d91bef-df", "ovs_interfaceid": "28d91bef-df2e-469a-b449-10e27e352ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converting VIF {"id": "28d91bef-df2e-469a-b449-10e27e352ee8", "address": "fa:16:3e:d4:e9:c0", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d91bef-df", "ovs_interfaceid": "28d91bef-df2e-469a-b449-10e27e352ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:d4:e9:c0,bridge_name='br-int',has_traffic_filtering=True,id=28d91bef-df2e-469a-b449-10e27e352ee8,network=Network(fc93cbb9-0614-404f-bbdf-ea3ae231e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28d91bef-df') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG os_vif [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:e9:c0,bridge_name='br-int',has_traffic_filtering=True,id=28d91bef-df2e-469a-b449-10e27e352ee8,network=Network(fc93cbb9-0614-404f-bbdf-ea3ae231e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28d91bef-df') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap28d91bef-df, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:26 user nova-compute[231753]: INFO os_vif [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:d4:e9:c0,bridge_name='br-int',has_traffic_filtering=True,id=28d91bef-df2e-469a-b449-10e27e352ee8,network=Network(fc93cbb9-0614-404f-bbdf-ea3ae231e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap28d91bef-df')
Jul 29 13:36:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:34:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-193231798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-193231798',id=10,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnjgLufIx9AcHRLY1+xFOFrurx8FQrjKmAFitYyIVkA0E/XFblcb7deXyn7s807fFsDqkhMPJXSw7WsvI3EyPFy9AaTFOnoPnOc9y58HRuKN2BV9abvk9+1sjgea9bM1A==',key_name='tempest-keypair-2063282615',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:35:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='195f27dc9cac4e53b96830a5f5168711',ramdisk_id='',reservation_id='r-97j3f17v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2120010551',owner_user_name='tempest-TaggedBootDevicesTest-2120010551-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:35:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcfae116c60144ef84c15680f8936de3',uuid=5127f26d-e912-49a4-b8ae-6157f0055270,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7a1e3eda-8abb-49ca-a495-aa7f584a9252", "address": "fa:16:3e:30:08:c1", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1e3eda-8a", "ovs_interfaceid": "7a1e3eda-8abb-49ca-a495-aa7f584a9252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converting VIF {"id": "7a1e3eda-8abb-49ca-a495-aa7f584a9252", "address": "fa:16:3e:30:08:c1", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.223", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7a1e3eda-8a", "ovs_interfaceid": "7a1e3eda-8abb-49ca-a495-aa7f584a9252", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:08:c1,bridge_name='br-int',has_traffic_filtering=True,id=7a1e3eda-8abb-49ca-a495-aa7f584a9252,network=Network(fc93cbb9-0614-404f-bbdf-ea3ae231e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a1e3eda-8a') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG os_vif [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:08:c1,bridge_name='br-int',has_traffic_filtering=True,id=7a1e3eda-8abb-49ca-a495-aa7f584a9252,network=Network(fc93cbb9-0614-404f-bbdf-ea3ae231e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a1e3eda-8a') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7a1e3eda-8a, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'RgCoJrvq', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf', 'volume_id': '0ce5cc94-fc7d-45dd-a970-f73d9c853fdd'}, None), 'kwargs': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:36:26 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:36:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:26 user nova-compute[231753]: INFO os_vif [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:08:c1,bridge_name='br-int',has_traffic_filtering=True,id=7a1e3eda-8abb-49ca-a495-aa7f584a9252,network=Network(fc93cbb9-0614-404f-bbdf-ea3ae231e7b6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7a1e3eda-8a')
Jul 29 13:36:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:34:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-193231798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-193231798',id=10,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnjgLufIx9AcHRLY1+xFOFrurx8FQrjKmAFitYyIVkA0E/XFblcb7deXyn7s807fFsDqkhMPJXSw7WsvI3EyPFy9AaTFOnoPnOc9y58HRuKN2BV9abvk9+1sjgea9bM1A==',key_name='tempest-keypair-2063282615',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:35:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='195f27dc9cac4e53b96830a5f5168711',ramdisk_id='',reservation_id='r-97j3f17v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2120010551',owner_user_name='tempest-TaggedBootDevicesTest-2120010551-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:35:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcfae116c60144ef84c15680f8936de3',uuid=5127f26d-e912-49a4-b8ae-6157f0055270,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "0dd83ad9-c54b-4c90-981a-8982501e36cf", "address": "fa:16:3e:cb:c0:08", "network": {"id": "70108ad7-d95b-4b71-a4b1-d6750a3d30cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-155167949", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dd83ad9-c5", "ovs_interfaceid": "0dd83ad9-c54b-4c90-981a-8982501e36cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converting VIF {"id": "0dd83ad9-c54b-4c90-981a-8982501e36cf", "address": "fa:16:3e:cb:c0:08", "network": {"id": "70108ad7-d95b-4b71-a4b1-d6750a3d30cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-155167949", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dd83ad9-c5", "ovs_interfaceid": "0dd83ad9-c54b-4c90-981a-8982501e36cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:c0:08,bridge_name='br-int',has_traffic_filtering=True,id=0dd83ad9-c54b-4c90-981a-8982501e36cf,network=Network(70108ad7-d95b-4b71-a4b1-d6750a3d30cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dd83ad9-c5') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG os_vif [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:c0:08,bridge_name='br-int',has_traffic_filtering=True,id=0dd83ad9-c54b-4c90-981a-8982501e36cf,network=Network(70108ad7-d95b-4b71-a4b1-d6750a3d30cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dd83ad9-c5') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap0dd83ad9-c5, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b62562-17fd-46c5-94dc-261089791b84]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:36:26 user nova-compute[231753]: No targets found.
Jul 29 13:36:26 user nova-compute[231753]: iSNS:
Jul 29 13:36:26 user nova-compute[231753]: No targets found.
Jul 29 13:36:26 user nova-compute[231753]: STATIC:
Jul 29 13:36:26 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d
Jul 29 13:36:26 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:36:26 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:36:26 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008
Jul 29 13:36:26 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:36:26 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:36:26 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf
Jul 29 13:36:26 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:36:26 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:36:26 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c
Jul 29 13:36:26 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:36:26 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:36:26 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd
Jul 29 13:36:26 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:36:26 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:36:26 user nova-compute[231753]: FIRMWARE:
Jul 29 13:36:26 user nova-compute[231753]: No targets found.
Jul 29 13:36:26 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:36:26 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:36:26 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:36:26 user nova-compute[231753]: INFO os_vif [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:c0:08,bridge_name='br-int',has_traffic_filtering=True,id=0dd83ad9-c54b-4c90-981a-8982501e36cf,network=Network(70108ad7-d95b-4b71-a4b1-d6750a3d30cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0dd83ad9-c5')
Jul 29 13:36:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:34:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-193231798',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-193231798',id=10,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOnjgLufIx9AcHRLY1+xFOFrurx8FQrjKmAFitYyIVkA0E/XFblcb7deXyn7s807fFsDqkhMPJXSw7WsvI3EyPFy9AaTFOnoPnOc9y58HRuKN2BV9abvk9+1sjgea9bM1A==',key_name='tempest-keypair-2063282615',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:35:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='195f27dc9cac4e53b96830a5f5168711',ramdisk_id='',reservation_id='r-97j3f17v',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-2120010551',owner_user_name='tempest-TaggedBootDevicesTest-2120010551-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:35:07Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='dcfae116c60144ef84c15680f8936de3',uuid=5127f26d-e912-49a4-b8ae-6157f0055270,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "713bc8f5-df03-42c3-8250-ff7ed4e07f4e", "address": "fa:16:3e:22:fe:88", "network": {"id": "70108ad7-d95b-4b71-a4b1-d6750a3d30cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-155167949", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap713bc8f5-df", "ovs_interfaceid": "713bc8f5-df03-42c3-8250-ff7ed4e07f4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converting VIF {"id": "713bc8f5-df03-42c3-8250-ff7ed4e07f4e", "address": "fa:16:3e:22:fe:88", "network": {"id": "70108ad7-d95b-4b71-a4b1-d6750a3d30cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-155167949", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap713bc8f5-df", "ovs_interfaceid": "713bc8f5-df03-42c3-8250-ff7ed4e07f4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:22:fe:88,bridge_name='br-int',has_traffic_filtering=True,id=713bc8f5-df03-42c3-8250-ff7ed4e07f4e,network=Network(70108ad7-d95b-4b71-a4b1-d6750a3d30cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap713bc8f5-df') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG os_vif [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:fe:88,bridge_name='br-int',has_traffic_filtering=True,id=713bc8f5-df03-42c3-8250-ff7ed4e07f4e,network=Network(70108ad7-d95b-4b71-a4b1-d6750a3d30cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap713bc8f5-df') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap713bc8f5-df, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:26 user nova-compute[231753]: INFO os_vif [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:22:fe:88,bridge_name='br-int',has_traffic_filtering=True,id=713bc8f5-df03-42c3-8250-ff7ed4e07f4e,network=Network(70108ad7-d95b-4b71-a4b1-d6750a3d30cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap713bc8f5-df')
Jul 29 13:36:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'KqOjMvDc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:36:26 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:36:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[46f3c5fe-287f-450d-827b-2c1fa730e828]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ae2c00-d3a1-4957-95ff-5ba9becfab21]: (4, ('tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd (non-flash)\ntcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd (non-flash)
Jul 29 13:36:26 user nova-compute[231753]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)
Jul 29 13:36:26 user nova-compute[231753]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:36:26 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:36:26 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:36:26 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] iscsi session list stdout=tcp: [11] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd (non-flash)
Jul 29 13:36:26 user nova-compute[231753]: tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)
Jul 29 13:36:26 user nova-compute[231753]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:36:26 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:36:26 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:36:26 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ca9580af0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd'): ({'sdf'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Removing single pathed devices sdf {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e416998-af16-4ef2-8a37-08ec7a399075]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5b614ed-6a39-4ff7-8227-007b9bfff7cd]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Flushing IO for device /dev/sdf {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f239d74-cca4-4da0-8052-ac09b6d30365]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.033s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e11027-5b47-4b4e-a6bd-e257f9624f2b]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Checking to see if SCSI volumes sdf have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] SCSI volumes sdf have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f35a9e-94f0-46e1-b71b-31a8a927bbf5]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd -p 172.16.0.220:3260 --logout" returned: 0 in 0.079s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0355b989-304d-4ac0-820b-6d70dadbb626]: (4, ('Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd, portal: 172.16.0.220,3260]\nLogout of [sid: 11, target: iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd, portal: 172.16.0.220,3260]
Jul 29 13:36:26 user nova-compute[231753]: Logout of [sid: 11, target: iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd, portal: 172.16.0.220,3260] successful.
Jul 29 13:36:26 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:36:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0ce5cc94-fc7d-45dd-a970-f73d9c853fdd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0696fcd0-cbb5-4eb2-be0e-151f7c0d3da6]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.372s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] <== disconnect_volume: return (374ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.324s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8701d669-6360-42ef-bcc3-1ce6a83cf39a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:36:27 user nova-compute[231753]: No targets found.
Jul 29 13:36:27 user nova-compute[231753]: iSNS:
Jul 29 13:36:27 user nova-compute[231753]: No targets found.
Jul 29 13:36:27 user nova-compute[231753]: STATIC:
Jul 29 13:36:27 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d
Jul 29 13:36:27 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:36:27 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:36:27 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008
Jul 29 13:36:27 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:36:27 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:36:27 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf
Jul 29 13:36:27 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:36:27 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:36:27 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c
Jul 29 13:36:27 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:36:27 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:36:27 user nova-compute[231753]: FIRMWARE:
Jul 29 13:36:27 user nova-compute[231753]: No targets found.
Jul 29 13:36:27 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:36:27 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:36:27 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[630b45bd-1513-4b74-b1da-cfe1d83aad82]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG nova.compute.manager [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] swap_volume: Driver volume swap returned, new connection_info is now : {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SWZqXMbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': 'b02ec16d-24a3-450d-858d-3ad302086ac3', 'attached_at': '', 'detached_at': '', 'volume_id': 'a8f01b66-d2ac-4dae-99f7-04556527fb6d', 'serial'} {{(pid=231753) _swap_volume /opt/stack/nova/nova/compute/manager.py:7711}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG nova.compute.manager [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] swap_volume: removing Cinder connection for volume 0ce5cc94-fc7d-45dd-a970-f73d9c853fdd {{(pid=231753) _swap_volume /opt/stack/nova/nova/compute/manager.py:7756}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[08277248-e484-48d2-82db-0f7dc2dbeebe]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)\ntcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)
Jul 29 13:36:27 user nova-compute[231753]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:36:27 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:36:27 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:36:27 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)
Jul 29 13:36:27 user nova-compute[231753]: tcp: [2] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf (non-flash)
Jul 29 13:36:27 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:36:27 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:36:27 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ca10e85e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf'): ({'sdb'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Removing single pathed devices sdb {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[73d6e041-f7e5-4b43-b977-2820c5543d7b]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[60034375-61fe-4aef-823c-1be0cccbafc2]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Flushing IO for device /dev/sdb {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[75fa30d0-b476-4bd6-b001-a01ea657ae37]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.037s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3d1a569-28a4-4f66-b420-861c650e4463]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] SCSI volumes sdb have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-a563d7ae-8842-4acb-a27a-a0192fa37252 req-cad77c5a-3ace-4d9b-9cf0-6a530314180e service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-plugged-c652fd6e-0d41-4593-8d73-893962490f30 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a563d7ae-8842-4acb-a27a-a0192fa37252 req-cad77c5a-3ace-4d9b-9cf0-6a530314180e service nova] Acquiring lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a563d7ae-8842-4acb-a27a-a0192fa37252 req-cad77c5a-3ace-4d9b-9cf0-6a530314180e service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a563d7ae-8842-4acb-a27a-a0192fa37252 req-cad77c5a-3ace-4d9b-9cf0-6a530314180e service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-a563d7ae-8842-4acb-a27a-a0192fa37252 req-cad77c5a-3ace-4d9b-9cf0-6a530314180e service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] No waiting events found dispatching network-vif-plugged-c652fd6e-0d41-4593-8d73-893962490f30 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:36:27 user nova-compute[231753]: WARNING nova.compute.manager [req-a563d7ae-8842-4acb-a27a-a0192fa37252 req-cad77c5a-3ace-4d9b-9cf0-6a530314180e service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received unexpected event network-vif-plugged-c652fd6e-0d41-4593-8d73-893962490f30 for instance with vm_state active and task_state deleting.
Jul 29 13:36:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-a563d7ae-8842-4acb-a27a-a0192fa37252 req-cad77c5a-3ace-4d9b-9cf0-6a530314180e service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-unplugged-e106a9dd-3d36-4bea-953b-fe65ba4747a5 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a563d7ae-8842-4acb-a27a-a0192fa37252 req-cad77c5a-3ace-4d9b-9cf0-6a530314180e service nova] Acquiring lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a563d7ae-8842-4acb-a27a-a0192fa37252 req-cad77c5a-3ace-4d9b-9cf0-6a530314180e service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a563d7ae-8842-4acb-a27a-a0192fa37252 req-cad77c5a-3ace-4d9b-9cf0-6a530314180e service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-a563d7ae-8842-4acb-a27a-a0192fa37252 req-cad77c5a-3ace-4d9b-9cf0-6a530314180e service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] No waiting events found dispatching network-vif-unplugged-e106a9dd-3d36-4bea-953b-fe65ba4747a5 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-a563d7ae-8842-4acb-a27a-a0192fa37252 req-cad77c5a-3ace-4d9b-9cf0-6a530314180e service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-unplugged-e106a9dd-3d36-4bea-953b-fe65ba4747a5 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-a563d7ae-8842-4acb-a27a-a0192fa37252 req-cad77c5a-3ace-4d9b-9cf0-6a530314180e service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-plugged-e106a9dd-3d36-4bea-953b-fe65ba4747a5 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a563d7ae-8842-4acb-a27a-a0192fa37252 req-cad77c5a-3ace-4d9b-9cf0-6a530314180e service nova] Acquiring lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a563d7ae-8842-4acb-a27a-a0192fa37252 req-cad77c5a-3ace-4d9b-9cf0-6a530314180e service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a563d7ae-8842-4acb-a27a-a0192fa37252 req-cad77c5a-3ace-4d9b-9cf0-6a530314180e service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-a563d7ae-8842-4acb-a27a-a0192fa37252 req-cad77c5a-3ace-4d9b-9cf0-6a530314180e service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] No waiting events found dispatching network-vif-plugged-e106a9dd-3d36-4bea-953b-fe65ba4747a5 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:36:27 user nova-compute[231753]: WARNING nova.compute.manager [req-a563d7ae-8842-4acb-a27a-a0192fa37252 req-cad77c5a-3ace-4d9b-9cf0-6a530314180e service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received unexpected event network-vif-plugged-e106a9dd-3d36-4bea-953b-fe65ba4747a5 for instance with vm_state active and task_state deleting.
Jul 29 13:36:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-a563d7ae-8842-4acb-a27a-a0192fa37252 req-cad77c5a-3ace-4d9b-9cf0-6a530314180e service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-unplugged-713bc8f5-df03-42c3-8250-ff7ed4e07f4e {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a563d7ae-8842-4acb-a27a-a0192fa37252 req-cad77c5a-3ace-4d9b-9cf0-6a530314180e service nova] Acquiring lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a563d7ae-8842-4acb-a27a-a0192fa37252 req-cad77c5a-3ace-4d9b-9cf0-6a530314180e service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a563d7ae-8842-4acb-a27a-a0192fa37252 req-cad77c5a-3ace-4d9b-9cf0-6a530314180e service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-a563d7ae-8842-4acb-a27a-a0192fa37252 req-cad77c5a-3ace-4d9b-9cf0-6a530314180e service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] No waiting events found dispatching network-vif-unplugged-713bc8f5-df03-42c3-8250-ff7ed4e07f4e {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-a563d7ae-8842-4acb-a27a-a0192fa37252 req-cad77c5a-3ace-4d9b-9cf0-6a530314180e service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-unplugged-713bc8f5-df03-42c3-8250-ff7ed4e07f4e for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-a563d7ae-8842-4acb-a27a-a0192fa37252 req-cad77c5a-3ace-4d9b-9cf0-6a530314180e service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-plugged-713bc8f5-df03-42c3-8250-ff7ed4e07f4e {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a563d7ae-8842-4acb-a27a-a0192fa37252 req-cad77c5a-3ace-4d9b-9cf0-6a530314180e service nova] Acquiring lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a563d7ae-8842-4acb-a27a-a0192fa37252 req-cad77c5a-3ace-4d9b-9cf0-6a530314180e service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a563d7ae-8842-4acb-a27a-a0192fa37252 req-cad77c5a-3ace-4d9b-9cf0-6a530314180e service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-a563d7ae-8842-4acb-a27a-a0192fa37252 req-cad77c5a-3ace-4d9b-9cf0-6a530314180e service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] No waiting events found dispatching network-vif-plugged-713bc8f5-df03-42c3-8250-ff7ed4e07f4e {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:36:27 user nova-compute[231753]: WARNING nova.compute.manager [req-a563d7ae-8842-4acb-a27a-a0192fa37252 req-cad77c5a-3ace-4d9b-9cf0-6a530314180e service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received unexpected event network-vif-plugged-713bc8f5-df03-42c3-8250-ff7ed4e07f4e for instance with vm_state active and task_state deleting.
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[05e34ecf-3cd9-4bd3-9031-1a5c6e1da480]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[546d1123-9b05-4d74-99f1-0fa3dd0dc159]: (4, ('Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf, portal: 172.16.0.220,3260]\nLogout of [sid: 2, target: iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 2, target: iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf, portal: 172.16.0.220,3260]
Jul 29 13:36:27 user nova-compute[231753]: Logout of [sid: 2, target: iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf, portal: 172.16.0.220,3260] successful.
Jul 29 13:36:27 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-bdc4cb04-eca1-41e0-868d-c1277a9d0560 req-539b0499-5315-41d5-a8b0-aa637c491dd5 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-plugged-28d91bef-df2e-469a-b449-10e27e352ee8 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bdc4cb04-eca1-41e0-868d-c1277a9d0560 req-539b0499-5315-41d5-a8b0-aa637c491dd5 service nova] Acquiring lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bdc4cb04-eca1-41e0-868d-c1277a9d0560 req-539b0499-5315-41d5-a8b0-aa637c491dd5 service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bdc4cb04-eca1-41e0-868d-c1277a9d0560 req-539b0499-5315-41d5-a8b0-aa637c491dd5 service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-bdc4cb04-eca1-41e0-868d-c1277a9d0560 req-539b0499-5315-41d5-a8b0-aa637c491dd5 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] No waiting events found dispatching network-vif-plugged-28d91bef-df2e-469a-b449-10e27e352ee8 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:36:27 user nova-compute[231753]: WARNING nova.compute.manager [req-bdc4cb04-eca1-41e0-868d-c1277a9d0560 req-539b0499-5315-41d5-a8b0-aa637c491dd5 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received unexpected event network-vif-plugged-28d91bef-df2e-469a-b449-10e27e352ee8 for instance with vm_state active and task_state deleting.
Jul 29 13:36:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-bdc4cb04-eca1-41e0-868d-c1277a9d0560 req-539b0499-5315-41d5-a8b0-aa637c491dd5 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-unplugged-7a1e3eda-8abb-49ca-a495-aa7f584a9252 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bdc4cb04-eca1-41e0-868d-c1277a9d0560 req-539b0499-5315-41d5-a8b0-aa637c491dd5 service nova] Acquiring lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bdc4cb04-eca1-41e0-868d-c1277a9d0560 req-539b0499-5315-41d5-a8b0-aa637c491dd5 service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bdc4cb04-eca1-41e0-868d-c1277a9d0560 req-539b0499-5315-41d5-a8b0-aa637c491dd5 service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-bdc4cb04-eca1-41e0-868d-c1277a9d0560 req-539b0499-5315-41d5-a8b0-aa637c491dd5 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] No waiting events found dispatching network-vif-unplugged-7a1e3eda-8abb-49ca-a495-aa7f584a9252 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-bdc4cb04-eca1-41e0-868d-c1277a9d0560 req-539b0499-5315-41d5-a8b0-aa637c491dd5 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-unplugged-7a1e3eda-8abb-49ca-a495-aa7f584a9252 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-bdc4cb04-eca1-41e0-868d-c1277a9d0560 req-539b0499-5315-41d5-a8b0-aa637c491dd5 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-plugged-7a1e3eda-8abb-49ca-a495-aa7f584a9252 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bdc4cb04-eca1-41e0-868d-c1277a9d0560 req-539b0499-5315-41d5-a8b0-aa637c491dd5 service nova] Acquiring lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bdc4cb04-eca1-41e0-868d-c1277a9d0560 req-539b0499-5315-41d5-a8b0-aa637c491dd5 service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bdc4cb04-eca1-41e0-868d-c1277a9d0560 req-539b0499-5315-41d5-a8b0-aa637c491dd5 service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-bdc4cb04-eca1-41e0-868d-c1277a9d0560 req-539b0499-5315-41d5-a8b0-aa637c491dd5 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] No waiting events found dispatching network-vif-plugged-7a1e3eda-8abb-49ca-a495-aa7f584a9252 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:36:27 user nova-compute[231753]: WARNING nova.compute.manager [req-bdc4cb04-eca1-41e0-868d-c1277a9d0560 req-539b0499-5315-41d5-a8b0-aa637c491dd5 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received unexpected event network-vif-plugged-7a1e3eda-8abb-49ca-a495-aa7f584a9252 for instance with vm_state active and task_state deleting.
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f3eaf40c-503b-4301-b848-a237cbc8d6cf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac9b05e4-4b5a-4d9d-903a-0a40c904343f]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] <== disconnect_volume: return (708ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'iFthIgSl', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:36:27 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-dfcd2187-7890-448e-86f6-d3d63dfa6e6a req-16ccd9e8-0481-4d22-b88f-264205d0a14a service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-plugged-f6babf7d-a012-411a-a2cc-134c92ac26d8 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-dfcd2187-7890-448e-86f6-d3d63dfa6e6a req-16ccd9e8-0481-4d22-b88f-264205d0a14a service nova] Acquiring lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-dfcd2187-7890-448e-86f6-d3d63dfa6e6a req-16ccd9e8-0481-4d22-b88f-264205d0a14a service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-dfcd2187-7890-448e-86f6-d3d63dfa6e6a req-16ccd9e8-0481-4d22-b88f-264205d0a14a service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-dfcd2187-7890-448e-86f6-d3d63dfa6e6a req-16ccd9e8-0481-4d22-b88f-264205d0a14a service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] No waiting events found dispatching network-vif-plugged-f6babf7d-a012-411a-a2cc-134c92ac26d8 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:36:27 user nova-compute[231753]: WARNING nova.compute.manager [req-dfcd2187-7890-448e-86f6-d3d63dfa6e6a req-16ccd9e8-0481-4d22-b88f-264205d0a14a service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received unexpected event network-vif-plugged-f6babf7d-a012-411a-a2cc-134c92ac26d8 for instance with vm_state active and task_state deleting.
Jul 29 13:36:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-dfcd2187-7890-448e-86f6-d3d63dfa6e6a req-16ccd9e8-0481-4d22-b88f-264205d0a14a service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-unplugged-0dd83ad9-c54b-4c90-981a-8982501e36cf {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-dfcd2187-7890-448e-86f6-d3d63dfa6e6a req-16ccd9e8-0481-4d22-b88f-264205d0a14a service nova] Acquiring lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-dfcd2187-7890-448e-86f6-d3d63dfa6e6a req-16ccd9e8-0481-4d22-b88f-264205d0a14a service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-dfcd2187-7890-448e-86f6-d3d63dfa6e6a req-16ccd9e8-0481-4d22-b88f-264205d0a14a service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-dfcd2187-7890-448e-86f6-d3d63dfa6e6a req-16ccd9e8-0481-4d22-b88f-264205d0a14a service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] No waiting events found dispatching network-vif-unplugged-0dd83ad9-c54b-4c90-981a-8982501e36cf {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-dfcd2187-7890-448e-86f6-d3d63dfa6e6a req-16ccd9e8-0481-4d22-b88f-264205d0a14a service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-unplugged-0dd83ad9-c54b-4c90-981a-8982501e36cf for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-dfcd2187-7890-448e-86f6-d3d63dfa6e6a req-16ccd9e8-0481-4d22-b88f-264205d0a14a service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-plugged-0dd83ad9-c54b-4c90-981a-8982501e36cf {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-dfcd2187-7890-448e-86f6-d3d63dfa6e6a req-16ccd9e8-0481-4d22-b88f-264205d0a14a service nova] Acquiring lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-dfcd2187-7890-448e-86f6-d3d63dfa6e6a req-16ccd9e8-0481-4d22-b88f-264205d0a14a service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-dfcd2187-7890-448e-86f6-d3d63dfa6e6a req-16ccd9e8-0481-4d22-b88f-264205d0a14a service nova] Lock "5127f26d-e912-49a4-b8ae-6157f0055270-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-dfcd2187-7890-448e-86f6-d3d63dfa6e6a req-16ccd9e8-0481-4d22-b88f-264205d0a14a service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] No waiting events found dispatching network-vif-plugged-0dd83ad9-c54b-4c90-981a-8982501e36cf {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:36:27 user nova-compute[231753]: WARNING nova.compute.manager [req-dfcd2187-7890-448e-86f6-d3d63dfa6e6a req-16ccd9e8-0481-4d22-b88f-264205d0a14a service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received unexpected event network-vif-plugged-0dd83ad9-c54b-4c90-981a-8982501e36cf for instance with vm_state active and task_state deleting.
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1f429f-1acc-4501-a3a0-4441662aa62e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:36:27 user nova-compute[231753]: No targets found.
Jul 29 13:36:27 user nova-compute[231753]: iSNS:
Jul 29 13:36:27 user nova-compute[231753]: No targets found.
Jul 29 13:36:27 user nova-compute[231753]: STATIC:
Jul 29 13:36:27 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d
Jul 29 13:36:27 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:36:27 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:36:27 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008
Jul 29 13:36:27 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:36:27 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:36:27 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c
Jul 29 13:36:27 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:36:27 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:36:27 user nova-compute[231753]: FIRMWARE:
Jul 29 13:36:27 user nova-compute[231753]: No targets found.
Jul 29 13:36:27 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:36:27 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:36:27 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[85746ac0-f77c-4957-9d19-03c8f478995d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ead03b8-b1e8-4321-80d3-f033c923820d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)\ntcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)
Jul 29 13:36:27 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:36:27 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:36:27 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)
Jul 29 13:36:27 user nova-compute[231753]: tcp: [3] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c (non-flash)
Jul 29 13:36:27 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:36:27 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ca01f49d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c'): ({'sdc'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Removing single pathed devices sdc {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[723d6db0-bb50-4fcd-a70f-8f25d4e4c233]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.096s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5462d38b-f593-40ef-9350-ed4c4ffa121d]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Flushing IO for device /dev/sdc {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e918db7-4b12-42ae-ab03-3c7769021277]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.071s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5438d88d-9fef-499f-8217-502ef177793f]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] SCSI volumes sdc have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.028s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f786062f-d3b1-4b1a-8c6a-1095df4e388c]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9572f9d5-2a64-42b1-95e0-c862a2cd980c]: (4, ('Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c, portal: 172.16.0.220,3260]\nLogout of [sid: 3, target: iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 3, target: iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c, portal: 172.16.0.220,3260]
Jul 29 13:36:27 user nova-compute[231753]: Logout of [sid: 3, target: iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c, portal: 172.16.0.220,3260] successful.
Jul 29 13:36:27 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:55023ac1-9e61-4b60-afc0-f6961380cd9c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5774229d-bcce-4996-a1dc-62b978e18b32]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.479s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] <== disconnect_volume: return (481ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wDGIyoej', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:36:27 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[55abde50-79f1-4d25-8b04-1de4bf37a662]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:36:27 user nova-compute[231753]: No targets found.
Jul 29 13:36:27 user nova-compute[231753]: iSNS:
Jul 29 13:36:27 user nova-compute[231753]: No targets found.
Jul 29 13:36:27 user nova-compute[231753]: STATIC:
Jul 29 13:36:27 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d
Jul 29 13:36:27 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:36:27 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:36:27 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008
Jul 29 13:36:27 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:36:27 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:36:27 user nova-compute[231753]: FIRMWARE:
Jul 29 13:36:27 user nova-compute[231753]: No targets found.
Jul 29 13:36:27 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:36:27 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:36:27 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.036s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf08e49-9efa-413f-9955-9dcc4647c725]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG nova.compute.manager [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] swap_volume: Updating volume 0ce5cc94-fc7d-45dd-a970-f73d9c853fdd BDM record with {'connection_info': '{"driver_volume_type": "iscsi", "data": {"target_iqn": "iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d", "target_portal": "172.16.0.220:3260", "target_discovered": false, "auth_method": "CHAP", "auth_username": "SWZqXMbc", "auth_password": "wnNcCbRgxYVa9s", "target_lun": 0, "qos_specs": null, "access_mode": "rw", "encrypted": false, "cacheable": false, "device_path": "/dev/sde", "volume_id": "a8f01b66-d2ac-4dae-99f7-04556527fb6d"}, "status": "reserved", "instance": "b02ec16d-24a3-450d-858d-3ad302086ac3", "attached_at": "", "detached_at": "", "volume_id": "a8f01b66-d2ac-4dae-99f7-04556527fb6d", "serial": "a8f01b66-d2ac-4dae-99f7-04556527fb6d"}', 'source_type': 'volume', 'destination_type': 'volume', 'snapshot_id': None, 'volume_id': 'a8f01b66-d2ac-4dae-99f7-04556527fb6d', 'no_device': None, 'attachment_id': '8c3da5e4-2ba0-4e78-9096-9649eb46a24a'} {{(pid=231753) _do_swap_volume /opt/stack/nova/nova/compute/manager.py:7904}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[448a41b3-e43d-4124-9777-86fb9e8d208d]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)\ntcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)
Jul 29 13:36:28 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:36:28 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)
Jul 29 13:36:28 user nova-compute[231753]: tcp: [4] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 (non-flash)
Jul 29 13:36:28 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c983ac040>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008'): ({'sdd'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Removing single pathed devices sdd {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5b0fb7e2-99d5-4d58-acc4-fbc03609df97 tempest-TestVolumeSwap-1996519037 tempest-TestVolumeSwap-1996519037-project-admin] Lock "b02ec16d-24a3-450d-858d-3ad302086ac3" "released" by "nova.compute.manager.ComputeManager.swap_volume.<locals>._do_locked_swap_volume" :: held 15.983s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fb2c0c-2b66-4e34-9e59-585fd393def5]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[745a86b0-0d2f-4119-86cf-eb920994f6e1]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Flushing IO for device /dev/sdd {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed36ce4a-a50c-4878-8a23-45f5b3e58c59]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.052s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd49b6d2-84e1-4617-9dc6-f450ad416e3d]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] SCSI volumes sdd have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b112b4a-5f7e-415b-b400-dc152c3838a3]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa0c701-329b-4808-9acf-dd8b483926d8]: (4, ('Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008, portal: 172.16.0.220,3260]\nLogout of [sid: 4, target: iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008, portal: 172.16.0.220,3260]
Jul 29 13:36:28 user nova-compute[231753]: Logout of [sid: 4, target: iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008, portal: 172.16.0.220,3260] successful.
Jul 29 13:36:28 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:d53c30b5-db6e-4df2-a6cc-598971557008 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[153ba357-b607-4602-979f-c095b9e1d4a1]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] <== disconnect_volume: return (379ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:36:28 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Deleting instance files /opt/stack/data/nova/instances/5127f26d-e912-49a4-b8ae-6157f0055270_del
Jul 29 13:36:28 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Deletion of /opt/stack/data/nova/instances/5127f26d-e912-49a4-b8ae-6157f0055270_del complete
Jul 29 13:36:28 user nova-compute[231753]: INFO nova.compute.manager [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Took 4.14 seconds to destroy the instance on the hypervisor.
Jul 29 13:36:28 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-76d0a428-7f34-4e01-8023-3bb6e4c6aa0e tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Acquiring lock "b02ec16d-24a3-450d-858d-3ad302086ac3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-76d0a428-7f34-4e01-8023-3bb6e4c6aa0e tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Lock "b02ec16d-24a3-450d-858d-3ad302086ac3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:28 user nova-compute[231753]: INFO nova.compute.manager [None req-76d0a428-7f34-4e01-8023-3bb6e4c6aa0e tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Detaching volume a8f01b66-d2ac-4dae-99f7-04556527fb6d
Jul 29 13:36:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:28 user nova-compute[231753]: INFO nova.virt.block_device [None req-76d0a428-7f34-4e01-8023-3bb6e4c6aa0e tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Attempting to driver detach volume a8f01b66-d2ac-4dae-99f7-04556527fb6d from mountpoint /dev/vdb
Jul 29 13:36:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-76d0a428-7f34-4e01-8023-3bb6e4c6aa0e tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Attempting to detach device vdb from instance b02ec16d-24a3-450d-858d-3ad302086ac3 from the persistent domain config. {{(pid=231753) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-76d0a428-7f34-4e01-8023-3bb6e4c6aa0e tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:36:29 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:36:29 user nova-compute[231753]:   <source dev="/dev/sde"/>
Jul 29 13:36:29 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:36:29 user nova-compute[231753]:   <serial>a8f01b66-d2ac-4dae-99f7-04556527fb6d</serial>
Jul 29 13:36:29 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 13:36:29 user nova-compute[231753]: </disk>
Jul 29 13:36:29 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:36:29 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-76d0a428-7f34-4e01-8023-3bb6e4c6aa0e tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Successfully detached device vdb from instance b02ec16d-24a3-450d-858d-3ad302086ac3 from the persistent domain config.
Jul 29 13:36:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-76d0a428-7f34-4e01-8023-3bb6e4c6aa0e tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b02ec16d-24a3-450d-858d-3ad302086ac3 from the live domain config. {{(pid=231753) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-76d0a428-7f34-4e01-8023-3bb6e4c6aa0e tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:36:29 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:36:29 user nova-compute[231753]:   <source dev="/dev/sde"/>
Jul 29 13:36:29 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:36:29 user nova-compute[231753]:   <serial>a8f01b66-d2ac-4dae-99f7-04556527fb6d</serial>
Jul 29 13:36:29 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 13:36:29 user nova-compute[231753]: </disk>
Jul 29 13:36:29 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Acquiring lock "b5e7da3f-33d9-4f58-8c98-72869b679850" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "b5e7da3f-33d9-4f58-8c98-72869b679850" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG nova.compute.manager [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:36:29 user nova-compute[231753]: INFO nova.compute.claims [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Claim successful on node user
Jul 29 13:36:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Received event <DeviceRemovedEvent: 1690637789.5027423, b02ec16d-24a3-450d-858d-3ad302086ac3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=231753) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-76d0a428-7f34-4e01-8023-3bb6e4c6aa0e tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b02ec16d-24a3-450d-858d-3ad302086ac3 {{(pid=231753) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 13:36:29 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-76d0a428-7f34-4e01-8023-3bb6e4c6aa0e tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Successfully detached device vdb from instance b02ec16d-24a3-450d-858d-3ad302086ac3 from the live domain config.
Jul 29 13:36:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76d0a428-7f34-4e01-8023-3bb6e4c6aa0e tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d0a428-7f34-4e01-8023-3bb6e4c6aa0e tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'SWZqXMbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde', 'volume_id': 'a8f01b66-d2ac-4dae-99f7-04556527fb6d'}, None), 'kwargs': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:36:29 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-76d0a428-7f34-4e01-8023-3bb6e4c6aa0e tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:36:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-76d0a428-7f34-4e01-8023-3bb6e4c6aa0e tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-76d0a428-7f34-4e01-8023-3bb6e4c6aa0e tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[34eec764-9f32-4006-b7fa-3c81aa4f514e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d0a428-7f34-4e01-8023-3bb6e4c6aa0e tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:36:29 user nova-compute[231753]: No targets found.
Jul 29 13:36:29 user nova-compute[231753]: iSNS:
Jul 29 13:36:29 user nova-compute[231753]: No targets found.
Jul 29 13:36:29 user nova-compute[231753]: STATIC:
Jul 29 13:36:29 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d
Jul 29 13:36:29 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:36:29 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:36:29 user nova-compute[231753]: FIRMWARE:
Jul 29 13:36:29 user nova-compute[231753]: No targets found.
Jul 29 13:36:29 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d0a428-7f34-4e01-8023-3bb6e4c6aa0e tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:36:29 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:36:29 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d0a428-7f34-4e01-8023-3bb6e4c6aa0e tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c98ff00-8883-4f60-93f5-56deeda31590]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.048s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2319ce67-f683-445a-aeb7-6fa38ecf79f7]: (4, ('tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d0a428-7f34-4e01-8023-3bb6e4c6aa0e tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)
Jul 29 13:36:29 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d0a428-7f34-4e01-8023-3bb6e4c6aa0e tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] iscsi session list stdout=tcp: [12] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d (non-flash)
Jul 29 13:36:29 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d0a428-7f34-4e01-8023-3bb6e4c6aa0e tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c982aba30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d'): ({'sde'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-76d0a428-7f34-4e01-8023-3bb6e4c6aa0e tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Removing single pathed devices sde {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d134a1-7eae-4cd9-9719-c3345af55210]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4779c919-672a-4635-99ba-0d2a8f640a78]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-76d0a428-7f34-4e01-8023-3bb6e4c6aa0e tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Flushing IO for device /dev/sde {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ffd6a93-3ed4-445a-84fc-7c7f8aefbac5]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-76d0a428-7f34-4e01-8023-3bb6e4c6aa0e tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.064s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[76013a7a-e587-453e-8f5e-d7d93ffeb55f]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-76d0a428-7f34-4e01-8023-3bb6e4c6aa0e tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-76d0a428-7f34-4e01-8023-3bb6e4c6aa0e tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] SCSI volumes sde have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d0a428-7f34-4e01-8023-3bb6e4c6aa0e tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f09bf293-7607-45e3-91b8-c2694956be30]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d0a428-7f34-4e01-8023-3bb6e4c6aa0e tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a05ec45-157f-40e1-a77c-7b3b2ed82a94]: (4, ('Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d, portal: 172.16.0.220,3260]\nLogout of [sid: 12, target: iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d0a428-7f34-4e01-8023-3bb6e4c6aa0e tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d, portal: 172.16.0.220,3260]
Jul 29 13:36:29 user nova-compute[231753]: Logout of [sid: 12, target: iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d, portal: 172.16.0.220,3260] successful.
Jul 29 13:36:29 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a8f01b66-d2ac-4dae-99f7-04556527fb6d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cfde802-5938-426e-8254-887360ed087f]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d0a428-7f34-4e01-8023-3bb6e4c6aa0e tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-76d0a428-7f34-4e01-8023-3bb6e4c6aa0e tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d0a428-7f34-4e01-8023-3bb6e4c6aa0e tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] <== disconnect_volume: return (393ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76d0a428-7f34-4e01-8023-3bb6e4c6aa0e tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:36:29 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:36:30 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:36:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.632s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:30 user nova-compute[231753]: DEBUG nova.compute.manager [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:36:30 user nova-compute[231753]: DEBUG nova.compute.manager [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:36:30 user nova-compute[231753]: DEBUG nova.network.neutron [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:36:30 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:36:30 user nova-compute[231753]: DEBUG nova.compute.manager [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:36:30 user nova-compute[231753]: DEBUG nova.policy [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '82c6eeb939f94fa5953a349127247021', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44867a8743214d32a94bca3506295e92', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:36:30 user nova-compute[231753]: DEBUG nova.compute.manager [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:36:30 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:36:30 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Creating image(s)
Jul 29 13:36:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Acquiring lock "/opt/stack/data/nova/instances/b5e7da3f-33d9-4f58-8c98-72869b679850/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "/opt/stack/data/nova/instances/b5e7da3f-33d9-4f58-8c98-72869b679850/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "/opt/stack/data/nova/instances/b5e7da3f-33d9-4f58-8c98-72869b679850/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.167s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.003s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.211s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/b5e7da3f-33d9-4f58-8c98-72869b679850/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:30 user nova-compute[231753]: DEBUG nova.objects.instance [None req-76d0a428-7f34-4e01-8023-3bb6e4c6aa0e tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Lazy-loading 'flavor' on Instance uuid b02ec16d-24a3-450d-858d-3ad302086ac3 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:36:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/b5e7da3f-33d9-4f58-8c98-72869b679850/disk 1073741824" returned: 0 in 0.086s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.302s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-76d0a428-7f34-4e01-8023-3bb6e4c6aa0e tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Lock "b02ec16d-24a3-450d-858d-3ad302086ac3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.025s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:31 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.183s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:31 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b5e7da3f-33d9-4f58-8c98-72869b679850/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:36:31 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e7da3f-33d9-4f58-8c98-72869b679850/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:31 user nova-compute[231753]: DEBUG nova.compute.manager [req-d93271ac-76de-4d4f-9ab9-f4cce36197b5 req-1d6ee83e-dad4-4b7e-985a-0df00f19e996 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-deleted-7a1e3eda-8abb-49ca-a495-aa7f584a9252 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:31 user nova-compute[231753]: INFO nova.compute.manager [req-d93271ac-76de-4d4f-9ab9-f4cce36197b5 req-1d6ee83e-dad4-4b7e-985a-0df00f19e996 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Neutron deleted interface 7a1e3eda-8abb-49ca-a495-aa7f584a9252; detaching it from the instance and deleting it from the info cache
Jul 29 13:36:31 user nova-compute[231753]: DEBUG nova.network.neutron [req-d93271ac-76de-4d4f-9ab9-f4cce36197b5 req-1d6ee83e-dad4-4b7e-985a-0df00f19e996 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Updating instance_info_cache with network_info: [{"id": "f6babf7d-a012-411a-a2cc-134c92ac26d8", "address": "fa:16:3e:0f:55:20", "network": {"id": "506f7783-e44a-4de3-8c0d-aa1177c2eef6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-998637392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6babf7d-a0", "ovs_interfaceid": "f6babf7d-a012-411a-a2cc-134c92ac26d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c652fd6e-0d41-4593-8d73-893962490f30", "address": "fa:16:3e:45:ca:0a", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652fd6e-0d", "ovs_interfaceid": "c652fd6e-0d41-4593-8d73-893962490f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e106a9dd-3d36-4bea-953b-fe65ba4747a5", "address": "fa:16:3e:6a:51:5c", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106a9dd-3d", "ovs_interfaceid": "e106a9dd-3d36-4bea-953b-fe65ba4747a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28d91bef-df2e-469a-b449-10e27e352ee8", "address": "fa:16:3e:d4:e9:c0", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d91bef-df", "ovs_interfaceid": "28d91bef-df2e-469a-b449-10e27e352ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "0dd83ad9-c54b-4c90-981a-8982501e36cf", "address": "fa:16:3e:cb:c0:08", "network": {"id": "70108ad7-d95b-4b71-a4b1-d6750a3d30cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-155167949", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap0dd83ad9-c5", "ovs_interfaceid": "0dd83ad9-c54b-4c90-981a-8982501e36cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "713bc8f5-df03-42c3-8250-ff7ed4e07f4e", "address": "fa:16:3e:22:fe:88", "network": {"id": "70108ad7-d95b-4b71-a4b1-d6750a3d30cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-155167949", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap713bc8f5-df", "ovs_interfaceid": "713bc8f5-df03-42c3-8250-ff7ed4e07f4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:36:31 user nova-compute[231753]: DEBUG nova.network.neutron [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Successfully created port: 7be1f6de-22a8-4dde-9fad-8c62c975ab2b {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:36:31 user nova-compute[231753]: DEBUG nova.compute.manager [req-d93271ac-76de-4d4f-9ab9-f4cce36197b5 req-1d6ee83e-dad4-4b7e-985a-0df00f19e996 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Detach interface failed, port_id=7a1e3eda-8abb-49ca-a495-aa7f584a9252, reason: Instance 5127f26d-e912-49a4-b8ae-6157f0055270 could not be found. {{(pid=231753) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 13:36:31 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e7da3f-33d9-4f58-8c98-72869b679850/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:31 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Cannot resize image /opt/stack/data/nova/instances/b5e7da3f-33d9-4f58-8c98-72869b679850/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:36:31 user nova-compute[231753]: DEBUG nova.objects.instance [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lazy-loading 'migration_context' on Instance uuid b5e7da3f-33d9-4f58-8c98-72869b679850 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:36:31 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:36:31 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Ensure instance console log exists: /opt/stack/data/nova/instances/b5e7da3f-33d9-4f58-8c98-72869b679850/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:36:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:31 user nova-compute[231753]: DEBUG nova.network.neutron [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Successfully updated port: 7be1f6de-22a8-4dde-9fad-8c62c975ab2b {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:36:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Acquiring lock "refresh_cache-b5e7da3f-33d9-4f58-8c98-72869b679850" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:36:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Acquired lock "refresh_cache-b5e7da3f-33d9-4f58-8c98-72869b679850" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:36:31 user nova-compute[231753]: DEBUG nova.network.neutron [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG nova.compute.manager [req-7ce5d2b1-26d6-4f0d-a0f6-c7869bec985b req-21f4e8ed-c254-4f0b-a313-f437be175164 service nova] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Received event network-changed-7be1f6de-22a8-4dde-9fad-8c62c975ab2b {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG nova.compute.manager [req-7ce5d2b1-26d6-4f0d-a0f6-c7869bec985b req-21f4e8ed-c254-4f0b-a313-f437be175164 service nova] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Refreshing instance network info cache due to event network-changed-7be1f6de-22a8-4dde-9fad-8c62c975ab2b. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7ce5d2b1-26d6-4f0d-a0f6-c7869bec985b req-21f4e8ed-c254-4f0b-a313-f437be175164 service nova] Acquiring lock "refresh_cache-b5e7da3f-33d9-4f58-8c98-72869b679850" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG nova.network.neutron [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG nova.network.neutron [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Updating instance_info_cache with network_info: [{"id": "7be1f6de-22a8-4dde-9fad-8c62c975ab2b", "address": "fa:16:3e:e8:21:9c", "network": {"id": "2e7ef980-929c-4ea5-86b7-d69bcfa4a209", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1403711156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44867a8743214d32a94bca3506295e92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be1f6de-22", "ovs_interfaceid": "7be1f6de-22a8-4dde-9fad-8c62c975ab2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Releasing lock "refresh_cache-b5e7da3f-33d9-4f58-8c98-72869b679850" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG nova.compute.manager [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Instance network_info: |[{"id": "7be1f6de-22a8-4dde-9fad-8c62c975ab2b", "address": "fa:16:3e:e8:21:9c", "network": {"id": "2e7ef980-929c-4ea5-86b7-d69bcfa4a209", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1403711156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44867a8743214d32a94bca3506295e92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be1f6de-22", "ovs_interfaceid": "7be1f6de-22a8-4dde-9fad-8c62c975ab2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7ce5d2b1-26d6-4f0d-a0f6-c7869bec985b req-21f4e8ed-c254-4f0b-a313-f437be175164 service nova] Acquired lock "refresh_cache-b5e7da3f-33d9-4f58-8c98-72869b679850" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG nova.network.neutron [req-7ce5d2b1-26d6-4f0d-a0f6-c7869bec985b req-21f4e8ed-c254-4f0b-a313-f437be175164 service nova] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Refreshing network info cache for port 7be1f6de-22a8-4dde-9fad-8c62c975ab2b {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Start _get_guest_xml network_info=[{"id": "7be1f6de-22a8-4dde-9fad-8c62c975ab2b", "address": "fa:16:3e:e8:21:9c", "network": {"id": "2e7ef980-929c-4ea5-86b7-d69bcfa4a209", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1403711156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44867a8743214d32a94bca3506295e92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be1f6de-22", "ovs_interfaceid": "7be1f6de-22a8-4dde-9fad-8c62c975ab2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:36:32 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:36:32 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:36:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:36:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-401714488',display_name='tempest-VolumesAdminNegativeTest-server-401714488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-401714488',id=13,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44867a8743214d32a94bca3506295e92',ramdisk_id='',reservation_id='r-zlkd57hd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-193285786',owner_user_name='tempest-VolumesAdminNegativeTest-193285786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:36:30Z,user_data=None,user_id='82c6eeb939f94fa5953a349127247021',uuid=b5e7da3f-33d9-4f58-8c98-72869b679850,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7be1f6de-22a8-4dde-9fad-8c62c975ab2b", "address": "fa:16:3e:e8:21:9c", "network": {"id": "2e7ef980-929c-4ea5-86b7-d69bcfa4a209", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1403711156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44867a8743214d32a94bca3506295e92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be1f6de-22", "ovs_interfaceid": "7be1f6de-22a8-4dde-9fad-8c62c975ab2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Converting VIF {"id": "7be1f6de-22a8-4dde-9fad-8c62c975ab2b", "address": "fa:16:3e:e8:21:9c", "network": {"id": "2e7ef980-929c-4ea5-86b7-d69bcfa4a209", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1403711156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44867a8743214d32a94bca3506295e92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be1f6de-22", "ovs_interfaceid": "7be1f6de-22a8-4dde-9fad-8c62c975ab2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:21:9c,bridge_name='br-int',has_traffic_filtering=True,id=7be1f6de-22a8-4dde-9fad-8c62c975ab2b,network=Network(2e7ef980-929c-4ea5-86b7-d69bcfa4a209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be1f6de-22') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG nova.objects.instance [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lazy-loading 'pci_devices' on Instance uuid b5e7da3f-33d9-4f58-8c98-72869b679850 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:36:32 user nova-compute[231753]:   <uuid>b5e7da3f-33d9-4f58-8c98-72869b679850</uuid>
Jul 29 13:36:32 user nova-compute[231753]:   <name>instance-0000000d</name>
Jul 29 13:36:32 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:36:32 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:36:32 user nova-compute[231753]:   <metadata>
Jul 29 13:36:32 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:36:32 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:36:32 user nova-compute[231753]:       <nova:name>tempest-VolumesAdminNegativeTest-server-401714488</nova:name>
Jul 29 13:36:32 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:36:32</nova:creationTime>
Jul 29 13:36:32 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:36:32 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:36:32 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:36:32 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:36:32 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:36:32 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:36:32 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:36:32 user nova-compute[231753]:       <nova:owner>
Jul 29 13:36:32 user nova-compute[231753]:         <nova:user uuid="82c6eeb939f94fa5953a349127247021">tempest-VolumesAdminNegativeTest-193285786-project-member</nova:user>
Jul 29 13:36:32 user nova-compute[231753]:         <nova:project uuid="44867a8743214d32a94bca3506295e92">tempest-VolumesAdminNegativeTest-193285786</nova:project>
Jul 29 13:36:32 user nova-compute[231753]:       </nova:owner>
Jul 29 13:36:32 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:36:32 user nova-compute[231753]:       <nova:ports>
Jul 29 13:36:32 user nova-compute[231753]:         <nova:port uuid="7be1f6de-22a8-4dde-9fad-8c62c975ab2b">
Jul 29 13:36:32 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 29 13:36:32 user nova-compute[231753]:         </nova:port>
Jul 29 13:36:32 user nova-compute[231753]:       </nova:ports>
Jul 29 13:36:32 user nova-compute[231753]:     </nova:instance>
Jul 29 13:36:32 user nova-compute[231753]:   </metadata>
Jul 29 13:36:32 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:36:32 user nova-compute[231753]:     <system>
Jul 29 13:36:32 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:36:32 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:36:32 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:36:32 user nova-compute[231753]:       <entry name="serial">b5e7da3f-33d9-4f58-8c98-72869b679850</entry>
Jul 29 13:36:32 user nova-compute[231753]:       <entry name="uuid">b5e7da3f-33d9-4f58-8c98-72869b679850</entry>
Jul 29 13:36:32 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:36:32 user nova-compute[231753]:     </system>
Jul 29 13:36:32 user nova-compute[231753]:   </sysinfo>
Jul 29 13:36:32 user nova-compute[231753]:   <os>
Jul 29 13:36:32 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:36:32 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:36:32 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:36:32 user nova-compute[231753]:   </os>
Jul 29 13:36:32 user nova-compute[231753]:   <features>
Jul 29 13:36:32 user nova-compute[231753]:     <acpi/>
Jul 29 13:36:32 user nova-compute[231753]:     <apic/>
Jul 29 13:36:32 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:36:32 user nova-compute[231753]:   </features>
Jul 29 13:36:32 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:36:32 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:36:32 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:36:32 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:36:32 user nova-compute[231753]:   </clock>
Jul 29 13:36:32 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:36:32 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:36:32 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:36:32 user nova-compute[231753]:   </cpu>
Jul 29 13:36:32 user nova-compute[231753]:   <devices>
Jul 29 13:36:32 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:36:32 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:36:32 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/b5e7da3f-33d9-4f58-8c98-72869b679850/disk"/>
Jul 29 13:36:32 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:36:32 user nova-compute[231753]:     </disk>
Jul 29 13:36:32 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:36:32 user nova-compute[231753]:       <mac address="fa:16:3e:e8:21:9c"/>
Jul 29 13:36:32 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:36:32 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:36:32 user nova-compute[231753]:       <target dev="tap7be1f6de-22"/>
Jul 29 13:36:32 user nova-compute[231753]:     </interface>
Jul 29 13:36:32 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:36:32 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/b5e7da3f-33d9-4f58-8c98-72869b679850/console.log" append="off"/>
Jul 29 13:36:32 user nova-compute[231753]:     </serial>
Jul 29 13:36:32 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:36:32 user nova-compute[231753]:     <video>
Jul 29 13:36:32 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:36:32 user nova-compute[231753]:     </video>
Jul 29 13:36:32 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:36:32 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:36:32 user nova-compute[231753]:     </rng>
Jul 29 13:36:32 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:36:32 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:36:32 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:36:32 user nova-compute[231753]:     </memballoon>
Jul 29 13:36:32 user nova-compute[231753]:   </devices>
Jul 29 13:36:32 user nova-compute[231753]: </domain>
Jul 29 13:36:32 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:36:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-401714488',display_name='tempest-VolumesAdminNegativeTest-server-401714488',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-401714488',id=13,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='44867a8743214d32a94bca3506295e92',ramdisk_id='',reservation_id='r-zlkd57hd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-193285786',owner_user_name='tempest-VolumesAdminNegativeTest-193285786-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:36:30Z,user_data=None,user_id='82c6eeb939f94fa5953a349127247021',uuid=b5e7da3f-33d9-4f58-8c98-72869b679850,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7be1f6de-22a8-4dde-9fad-8c62c975ab2b", "address": "fa:16:3e:e8:21:9c", "network": {"id": "2e7ef980-929c-4ea5-86b7-d69bcfa4a209", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1403711156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44867a8743214d32a94bca3506295e92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be1f6de-22", "ovs_interfaceid": "7be1f6de-22a8-4dde-9fad-8c62c975ab2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Converting VIF {"id": "7be1f6de-22a8-4dde-9fad-8c62c975ab2b", "address": "fa:16:3e:e8:21:9c", "network": {"id": "2e7ef980-929c-4ea5-86b7-d69bcfa4a209", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1403711156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44867a8743214d32a94bca3506295e92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be1f6de-22", "ovs_interfaceid": "7be1f6de-22a8-4dde-9fad-8c62c975ab2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:21:9c,bridge_name='br-int',has_traffic_filtering=True,id=7be1f6de-22a8-4dde-9fad-8c62c975ab2b,network=Network(2e7ef980-929c-4ea5-86b7-d69bcfa4a209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be1f6de-22') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG os_vif [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:21:9c,bridge_name='br-int',has_traffic_filtering=True,id=7be1f6de-22a8-4dde-9fad-8c62c975ab2b,network=Network(2e7ef980-929c-4ea5-86b7-d69bcfa4a209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be1f6de-22') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7be1f6de-22, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7be1f6de-22, col_values=(('external_ids', {'iface-id': '7be1f6de-22a8-4dde-9fad-8c62c975ab2b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e8:21:9c', 'vm-uuid': 'b5e7da3f-33d9-4f58-8c98-72869b679850'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:32 user nova-compute[231753]: INFO os_vif [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:21:9c,bridge_name='br-int',has_traffic_filtering=True,id=7be1f6de-22a8-4dde-9fad-8c62c975ab2b,network=Network(2e7ef980-929c-4ea5-86b7-d69bcfa4a209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be1f6de-22')
Jul 29 13:36:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] No VIF found with MAC fa:16:3e:e8:21:9c, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:36:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:33 user nova-compute[231753]: DEBUG nova.compute.manager [req-45859ae8-7b9d-4a76-8405-2c61271b033b req-a26ac146-54ac-408f-b03b-d3ff9a9d7a44 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-deleted-0dd83ad9-c54b-4c90-981a-8982501e36cf {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:33 user nova-compute[231753]: INFO nova.compute.manager [req-45859ae8-7b9d-4a76-8405-2c61271b033b req-a26ac146-54ac-408f-b03b-d3ff9a9d7a44 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Neutron deleted interface 0dd83ad9-c54b-4c90-981a-8982501e36cf; detaching it from the instance and deleting it from the info cache
Jul 29 13:36:33 user nova-compute[231753]: DEBUG nova.network.neutron [req-45859ae8-7b9d-4a76-8405-2c61271b033b req-a26ac146-54ac-408f-b03b-d3ff9a9d7a44 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Updating instance_info_cache with network_info: [{"id": "f6babf7d-a012-411a-a2cc-134c92ac26d8", "address": "fa:16:3e:0f:55:20", "network": {"id": "506f7783-e44a-4de3-8c0d-aa1177c2eef6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-998637392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6babf7d-a0", "ovs_interfaceid": "f6babf7d-a012-411a-a2cc-134c92ac26d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c652fd6e-0d41-4593-8d73-893962490f30", "address": "fa:16:3e:45:ca:0a", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652fd6e-0d", "ovs_interfaceid": "c652fd6e-0d41-4593-8d73-893962490f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e106a9dd-3d36-4bea-953b-fe65ba4747a5", "address": "fa:16:3e:6a:51:5c", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106a9dd-3d", "ovs_interfaceid": "e106a9dd-3d36-4bea-953b-fe65ba4747a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28d91bef-df2e-469a-b449-10e27e352ee8", "address": "fa:16:3e:d4:e9:c0", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d91bef-df", "ovs_interfaceid": "28d91bef-df2e-469a-b449-10e27e352ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "713bc8f5-df03-42c3-8250-ff7ed4e07f4e", "address": "fa:16:3e:22:fe:88", "network": {"id": "70108ad7-d95b-4b71-a4b1-d6750a3d30cf", "bridge": "br-int", "label": "tempest-device-tagging-net2-155167949", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap713bc8f5-df", "ovs_interfaceid": "713bc8f5-df03-42c3-8250-ff7ed4e07f4e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:36:33 user nova-compute[231753]: DEBUG nova.compute.manager [req-45859ae8-7b9d-4a76-8405-2c61271b033b req-a26ac146-54ac-408f-b03b-d3ff9a9d7a44 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Detach interface failed, port_id=0dd83ad9-c54b-4c90-981a-8982501e36cf, reason: Instance 5127f26d-e912-49a4-b8ae-6157f0055270 could not be found. {{(pid=231753) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 13:36:33 user nova-compute[231753]: DEBUG nova.compute.manager [req-45859ae8-7b9d-4a76-8405-2c61271b033b req-a26ac146-54ac-408f-b03b-d3ff9a9d7a44 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-deleted-713bc8f5-df03-42c3-8250-ff7ed4e07f4e {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:33 user nova-compute[231753]: INFO nova.compute.manager [req-45859ae8-7b9d-4a76-8405-2c61271b033b req-a26ac146-54ac-408f-b03b-d3ff9a9d7a44 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Neutron deleted interface 713bc8f5-df03-42c3-8250-ff7ed4e07f4e; detaching it from the instance and deleting it from the info cache
Jul 29 13:36:33 user nova-compute[231753]: DEBUG nova.network.neutron [req-45859ae8-7b9d-4a76-8405-2c61271b033b req-a26ac146-54ac-408f-b03b-d3ff9a9d7a44 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Updating instance_info_cache with network_info: [{"id": "f6babf7d-a012-411a-a2cc-134c92ac26d8", "address": "fa:16:3e:0f:55:20", "network": {"id": "506f7783-e44a-4de3-8c0d-aa1177c2eef6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-998637392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6babf7d-a0", "ovs_interfaceid": "f6babf7d-a012-411a-a2cc-134c92ac26d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c652fd6e-0d41-4593-8d73-893962490f30", "address": "fa:16:3e:45:ca:0a", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652fd6e-0d", "ovs_interfaceid": "c652fd6e-0d41-4593-8d73-893962490f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e106a9dd-3d36-4bea-953b-fe65ba4747a5", "address": "fa:16:3e:6a:51:5c", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106a9dd-3d", "ovs_interfaceid": "e106a9dd-3d36-4bea-953b-fe65ba4747a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "28d91bef-df2e-469a-b449-10e27e352ee8", "address": "fa:16:3e:d4:e9:c0", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.59", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap28d91bef-df", "ovs_interfaceid": "28d91bef-df2e-469a-b449-10e27e352ee8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:36:33 user nova-compute[231753]: DEBUG nova.compute.manager [req-45859ae8-7b9d-4a76-8405-2c61271b033b req-a26ac146-54ac-408f-b03b-d3ff9a9d7a44 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Detach interface failed, port_id=713bc8f5-df03-42c3-8250-ff7ed4e07f4e, reason: Instance 5127f26d-e912-49a4-b8ae-6157f0055270 could not be found. {{(pid=231753) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 13:36:33 user nova-compute[231753]: DEBUG nova.compute.manager [req-45859ae8-7b9d-4a76-8405-2c61271b033b req-a26ac146-54ac-408f-b03b-d3ff9a9d7a44 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-deleted-28d91bef-df2e-469a-b449-10e27e352ee8 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:33 user nova-compute[231753]: INFO nova.compute.manager [req-45859ae8-7b9d-4a76-8405-2c61271b033b req-a26ac146-54ac-408f-b03b-d3ff9a9d7a44 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Neutron deleted interface 28d91bef-df2e-469a-b449-10e27e352ee8; detaching it from the instance and deleting it from the info cache
Jul 29 13:36:33 user nova-compute[231753]: DEBUG nova.network.neutron [req-45859ae8-7b9d-4a76-8405-2c61271b033b req-a26ac146-54ac-408f-b03b-d3ff9a9d7a44 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Updating instance_info_cache with network_info: [{"id": "f6babf7d-a012-411a-a2cc-134c92ac26d8", "address": "fa:16:3e:0f:55:20", "network": {"id": "506f7783-e44a-4de3-8c0d-aa1177c2eef6", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-998637392-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.218", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf6babf7d-a0", "ovs_interfaceid": "f6babf7d-a012-411a-a2cc-134c92ac26d8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c652fd6e-0d41-4593-8d73-893962490f30", "address": "fa:16:3e:45:ca:0a", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.117", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc652fd6e-0d", "ovs_interfaceid": "c652fd6e-0d41-4593-8d73-893962490f30", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "e106a9dd-3d36-4bea-953b-fe65ba4747a5", "address": "fa:16:3e:6a:51:5c", "network": {"id": "fc93cbb9-0614-404f-bbdf-ea3ae231e7b6", "bridge": "br-int", "label": "tempest-device-tagging-net1-1917373561", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.60", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "195f27dc9cac4e53b96830a5f5168711", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape106a9dd-3d", "ovs_interfaceid": "e106a9dd-3d36-4bea-953b-fe65ba4747a5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:36:33 user nova-compute[231753]: DEBUG nova.compute.manager [req-45859ae8-7b9d-4a76-8405-2c61271b033b req-a26ac146-54ac-408f-b03b-d3ff9a9d7a44 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Detach interface failed, port_id=28d91bef-df2e-469a-b449-10e27e352ee8, reason: Instance 5127f26d-e912-49a4-b8ae-6157f0055270 could not be found. {{(pid=231753) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 13:36:33 user nova-compute[231753]: DEBUG nova.network.neutron [req-7ce5d2b1-26d6-4f0d-a0f6-c7869bec985b req-21f4e8ed-c254-4f0b-a313-f437be175164 service nova] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Updated VIF entry in instance network info cache for port 7be1f6de-22a8-4dde-9fad-8c62c975ab2b. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:36:33 user nova-compute[231753]: DEBUG nova.network.neutron [req-7ce5d2b1-26d6-4f0d-a0f6-c7869bec985b req-21f4e8ed-c254-4f0b-a313-f437be175164 service nova] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Updating instance_info_cache with network_info: [{"id": "7be1f6de-22a8-4dde-9fad-8c62c975ab2b", "address": "fa:16:3e:e8:21:9c", "network": {"id": "2e7ef980-929c-4ea5-86b7-d69bcfa4a209", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1403711156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44867a8743214d32a94bca3506295e92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be1f6de-22", "ovs_interfaceid": "7be1f6de-22a8-4dde-9fad-8c62c975ab2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:36:33 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:36:33 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Took 4.93 seconds to deallocate network for instance.
Jul 29 13:36:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7ce5d2b1-26d6-4f0d-a0f6-c7869bec985b req-21f4e8ed-c254-4f0b-a313-f437be175164 service nova] Releasing lock "refresh_cache-b5e7da3f-33d9-4f58-8c98-72869b679850" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:36:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:34 user nova-compute[231753]: DEBUG nova.compute.manager [req-a894dfe0-141a-4f3b-a3c7-953d4aa0fa9f req-a9c1a995-1c17-44e4-81ec-9ad99d117c7e service nova] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Received event network-vif-plugged-7be1f6de-22a8-4dde-9fad-8c62c975ab2b {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a894dfe0-141a-4f3b-a3c7-953d4aa0fa9f req-a9c1a995-1c17-44e4-81ec-9ad99d117c7e service nova] Acquiring lock "b5e7da3f-33d9-4f58-8c98-72869b679850-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a894dfe0-141a-4f3b-a3c7-953d4aa0fa9f req-a9c1a995-1c17-44e4-81ec-9ad99d117c7e service nova] Lock "b5e7da3f-33d9-4f58-8c98-72869b679850-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a894dfe0-141a-4f3b-a3c7-953d4aa0fa9f req-a9c1a995-1c17-44e4-81ec-9ad99d117c7e service nova] Lock "b5e7da3f-33d9-4f58-8c98-72869b679850-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:34 user nova-compute[231753]: DEBUG nova.compute.manager [req-a894dfe0-141a-4f3b-a3c7-953d4aa0fa9f req-a9c1a995-1c17-44e4-81ec-9ad99d117c7e service nova] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] No waiting events found dispatching network-vif-plugged-7be1f6de-22a8-4dde-9fad-8c62c975ab2b {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:36:34 user nova-compute[231753]: WARNING nova.compute.manager [req-a894dfe0-141a-4f3b-a3c7-953d4aa0fa9f req-a9c1a995-1c17-44e4-81ec-9ad99d117c7e service nova] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Received unexpected event network-vif-plugged-7be1f6de-22a8-4dde-9fad-8c62c975ab2b for instance with vm_state building and task_state spawning.
Jul 29 13:36:35 user nova-compute[231753]: DEBUG nova.compute.manager [req-4662cb99-b930-4d0e-b8df-d69c8c26bff3 req-ab7692ea-4e9e-4a1f-8e5b-b0317ac44f80 service nova] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Received event network-vif-deleted-f6babf7d-a012-411a-a2cc-134c92ac26d8 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:35 user nova-compute[231753]: INFO nova.compute.manager [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Took 2.51 seconds to detach 3 volumes for instance.
Jul 29 13:36:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:36 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:36:36 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637796.3164423, b5e7da3f-33d9-4f58-8c98-72869b679850 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:36:36 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] VM Resumed (Lifecycle Event)
Jul 29 13:36:36 user nova-compute[231753]: DEBUG nova.compute.manager [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:36:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:36:36 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:36:36 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:36:36 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Instance spawned successfully.
Jul 29 13:36:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:36:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:36 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:36:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:36:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:36:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:36:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:36:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:36:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:36:36 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:36:36 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637796.3190951, b5e7da3f-33d9-4f58-8c98-72869b679850 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:36:36 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] VM Started (Lifecycle Event)
Jul 29 13:36:36 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Deleted allocations for instance 5127f26d-e912-49a4-b8ae-6157f0055270
Jul 29 13:36:36 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:36:36 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:36:36 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:36:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1bea6706-defc-4a0a-a681-2a4c42b3d8fc tempest-TaggedBootDevicesTest-2120010551 tempest-TaggedBootDevicesTest-2120010551-project-member] Lock "5127f26d-e912-49a4-b8ae-6157f0055270" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 12.270s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:36 user nova-compute[231753]: INFO nova.compute.manager [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Took 6.16 seconds to spawn the instance on the hypervisor.
Jul 29 13:36:36 user nova-compute[231753]: DEBUG nova.compute.manager [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:36:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:36 user nova-compute[231753]: INFO nova.compute.manager [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Took 7.35 seconds to build instance.
Jul 29 13:36:36 user nova-compute[231753]: DEBUG nova.compute.manager [req-6163321e-34cf-42cd-a803-6a9ef6a0e8b4 req-8ae7e446-ac29-4c71-a86d-2f5182072155 service nova] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Received event network-vif-plugged-7be1f6de-22a8-4dde-9fad-8c62c975ab2b {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6163321e-34cf-42cd-a803-6a9ef6a0e8b4 req-8ae7e446-ac29-4c71-a86d-2f5182072155 service nova] Acquiring lock "b5e7da3f-33d9-4f58-8c98-72869b679850-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6163321e-34cf-42cd-a803-6a9ef6a0e8b4 req-8ae7e446-ac29-4c71-a86d-2f5182072155 service nova] Lock "b5e7da3f-33d9-4f58-8c98-72869b679850-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6163321e-34cf-42cd-a803-6a9ef6a0e8b4 req-8ae7e446-ac29-4c71-a86d-2f5182072155 service nova] Lock "b5e7da3f-33d9-4f58-8c98-72869b679850-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:36 user nova-compute[231753]: DEBUG nova.compute.manager [req-6163321e-34cf-42cd-a803-6a9ef6a0e8b4 req-8ae7e446-ac29-4c71-a86d-2f5182072155 service nova] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] No waiting events found dispatching network-vif-plugged-7be1f6de-22a8-4dde-9fad-8c62c975ab2b {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:36:36 user nova-compute[231753]: WARNING nova.compute.manager [req-6163321e-34cf-42cd-a803-6a9ef6a0e8b4 req-8ae7e446-ac29-4c71-a86d-2f5182072155 service nova] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Received unexpected event network-vif-plugged-7be1f6de-22a8-4dde-9fad-8c62c975ab2b for instance with vm_state active and task_state None.
Jul 29 13:36:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c5615f8c-d56e-4c07-a22c-343ff8604bc1 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "b5e7da3f-33d9-4f58-8c98-72869b679850" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.504s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:41 user nova-compute[231753]: DEBUG nova.compute.manager [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:36:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:41 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:36:41 user nova-compute[231753]: INFO nova.compute.claims [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Claim successful on node user
Jul 29 13:36:41 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690637786.2670865, 5127f26d-e912-49a4-b8ae-6157f0055270 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:36:41 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] VM Stopped (Lifecycle Event)
Jul 29 13:36:41 user nova-compute[231753]: DEBUG nova.compute.manager [None req-b2fd9c5d-7724-46da-b227-a60cab6a43d5 None None] [instance: 5127f26d-e912-49a4-b8ae-6157f0055270] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:36:41 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:36:41 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:36:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.667s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:41 user nova-compute[231753]: DEBUG nova.compute.manager [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:36:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "8ea52d41-7ec3-44d7-8421-133000ee887b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "8ea52d41-7ec3-44d7-8421-133000ee887b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:41 user nova-compute[231753]: DEBUG nova.compute.manager [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:36:41 user nova-compute[231753]: DEBUG nova.compute.manager [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:36:41 user nova-compute[231753]: DEBUG nova.network.neutron [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:36:42 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:36:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:36:42 user nova-compute[231753]: INFO nova.compute.claims [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Claim successful on node user
Jul 29 13:36:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:36:42 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Creating image(s)
Jul 29 13:36:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "/opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "/opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG nova.policy [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '01b32889cd7442399a8bceaff3d05662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa6e9e70b4a49cb994440e868203c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.157s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.146s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk 1073741824" returned: 0 in 0.079s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.160s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Checking if we can resize image /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.681s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG nova.network.neutron [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:42 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:36:42 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Cannot resize image /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG nova.objects.instance [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lazy-loading 'migration_context' on Instance uuid 7e2615c1-b03e-4076-bcd9-3585fb11b8ac {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG nova.network.neutron [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Successfully created port: 8c8e51fe-0d15-4a27-8215-dc512b6816f5 {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Ensure instance console log exists: /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:43 user nova-compute[231753]: DEBUG nova.policy [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '01b32889cd7442399a8bceaff3d05662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa6e9e70b4a49cb994440e868203c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:36:43 user nova-compute[231753]: DEBUG nova.compute.manager [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:36:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:36:43 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Creating image(s)
Jul 29 13:36:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "/opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "/opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.090s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.246s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.204s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:43 user nova-compute[231753]: DEBUG nova.network.neutron [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Successfully created port: 4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:36:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk 1073741824" returned: 0 in 0.086s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.297s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.158s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:43 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:36:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Cannot resize image /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.objects.instance [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lazy-loading 'migration_context' on Instance uuid 8ea52d41-7ec3-44d7-8421-133000ee887b {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Ensure instance console log exists: /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.003s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.003s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.network.neutron [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Successfully updated port: 8c8e51fe-0d15-4a27-8215-dc512b6816f5 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "refresh_cache-7e2615c1-b03e-4076-bcd9-3585fb11b8ac" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquired lock "refresh_cache-7e2615c1-b03e-4076-bcd9-3585fb11b8ac" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.network.neutron [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-797eaeb7-1a29-4e83-8d9e-070ade714f95 req-a82c6f88-68fc-4b8b-93df-73b7dd636ef1 service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Received event network-changed-8c8e51fe-0d15-4a27-8215-dc512b6816f5 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-797eaeb7-1a29-4e83-8d9e-070ade714f95 req-a82c6f88-68fc-4b8b-93df-73b7dd636ef1 service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Refreshing instance network info cache due to event network-changed-8c8e51fe-0d15-4a27-8215-dc512b6816f5. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-797eaeb7-1a29-4e83-8d9e-070ade714f95 req-a82c6f88-68fc-4b8b-93df-73b7dd636ef1 service nova] Acquiring lock "refresh_cache-7e2615c1-b03e-4076-bcd9-3585fb11b8ac" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.network.neutron [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.network.neutron [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Successfully updated port: 4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "refresh_cache-8ea52d41-7ec3-44d7-8421-133000ee887b" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquired lock "refresh_cache-8ea52d41-7ec3-44d7-8421-133000ee887b" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.network.neutron [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-f4e92b26-c23a-44df-b557-1487e20a4d89 req-be54eee5-d0a2-4508-b614-ab8526410548 service nova] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Received event network-changed-4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-f4e92b26-c23a-44df-b557-1487e20a4d89 req-be54eee5-d0a2-4508-b614-ab8526410548 service nova] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Refreshing instance network info cache due to event network-changed-4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-f4e92b26-c23a-44df-b557-1487e20a4d89 req-be54eee5-d0a2-4508-b614-ab8526410548 service nova] Acquiring lock "refresh_cache-8ea52d41-7ec3-44d7-8421-133000ee887b" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.network.neutron [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.network.neutron [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Updating instance_info_cache with network_info: [{"id": "8c8e51fe-0d15-4a27-8215-dc512b6816f5", "address": "fa:16:3e:3e:10:27", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e51fe-0d", "ovs_interfaceid": "8c8e51fe-0d15-4a27-8215-dc512b6816f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Releasing lock "refresh_cache-7e2615c1-b03e-4076-bcd9-3585fb11b8ac" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.compute.manager [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Instance network_info: |[{"id": "8c8e51fe-0d15-4a27-8215-dc512b6816f5", "address": "fa:16:3e:3e:10:27", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e51fe-0d", "ovs_interfaceid": "8c8e51fe-0d15-4a27-8215-dc512b6816f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-797eaeb7-1a29-4e83-8d9e-070ade714f95 req-a82c6f88-68fc-4b8b-93df-73b7dd636ef1 service nova] Acquired lock "refresh_cache-7e2615c1-b03e-4076-bcd9-3585fb11b8ac" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.network.neutron [req-797eaeb7-1a29-4e83-8d9e-070ade714f95 req-a82c6f88-68fc-4b8b-93df-73b7dd636ef1 service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Refreshing network info cache for port 8c8e51fe-0d15-4a27-8215-dc512b6816f5 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Start _get_guest_xml network_info=[{"id": "8c8e51fe-0d15-4a27-8215-dc512b6816f5", "address": "fa:16:3e:3e:10:27", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e51fe-0d", "ovs_interfaceid": "8c8e51fe-0d15-4a27-8215-dc512b6816f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:36:44 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:36:44 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:36:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-350579303',display_name='tempest-ServerRescueNegativeTestJSON-server-350579303',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-350579303',id=14,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7aa6e9e70b4a49cb994440e868203c99',ramdisk_id='',reservation_id='r-3aiftumj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-700305152',owner_user_name='tempest-ServerRescueNegativeTestJSON-700305152-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:36:42Z,user_data=None,user_id='01b32889cd7442399a8bceaff3d05662',uuid=7e2615c1-b03e-4076-bcd9-3585fb11b8ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c8e51fe-0d15-4a27-8215-dc512b6816f5", "address": "fa:16:3e:3e:10:27", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e51fe-0d", "ovs_interfaceid": "8c8e51fe-0d15-4a27-8215-dc512b6816f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Converting VIF {"id": "8c8e51fe-0d15-4a27-8215-dc512b6816f5", "address": "fa:16:3e:3e:10:27", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e51fe-0d", "ovs_interfaceid": "8c8e51fe-0d15-4a27-8215-dc512b6816f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:10:27,bridge_name='br-int',has_traffic_filtering=True,id=8c8e51fe-0d15-4a27-8215-dc512b6816f5,network=Network(e1a83272-2e22-47dc-95ae-2ab9861c5925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8e51fe-0d') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.objects.instance [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e2615c1-b03e-4076-bcd9-3585fb11b8ac {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:36:44 user nova-compute[231753]:   <uuid>7e2615c1-b03e-4076-bcd9-3585fb11b8ac</uuid>
Jul 29 13:36:44 user nova-compute[231753]:   <name>instance-0000000e</name>
Jul 29 13:36:44 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:36:44 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:36:44 user nova-compute[231753]:   <metadata>
Jul 29 13:36:44 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:36:44 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:36:44 user nova-compute[231753]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-350579303</nova:name>
Jul 29 13:36:44 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:36:44</nova:creationTime>
Jul 29 13:36:44 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:36:44 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:36:44 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:36:44 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:36:44 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:36:44 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:36:44 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:36:44 user nova-compute[231753]:       <nova:owner>
Jul 29 13:36:44 user nova-compute[231753]:         <nova:user uuid="01b32889cd7442399a8bceaff3d05662">tempest-ServerRescueNegativeTestJSON-700305152-project-member</nova:user>
Jul 29 13:36:44 user nova-compute[231753]:         <nova:project uuid="7aa6e9e70b4a49cb994440e868203c99">tempest-ServerRescueNegativeTestJSON-700305152</nova:project>
Jul 29 13:36:44 user nova-compute[231753]:       </nova:owner>
Jul 29 13:36:44 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:36:44 user nova-compute[231753]:       <nova:ports>
Jul 29 13:36:44 user nova-compute[231753]:         <nova:port uuid="8c8e51fe-0d15-4a27-8215-dc512b6816f5">
Jul 29 13:36:44 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 29 13:36:44 user nova-compute[231753]:         </nova:port>
Jul 29 13:36:44 user nova-compute[231753]:       </nova:ports>
Jul 29 13:36:44 user nova-compute[231753]:     </nova:instance>
Jul 29 13:36:44 user nova-compute[231753]:   </metadata>
Jul 29 13:36:44 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:36:44 user nova-compute[231753]:     <system>
Jul 29 13:36:44 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:36:44 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:36:44 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:36:44 user nova-compute[231753]:       <entry name="serial">7e2615c1-b03e-4076-bcd9-3585fb11b8ac</entry>
Jul 29 13:36:44 user nova-compute[231753]:       <entry name="uuid">7e2615c1-b03e-4076-bcd9-3585fb11b8ac</entry>
Jul 29 13:36:44 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:36:44 user nova-compute[231753]:     </system>
Jul 29 13:36:44 user nova-compute[231753]:   </sysinfo>
Jul 29 13:36:44 user nova-compute[231753]:   <os>
Jul 29 13:36:44 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:36:44 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:36:44 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:36:44 user nova-compute[231753]:   </os>
Jul 29 13:36:44 user nova-compute[231753]:   <features>
Jul 29 13:36:44 user nova-compute[231753]:     <acpi/>
Jul 29 13:36:44 user nova-compute[231753]:     <apic/>
Jul 29 13:36:44 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:36:44 user nova-compute[231753]:   </features>
Jul 29 13:36:44 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:36:44 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:36:44 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:36:44 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:36:44 user nova-compute[231753]:   </clock>
Jul 29 13:36:44 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:36:44 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:36:44 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:36:44 user nova-compute[231753]:   </cpu>
Jul 29 13:36:44 user nova-compute[231753]:   <devices>
Jul 29 13:36:44 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:36:44 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:36:44 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk"/>
Jul 29 13:36:44 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:36:44 user nova-compute[231753]:     </disk>
Jul 29 13:36:44 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:36:44 user nova-compute[231753]:       <mac address="fa:16:3e:3e:10:27"/>
Jul 29 13:36:44 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:36:44 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:36:44 user nova-compute[231753]:       <target dev="tap8c8e51fe-0d"/>
Jul 29 13:36:44 user nova-compute[231753]:     </interface>
Jul 29 13:36:44 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:36:44 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/console.log" append="off"/>
Jul 29 13:36:44 user nova-compute[231753]:     </serial>
Jul 29 13:36:44 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:36:44 user nova-compute[231753]:     <video>
Jul 29 13:36:44 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:36:44 user nova-compute[231753]:     </video>
Jul 29 13:36:44 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:36:44 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:36:44 user nova-compute[231753]:     </rng>
Jul 29 13:36:44 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:36:44 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:36:44 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:36:44 user nova-compute[231753]:     </memballoon>
Jul 29 13:36:44 user nova-compute[231753]:   </devices>
Jul 29 13:36:44 user nova-compute[231753]: </domain>
Jul 29 13:36:44 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:36:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-350579303',display_name='tempest-ServerRescueNegativeTestJSON-server-350579303',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-350579303',id=14,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7aa6e9e70b4a49cb994440e868203c99',ramdisk_id='',reservation_id='r-3aiftumj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-700305152',owner_user_name='tempest-ServerRescueNegativeTestJSON-700305152-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:36:42Z,user_data=None,user_id='01b32889cd7442399a8bceaff3d05662',uuid=7e2615c1-b03e-4076-bcd9-3585fb11b8ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8c8e51fe-0d15-4a27-8215-dc512b6816f5", "address": "fa:16:3e:3e:10:27", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e51fe-0d", "ovs_interfaceid": "8c8e51fe-0d15-4a27-8215-dc512b6816f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Converting VIF {"id": "8c8e51fe-0d15-4a27-8215-dc512b6816f5", "address": "fa:16:3e:3e:10:27", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e51fe-0d", "ovs_interfaceid": "8c8e51fe-0d15-4a27-8215-dc512b6816f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3e:10:27,bridge_name='br-int',has_traffic_filtering=True,id=8c8e51fe-0d15-4a27-8215-dc512b6816f5,network=Network(e1a83272-2e22-47dc-95ae-2ab9861c5925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8e51fe-0d') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG os_vif [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:10:27,bridge_name='br-int',has_traffic_filtering=True,id=8c8e51fe-0d15-4a27-8215-dc512b6816f5,network=Network(e1a83272-2e22-47dc-95ae-2ab9861c5925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8e51fe-0d') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8c8e51fe-0d, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap8c8e51fe-0d, col_values=(('external_ids', {'iface-id': '8c8e51fe-0d15-4a27-8215-dc512b6816f5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3e:10:27', 'vm-uuid': '7e2615c1-b03e-4076-bcd9-3585fb11b8ac'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:44 user nova-compute[231753]: INFO os_vif [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3e:10:27,bridge_name='br-int',has_traffic_filtering=True,id=8c8e51fe-0d15-4a27-8215-dc512b6816f5,network=Network(e1a83272-2e22-47dc-95ae-2ab9861c5925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8e51fe-0d')
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.network.neutron [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Updating instance_info_cache with network_info: [{"id": "4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b", "address": "fa:16:3e:33:76:ce", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed7b5c5-f0", "ovs_interfaceid": "4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Releasing lock "refresh_cache-8ea52d41-7ec3-44d7-8421-133000ee887b" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.compute.manager [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Instance network_info: |[{"id": "4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b", "address": "fa:16:3e:33:76:ce", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed7b5c5-f0", "ovs_interfaceid": "4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-f4e92b26-c23a-44df-b557-1487e20a4d89 req-be54eee5-d0a2-4508-b614-ab8526410548 service nova] Acquired lock "refresh_cache-8ea52d41-7ec3-44d7-8421-133000ee887b" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.network.neutron [req-f4e92b26-c23a-44df-b557-1487e20a4d89 req-be54eee5-d0a2-4508-b614-ab8526410548 service nova] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Refreshing network info cache for port 4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Start _get_guest_xml network_info=[{"id": "4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b", "address": "fa:16:3e:33:76:ce", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed7b5c5-f0", "ovs_interfaceid": "4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:36:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] No VIF found with MAC fa:16:3e:3e:10:27, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:36:45 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:36:45 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:36:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:36:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1662901966',display_name='tempest-ServerRescueNegativeTestJSON-server-1662901966',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1662901966',id=15,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7aa6e9e70b4a49cb994440e868203c99',ramdisk_id='',reservation_id='r-bdwxrtct',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-700305152',owner_user_name='tempest-ServerRescueNegativeTestJSON-700305152-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:36:43Z,user_data=None,user_id='01b32889cd7442399a8bceaff3d05662',uuid=8ea52d41-7ec3-44d7-8421-133000ee887b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b", "address": "fa:16:3e:33:76:ce", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed7b5c5-f0", "ovs_interfaceid": "4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Converting VIF {"id": "4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b", "address": "fa:16:3e:33:76:ce", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed7b5c5-f0", "ovs_interfaceid": "4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:76:ce,bridge_name='br-int',has_traffic_filtering=True,id=4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b,network=Network(e1a83272-2e22-47dc-95ae-2ab9861c5925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed7b5c5-f0') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG nova.objects.instance [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ea52d41-7ec3-44d7-8421-133000ee887b {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:36:45 user nova-compute[231753]:   <uuid>8ea52d41-7ec3-44d7-8421-133000ee887b</uuid>
Jul 29 13:36:45 user nova-compute[231753]:   <name>instance-0000000f</name>
Jul 29 13:36:45 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:36:45 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:36:45 user nova-compute[231753]:   <metadata>
Jul 29 13:36:45 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:36:45 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:36:45 user nova-compute[231753]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1662901966</nova:name>
Jul 29 13:36:45 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:36:45</nova:creationTime>
Jul 29 13:36:45 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:36:45 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:36:45 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:36:45 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:36:45 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:36:45 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:36:45 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:36:45 user nova-compute[231753]:       <nova:owner>
Jul 29 13:36:45 user nova-compute[231753]:         <nova:user uuid="01b32889cd7442399a8bceaff3d05662">tempest-ServerRescueNegativeTestJSON-700305152-project-member</nova:user>
Jul 29 13:36:45 user nova-compute[231753]:         <nova:project uuid="7aa6e9e70b4a49cb994440e868203c99">tempest-ServerRescueNegativeTestJSON-700305152</nova:project>
Jul 29 13:36:45 user nova-compute[231753]:       </nova:owner>
Jul 29 13:36:45 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:36:45 user nova-compute[231753]:       <nova:ports>
Jul 29 13:36:45 user nova-compute[231753]:         <nova:port uuid="4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b">
Jul 29 13:36:45 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 29 13:36:45 user nova-compute[231753]:         </nova:port>
Jul 29 13:36:45 user nova-compute[231753]:       </nova:ports>
Jul 29 13:36:45 user nova-compute[231753]:     </nova:instance>
Jul 29 13:36:45 user nova-compute[231753]:   </metadata>
Jul 29 13:36:45 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:36:45 user nova-compute[231753]:     <system>
Jul 29 13:36:45 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:36:45 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:36:45 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:36:45 user nova-compute[231753]:       <entry name="serial">8ea52d41-7ec3-44d7-8421-133000ee887b</entry>
Jul 29 13:36:45 user nova-compute[231753]:       <entry name="uuid">8ea52d41-7ec3-44d7-8421-133000ee887b</entry>
Jul 29 13:36:45 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:36:45 user nova-compute[231753]:     </system>
Jul 29 13:36:45 user nova-compute[231753]:   </sysinfo>
Jul 29 13:36:45 user nova-compute[231753]:   <os>
Jul 29 13:36:45 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:36:45 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:36:45 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:36:45 user nova-compute[231753]:   </os>
Jul 29 13:36:45 user nova-compute[231753]:   <features>
Jul 29 13:36:45 user nova-compute[231753]:     <acpi/>
Jul 29 13:36:45 user nova-compute[231753]:     <apic/>
Jul 29 13:36:45 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:36:45 user nova-compute[231753]:   </features>
Jul 29 13:36:45 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:36:45 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:36:45 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:36:45 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:36:45 user nova-compute[231753]:   </clock>
Jul 29 13:36:45 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:36:45 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:36:45 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:36:45 user nova-compute[231753]:   </cpu>
Jul 29 13:36:45 user nova-compute[231753]:   <devices>
Jul 29 13:36:45 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:36:45 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:36:45 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk"/>
Jul 29 13:36:45 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:36:45 user nova-compute[231753]:     </disk>
Jul 29 13:36:45 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:36:45 user nova-compute[231753]:       <mac address="fa:16:3e:33:76:ce"/>
Jul 29 13:36:45 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:36:45 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:36:45 user nova-compute[231753]:       <target dev="tap4ed7b5c5-f0"/>
Jul 29 13:36:45 user nova-compute[231753]:     </interface>
Jul 29 13:36:45 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:36:45 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/console.log" append="off"/>
Jul 29 13:36:45 user nova-compute[231753]:     </serial>
Jul 29 13:36:45 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:36:45 user nova-compute[231753]:     <video>
Jul 29 13:36:45 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:36:45 user nova-compute[231753]:     </video>
Jul 29 13:36:45 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:36:45 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:36:45 user nova-compute[231753]:     </rng>
Jul 29 13:36:45 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:36:45 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:36:45 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:36:45 user nova-compute[231753]:     </memballoon>
Jul 29 13:36:45 user nova-compute[231753]:   </devices>
Jul 29 13:36:45 user nova-compute[231753]: </domain>
Jul 29 13:36:45 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:36:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1662901966',display_name='tempest-ServerRescueNegativeTestJSON-server-1662901966',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1662901966',id=15,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7aa6e9e70b4a49cb994440e868203c99',ramdisk_id='',reservation_id='r-bdwxrtct',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-700305152',owner_user_name='tempest-ServerRescueNegativeTestJSON-700305152-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:36:43Z,user_data=None,user_id='01b32889cd7442399a8bceaff3d05662',uuid=8ea52d41-7ec3-44d7-8421-133000ee887b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b", "address": "fa:16:3e:33:76:ce", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed7b5c5-f0", "ovs_interfaceid": "4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Converting VIF {"id": "4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b", "address": "fa:16:3e:33:76:ce", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed7b5c5-f0", "ovs_interfaceid": "4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:76:ce,bridge_name='br-int',has_traffic_filtering=True,id=4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b,network=Network(e1a83272-2e22-47dc-95ae-2ab9861c5925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed7b5c5-f0') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG os_vif [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:76:ce,bridge_name='br-int',has_traffic_filtering=True,id=4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b,network=Network(e1a83272-2e22-47dc-95ae-2ab9861c5925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed7b5c5-f0') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4ed7b5c5-f0, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4ed7b5c5-f0, col_values=(('external_ids', {'iface-id': '4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:76:ce', 'vm-uuid': '8ea52d41-7ec3-44d7-8421-133000ee887b'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:45 user nova-compute[231753]: INFO os_vif [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:76:ce,bridge_name='br-int',has_traffic_filtering=True,id=4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b,network=Network(e1a83272-2e22-47dc-95ae-2ab9861c5925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed7b5c5-f0')
Jul 29 13:36:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] No VIF found with MAC fa:16:3e:33:76:ce, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG nova.network.neutron [req-797eaeb7-1a29-4e83-8d9e-070ade714f95 req-a82c6f88-68fc-4b8b-93df-73b7dd636ef1 service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Updated VIF entry in instance network info cache for port 8c8e51fe-0d15-4a27-8215-dc512b6816f5. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG nova.network.neutron [req-797eaeb7-1a29-4e83-8d9e-070ade714f95 req-a82c6f88-68fc-4b8b-93df-73b7dd636ef1 service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Updating instance_info_cache with network_info: [{"id": "8c8e51fe-0d15-4a27-8215-dc512b6816f5", "address": "fa:16:3e:3e:10:27", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e51fe-0d", "ovs_interfaceid": "8c8e51fe-0d15-4a27-8215-dc512b6816f5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-797eaeb7-1a29-4e83-8d9e-070ade714f95 req-a82c6f88-68fc-4b8b-93df-73b7dd636ef1 service nova] Releasing lock "refresh_cache-7e2615c1-b03e-4076-bcd9-3585fb11b8ac" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG nova.network.neutron [req-f4e92b26-c23a-44df-b557-1487e20a4d89 req-be54eee5-d0a2-4508-b614-ab8526410548 service nova] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Updated VIF entry in instance network info cache for port 4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG nova.network.neutron [req-f4e92b26-c23a-44df-b557-1487e20a4d89 req-be54eee5-d0a2-4508-b614-ab8526410548 service nova] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Updating instance_info_cache with network_info: [{"id": "4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b", "address": "fa:16:3e:33:76:ce", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed7b5c5-f0", "ovs_interfaceid": "4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:36:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-f4e92b26-c23a-44df-b557-1487e20a4d89 req-be54eee5-d0a2-4508-b614-ab8526410548 service nova] Releasing lock "refresh_cache-8ea52d41-7ec3-44d7-8421-133000ee887b" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:36:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ece2053d-5d6d-4901-8b02-b891ee6f3864 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Acquiring lock "8822efe3-e17a-4511-b75f-37f6a83616aa" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ece2053d-5d6d-4901-8b02-b891ee6f3864 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lock "8822efe3-e17a-4511-b75f-37f6a83616aa" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ece2053d-5d6d-4901-8b02-b891ee6f3864 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Acquiring lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ece2053d-5d6d-4901-8b02-b891ee6f3864 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ece2053d-5d6d-4901-8b02-b891ee6f3864 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:47 user nova-compute[231753]: INFO nova.compute.manager [None req-ece2053d-5d6d-4901-8b02-b891ee6f3864 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Terminating instance
Jul 29 13:36:47 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ece2053d-5d6d-4901-8b02-b891ee6f3864 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:36:47 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:47 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:47 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:47 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:47 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:47 user nova-compute[231753]: DEBUG nova.compute.manager [req-933f481e-4b80-466a-84c2-d38a7f6f8814 req-bc590fd8-b867-4249-84ec-a15a382c51d9 service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Received event network-vif-unplugged-7881fb42-caac-4254-a8ef-16b49c754bf9 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-933f481e-4b80-466a-84c2-d38a7f6f8814 req-bc590fd8-b867-4249-84ec-a15a382c51d9 service nova] Acquiring lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-933f481e-4b80-466a-84c2-d38a7f6f8814 req-bc590fd8-b867-4249-84ec-a15a382c51d9 service nova] Lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-933f481e-4b80-466a-84c2-d38a7f6f8814 req-bc590fd8-b867-4249-84ec-a15a382c51d9 service nova] Lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:47 user nova-compute[231753]: DEBUG nova.compute.manager [req-933f481e-4b80-466a-84c2-d38a7f6f8814 req-bc590fd8-b867-4249-84ec-a15a382c51d9 service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] No waiting events found dispatching network-vif-unplugged-7881fb42-caac-4254-a8ef-16b49c754bf9 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:36:47 user nova-compute[231753]: DEBUG nova.compute.manager [req-933f481e-4b80-466a-84c2-d38a7f6f8814 req-bc590fd8-b867-4249-84ec-a15a382c51d9 service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Received event network-vif-unplugged-7881fb42-caac-4254-a8ef-16b49c754bf9 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:36:47 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:47 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:47 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:47 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:48 user nova-compute[231753]: DEBUG nova.compute.manager [req-55c77787-a71f-413d-912d-44dbb9f5ae84 req-bbd6d50c-adfd-47ac-82ea-b022772aebff service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Received event network-vif-plugged-8c8e51fe-0d15-4a27-8215-dc512b6816f5 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-55c77787-a71f-413d-912d-44dbb9f5ae84 req-bbd6d50c-adfd-47ac-82ea-b022772aebff service nova] Acquiring lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-55c77787-a71f-413d-912d-44dbb9f5ae84 req-bbd6d50c-adfd-47ac-82ea-b022772aebff service nova] Lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-55c77787-a71f-413d-912d-44dbb9f5ae84 req-bbd6d50c-adfd-47ac-82ea-b022772aebff service nova] Lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:48 user nova-compute[231753]: DEBUG nova.compute.manager [req-55c77787-a71f-413d-912d-44dbb9f5ae84 req-bbd6d50c-adfd-47ac-82ea-b022772aebff service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] No waiting events found dispatching network-vif-plugged-8c8e51fe-0d15-4a27-8215-dc512b6816f5 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:36:48 user nova-compute[231753]: WARNING nova.compute.manager [req-55c77787-a71f-413d-912d-44dbb9f5ae84 req-bbd6d50c-adfd-47ac-82ea-b022772aebff service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Received unexpected event network-vif-plugged-8c8e51fe-0d15-4a27-8215-dc512b6816f5 for instance with vm_state building and task_state spawning.
Jul 29 13:36:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:48 user nova-compute[231753]: DEBUG nova.compute.manager [req-c2ee7fd2-b7cd-46f7-a5c4-1738610bb672 req-972d5389-6670-410d-a614-00df5acf95e2 service nova] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Received event network-vif-plugged-4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c2ee7fd2-b7cd-46f7-a5c4-1738610bb672 req-972d5389-6670-410d-a614-00df5acf95e2 service nova] Acquiring lock "8ea52d41-7ec3-44d7-8421-133000ee887b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c2ee7fd2-b7cd-46f7-a5c4-1738610bb672 req-972d5389-6670-410d-a614-00df5acf95e2 service nova] Lock "8ea52d41-7ec3-44d7-8421-133000ee887b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c2ee7fd2-b7cd-46f7-a5c4-1738610bb672 req-972d5389-6670-410d-a614-00df5acf95e2 service nova] Lock "8ea52d41-7ec3-44d7-8421-133000ee887b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:48 user nova-compute[231753]: DEBUG nova.compute.manager [req-c2ee7fd2-b7cd-46f7-a5c4-1738610bb672 req-972d5389-6670-410d-a614-00df5acf95e2 service nova] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] No waiting events found dispatching network-vif-plugged-4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:36:48 user nova-compute[231753]: WARNING nova.compute.manager [req-c2ee7fd2-b7cd-46f7-a5c4-1738610bb672 req-972d5389-6670-410d-a614-00df5acf95e2 service nova] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Received unexpected event network-vif-plugged-4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b for instance with vm_state building and task_state spawning.
Jul 29 13:36:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:49 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Instance destroyed successfully.
Jul 29 13:36:49 user nova-compute[231753]: DEBUG nova.objects.instance [None req-ece2053d-5d6d-4901-8b02-b891ee6f3864 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lazy-loading 'resources' on Instance uuid 8822efe3-e17a-4511-b75f-37f6a83616aa {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:36:49 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-ece2053d-5d6d-4901-8b02-b891ee6f3864 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:33:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1148074335',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-1148074335',id=7,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP0HnOcJSL5x0Tr4fe2VLkk8m+fQM2IcJ8g4N204I22r+/diZGGnEBXWHFX48Vhdy9jagxGQAFJRzYCdQHRK29zwqPTQRGmMCigLgYVfxtAv5zkyNXnhJGzjicINXHWlNA==',key_name='tempest-keypair-833006828',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:33:57Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='19ab44f715024188b10545aac4cbb675',ramdisk_id='',reservation_id='r-z1bc9xqi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1208246720',owner_user_name='tempest-TaggedAttachmentsTest-1208246720-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:33:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8de5c966bbb948499c560ea5ab63a960',uuid=8822efe3-e17a-4511-b75f-37f6a83616aa,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7881fb42-caac-4254-a8ef-16b49c754bf9", "address": "fa:16:3e:3b:15:58", "network": {"id": "12eb887a-c8b0-4fa9-ad24-8dbd6632aa5b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1203369018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19ab44f715024188b10545aac4cbb675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7881fb42-ca", "ovs_interfaceid": "7881fb42-caac-4254-a8ef-16b49c754bf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:36:49 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-ece2053d-5d6d-4901-8b02-b891ee6f3864 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Converting VIF {"id": "7881fb42-caac-4254-a8ef-16b49c754bf9", "address": "fa:16:3e:3b:15:58", "network": {"id": "12eb887a-c8b0-4fa9-ad24-8dbd6632aa5b", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-1203369018-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.59", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "19ab44f715024188b10545aac4cbb675", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7881fb42-ca", "ovs_interfaceid": "7881fb42-caac-4254-a8ef-16b49c754bf9", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:36:49 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-ece2053d-5d6d-4901-8b02-b891ee6f3864 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3b:15:58,bridge_name='br-int',has_traffic_filtering=True,id=7881fb42-caac-4254-a8ef-16b49c754bf9,network=Network(12eb887a-c8b0-4fa9-ad24-8dbd6632aa5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7881fb42-ca') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:36:49 user nova-compute[231753]: DEBUG os_vif [None req-ece2053d-5d6d-4901-8b02-b891ee6f3864 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:15:58,bridge_name='br-int',has_traffic_filtering=True,id=7881fb42-caac-4254-a8ef-16b49c754bf9,network=Network(12eb887a-c8b0-4fa9-ad24-8dbd6632aa5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7881fb42-ca') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:36:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7881fb42-ca, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:36:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:36:49 user nova-compute[231753]: INFO os_vif [None req-ece2053d-5d6d-4901-8b02-b891ee6f3864 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3b:15:58,bridge_name='br-int',has_traffic_filtering=True,id=7881fb42-caac-4254-a8ef-16b49c754bf9,network=Network(12eb887a-c8b0-4fa9-ad24-8dbd6632aa5b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7881fb42-ca')
Jul 29 13:36:49 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-ece2053d-5d6d-4901-8b02-b891ee6f3864 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Deleting instance files /opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa_del
Jul 29 13:36:49 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-ece2053d-5d6d-4901-8b02-b891ee6f3864 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Deletion of /opt/stack/data/nova/instances/8822efe3-e17a-4511-b75f-37f6a83616aa_del complete
Jul 29 13:36:49 user nova-compute[231753]: INFO nova.compute.manager [None req-ece2053d-5d6d-4901-8b02-b891ee6f3864 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Took 2.44 seconds to destroy the instance on the hypervisor.
Jul 29 13:36:49 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-ece2053d-5d6d-4901-8b02-b891ee6f3864 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:36:49 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:36:49 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:36:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:49 user nova-compute[231753]: DEBUG nova.compute.manager [req-d003da62-b079-423d-b8cc-f83375417480 req-f09505cb-561d-4ef1-a646-6b986f413026 service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Received event network-vif-plugged-7881fb42-caac-4254-a8ef-16b49c754bf9 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d003da62-b079-423d-b8cc-f83375417480 req-f09505cb-561d-4ef1-a646-6b986f413026 service nova] Acquiring lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d003da62-b079-423d-b8cc-f83375417480 req-f09505cb-561d-4ef1-a646-6b986f413026 service nova] Lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d003da62-b079-423d-b8cc-f83375417480 req-f09505cb-561d-4ef1-a646-6b986f413026 service nova] Lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:49 user nova-compute[231753]: DEBUG nova.compute.manager [req-d003da62-b079-423d-b8cc-f83375417480 req-f09505cb-561d-4ef1-a646-6b986f413026 service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] No waiting events found dispatching network-vif-plugged-7881fb42-caac-4254-a8ef-16b49c754bf9 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:36:49 user nova-compute[231753]: WARNING nova.compute.manager [req-d003da62-b079-423d-b8cc-f83375417480 req-f09505cb-561d-4ef1-a646-6b986f413026 service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Received unexpected event network-vif-plugged-7881fb42-caac-4254-a8ef-16b49c754bf9 for instance with vm_state active and task_state deleting.
Jul 29 13:36:49 user nova-compute[231753]: DEBUG nova.compute.manager [req-d003da62-b079-423d-b8cc-f83375417480 req-f09505cb-561d-4ef1-a646-6b986f413026 service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Received event network-vif-plugged-7881fb42-caac-4254-a8ef-16b49c754bf9 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d003da62-b079-423d-b8cc-f83375417480 req-f09505cb-561d-4ef1-a646-6b986f413026 service nova] Acquiring lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d003da62-b079-423d-b8cc-f83375417480 req-f09505cb-561d-4ef1-a646-6b986f413026 service nova] Lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.011s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d003da62-b079-423d-b8cc-f83375417480 req-f09505cb-561d-4ef1-a646-6b986f413026 service nova] Lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:49 user nova-compute[231753]: DEBUG nova.compute.manager [req-d003da62-b079-423d-b8cc-f83375417480 req-f09505cb-561d-4ef1-a646-6b986f413026 service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] No waiting events found dispatching network-vif-plugged-7881fb42-caac-4254-a8ef-16b49c754bf9 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:36:49 user nova-compute[231753]: WARNING nova.compute.manager [req-d003da62-b079-423d-b8cc-f83375417480 req-f09505cb-561d-4ef1-a646-6b986f413026 service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Received unexpected event network-vif-plugged-7881fb42-caac-4254-a8ef-16b49c754bf9 for instance with vm_state active and task_state deleting.
Jul 29 13:36:49 user nova-compute[231753]: DEBUG nova.compute.manager [req-d003da62-b079-423d-b8cc-f83375417480 req-f09505cb-561d-4ef1-a646-6b986f413026 service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Received event network-vif-plugged-7881fb42-caac-4254-a8ef-16b49c754bf9 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d003da62-b079-423d-b8cc-f83375417480 req-f09505cb-561d-4ef1-a646-6b986f413026 service nova] Acquiring lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d003da62-b079-423d-b8cc-f83375417480 req-f09505cb-561d-4ef1-a646-6b986f413026 service nova] Lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d003da62-b079-423d-b8cc-f83375417480 req-f09505cb-561d-4ef1-a646-6b986f413026 service nova] Lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:49 user nova-compute[231753]: DEBUG nova.compute.manager [req-d003da62-b079-423d-b8cc-f83375417480 req-f09505cb-561d-4ef1-a646-6b986f413026 service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] No waiting events found dispatching network-vif-plugged-7881fb42-caac-4254-a8ef-16b49c754bf9 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:36:49 user nova-compute[231753]: WARNING nova.compute.manager [req-d003da62-b079-423d-b8cc-f83375417480 req-f09505cb-561d-4ef1-a646-6b986f413026 service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Received unexpected event network-vif-plugged-7881fb42-caac-4254-a8ef-16b49c754bf9 for instance with vm_state active and task_state deleting.
Jul 29 13:36:49 user nova-compute[231753]: DEBUG nova.compute.manager [req-d003da62-b079-423d-b8cc-f83375417480 req-f09505cb-561d-4ef1-a646-6b986f413026 service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Received event network-vif-unplugged-7881fb42-caac-4254-a8ef-16b49c754bf9 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d003da62-b079-423d-b8cc-f83375417480 req-f09505cb-561d-4ef1-a646-6b986f413026 service nova] Acquiring lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d003da62-b079-423d-b8cc-f83375417480 req-f09505cb-561d-4ef1-a646-6b986f413026 service nova] Lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d003da62-b079-423d-b8cc-f83375417480 req-f09505cb-561d-4ef1-a646-6b986f413026 service nova] Lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:49 user nova-compute[231753]: DEBUG nova.compute.manager [req-d003da62-b079-423d-b8cc-f83375417480 req-f09505cb-561d-4ef1-a646-6b986f413026 service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] No waiting events found dispatching network-vif-unplugged-7881fb42-caac-4254-a8ef-16b49c754bf9 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:36:49 user nova-compute[231753]: DEBUG nova.compute.manager [req-d003da62-b079-423d-b8cc-f83375417480 req-f09505cb-561d-4ef1-a646-6b986f413026 service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Received event network-vif-unplugged-7881fb42-caac-4254-a8ef-16b49c754bf9 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:36:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:50 user nova-compute[231753]: DEBUG nova.compute.manager [req-a0d23fa9-200b-4e57-932e-36727237af58 req-31f4d73a-5007-4926-ade2-cb8b2daffb3a service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Received event network-vif-plugged-8c8e51fe-0d15-4a27-8215-dc512b6816f5 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a0d23fa9-200b-4e57-932e-36727237af58 req-31f4d73a-5007-4926-ade2-cb8b2daffb3a service nova] Acquiring lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a0d23fa9-200b-4e57-932e-36727237af58 req-31f4d73a-5007-4926-ade2-cb8b2daffb3a service nova] Lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a0d23fa9-200b-4e57-932e-36727237af58 req-31f4d73a-5007-4926-ade2-cb8b2daffb3a service nova] Lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:50 user nova-compute[231753]: DEBUG nova.compute.manager [req-a0d23fa9-200b-4e57-932e-36727237af58 req-31f4d73a-5007-4926-ade2-cb8b2daffb3a service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] No waiting events found dispatching network-vif-plugged-8c8e51fe-0d15-4a27-8215-dc512b6816f5 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:36:50 user nova-compute[231753]: WARNING nova.compute.manager [req-a0d23fa9-200b-4e57-932e-36727237af58 req-31f4d73a-5007-4926-ade2-cb8b2daffb3a service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Received unexpected event network-vif-plugged-8c8e51fe-0d15-4a27-8215-dc512b6816f5 for instance with vm_state building and task_state spawning.
Jul 29 13:36:50 user nova-compute[231753]: DEBUG nova.compute.manager [req-7eb4cb56-967b-4418-98f3-e2ebc71d4164 req-2b725d98-fcca-47a5-9fb6-5a8483b4b11a service nova] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Received event network-vif-plugged-4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7eb4cb56-967b-4418-98f3-e2ebc71d4164 req-2b725d98-fcca-47a5-9fb6-5a8483b4b11a service nova] Acquiring lock "8ea52d41-7ec3-44d7-8421-133000ee887b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7eb4cb56-967b-4418-98f3-e2ebc71d4164 req-2b725d98-fcca-47a5-9fb6-5a8483b4b11a service nova] Lock "8ea52d41-7ec3-44d7-8421-133000ee887b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7eb4cb56-967b-4418-98f3-e2ebc71d4164 req-2b725d98-fcca-47a5-9fb6-5a8483b4b11a service nova] Lock "8ea52d41-7ec3-44d7-8421-133000ee887b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:50 user nova-compute[231753]: DEBUG nova.compute.manager [req-7eb4cb56-967b-4418-98f3-e2ebc71d4164 req-2b725d98-fcca-47a5-9fb6-5a8483b4b11a service nova] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] No waiting events found dispatching network-vif-plugged-4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:36:50 user nova-compute[231753]: WARNING nova.compute.manager [req-7eb4cb56-967b-4418-98f3-e2ebc71d4164 req-2b725d98-fcca-47a5-9fb6-5a8483b4b11a service nova] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Received unexpected event network-vif-plugged-4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b for instance with vm_state building and task_state spawning.
Jul 29 13:36:50 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:36:50 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Took 1.45 seconds to deallocate network for instance.
Jul 29 13:36:51 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ece2053d-5d6d-4901-8b02-b891ee6f3864 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:51 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ece2053d-5d6d-4901-8b02-b891ee6f3864 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:51 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637811.4233198, 7e2615c1-b03e-4076-bcd9-3585fb11b8ac => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:36:51 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] VM Resumed (Lifecycle Event)
Jul 29 13:36:51 user nova-compute[231753]: DEBUG nova.compute.manager [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:36:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:36:51 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-ece2053d-5d6d-4901-8b02-b891ee6f3864 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:36:51 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Instance spawned successfully.
Jul 29 13:36:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:36:51 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:36:51 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-ece2053d-5d6d-4901-8b02-b891ee6f3864 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:36:51 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:36:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:36:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:36:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:36:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:36:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:36:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:36:51 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:36:51 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637811.4252563, 7e2615c1-b03e-4076-bcd9-3585fb11b8ac => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:36:51 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] VM Started (Lifecycle Event)
Jul 29 13:36:51 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ece2053d-5d6d-4901-8b02-b891ee6f3864 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.485s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:51 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:36:51 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:36:51 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-ece2053d-5d6d-4901-8b02-b891ee6f3864 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Deleted allocations for instance 8822efe3-e17a-4511-b75f-37f6a83616aa
Jul 29 13:36:51 user nova-compute[231753]: INFO nova.compute.manager [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Took 9.40 seconds to spawn the instance on the hypervisor.
Jul 29 13:36:51 user nova-compute[231753]: DEBUG nova.compute.manager [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:36:51 user nova-compute[231753]: DEBUG nova.compute.manager [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:36:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:36:51 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:36:51 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637811.5818362, 8ea52d41-7ec3-44d7-8421-133000ee887b => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:36:51 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] VM Resumed (Lifecycle Event)
Jul 29 13:36:51 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:36:51 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Instance spawned successfully.
Jul 29 13:36:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:36:51 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:36:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:36:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:36:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:36:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:36:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:36:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:36:51 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:36:51 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637811.5844827, 8ea52d41-7ec3-44d7-8421-133000ee887b => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:36:51 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] VM Started (Lifecycle Event)
Jul 29 13:36:51 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:36:51 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:36:51 user nova-compute[231753]: INFO nova.compute.manager [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Took 10.56 seconds to build instance.
Jul 29 13:36:51 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:36:51 user nova-compute[231753]: DEBUG nova.compute.manager [req-633ee106-fe86-48d6-8fbe-57d70f39946b req-bbbff72b-5dac-44fc-b29d-0d0571d6adcf service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Received event network-vif-plugged-7881fb42-caac-4254-a8ef-16b49c754bf9 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:51 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-633ee106-fe86-48d6-8fbe-57d70f39946b req-bbbff72b-5dac-44fc-b29d-0d0571d6adcf service nova] Acquiring lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:51 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-633ee106-fe86-48d6-8fbe-57d70f39946b req-bbbff72b-5dac-44fc-b29d-0d0571d6adcf service nova] Lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:51 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-633ee106-fe86-48d6-8fbe-57d70f39946b req-bbbff72b-5dac-44fc-b29d-0d0571d6adcf service nova] Lock "8822efe3-e17a-4511-b75f-37f6a83616aa-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:51 user nova-compute[231753]: DEBUG nova.compute.manager [req-633ee106-fe86-48d6-8fbe-57d70f39946b req-bbbff72b-5dac-44fc-b29d-0d0571d6adcf service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] No waiting events found dispatching network-vif-plugged-7881fb42-caac-4254-a8ef-16b49c754bf9 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:36:51 user nova-compute[231753]: WARNING nova.compute.manager [req-633ee106-fe86-48d6-8fbe-57d70f39946b req-bbbff72b-5dac-44fc-b29d-0d0571d6adcf service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Received unexpected event network-vif-plugged-7881fb42-caac-4254-a8ef-16b49c754bf9 for instance with vm_state deleted and task_state None.
Jul 29 13:36:51 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b2e035cf-63f5-4974-a48c-9678c42a41b6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.696s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:51 user nova-compute[231753]: INFO nova.compute.manager [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Took 8.66 seconds to spawn the instance on the hypervisor.
Jul 29 13:36:51 user nova-compute[231753]: DEBUG nova.compute.manager [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:36:51 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ece2053d-5d6d-4901-8b02-b891ee6f3864 tempest-TaggedAttachmentsTest-1208246720 tempest-TaggedAttachmentsTest-1208246720-project-member] Lock "8822efe3-e17a-4511-b75f-37f6a83616aa" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.781s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:51 user nova-compute[231753]: INFO nova.compute.manager [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Took 9.89 seconds to build instance.
Jul 29 13:36:51 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2ab92348-8b1a-4da5-b3e3-6f2ed82e3296 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "8ea52d41-7ec3-44d7-8421-133000ee887b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 10.027s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:52 user nova-compute[231753]: DEBUG nova.compute.manager [req-9610e6c5-0156-4e0a-b671-432369b07d7f req-508fb5d0-6bce-4d70-b524-03e126eefbe1 service nova] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Received event network-vif-deleted-7881fb42-caac-4254-a8ef-16b49c754bf9 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:36:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:57 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Acquiring lock "63fad324-aac2-4d60-b4ce-a32a5736657d" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:58 user nova-compute[231753]: DEBUG nova.objects.instance [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lazy-loading 'flavor' on Instance uuid 63fad324-aac2-4d60-b4ce-a32a5736657d {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:36:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.064s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:36:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Acquiring lock "63fad324-aac2-4d60-b4ce-a32a5736657d" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:36:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:36:58 user nova-compute[231753]: INFO nova.compute.manager [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Attaching volume a62778d4-32b0-41ef-b7df-716d38fbcba4 to /dev/vdb
Jul 29 13:36:58 user nova-compute[231753]: DEBUG os_brick.utils [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:36:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4676a25-d6c3-4c67-b933-28d6f255066d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b66f42a-bd04-4e23-bb4f-ac8fac24df60]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:36:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28dc415-9924-4151-aa92-bceb460737d5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6987b567-ef02-42a2-b2dd-55624dfbb31e]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:36:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:36:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:36:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:36:58 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:36:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b2a17b-e602-4c81-8a0d-6cdb8ccf29be]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:36:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:36:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:36:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:36:58 user nova-compute[231753]: DEBUG os_brick.utils [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] <== get_connector_properties: return (153ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:36:58 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Updating existing volume attachment record: 29cb017c-bf62-4703-b534-d11aaf15ee3f {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:36:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:36:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:01 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-dddd7b3f-2585-47c3-8458-1fd8e251b0a3 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Acquiring lock "3d25aef1-5ef1-42a9-be32-1e26077f7b74" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-dddd7b3f-2585-47c3-8458-1fd8e251b0a3 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lock "3d25aef1-5ef1-42a9-be32-1e26077f7b74" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-dddd7b3f-2585-47c3-8458-1fd8e251b0a3 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Acquiring lock "3d25aef1-5ef1-42a9-be32-1e26077f7b74-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-dddd7b3f-2585-47c3-8458-1fd8e251b0a3 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lock "3d25aef1-5ef1-42a9-be32-1e26077f7b74-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-dddd7b3f-2585-47c3-8458-1fd8e251b0a3 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lock "3d25aef1-5ef1-42a9-be32-1e26077f7b74-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:02 user nova-compute[231753]: INFO nova.compute.manager [None req-dddd7b3f-2585-47c3-8458-1fd8e251b0a3 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Terminating instance
Jul 29 13:37:02 user nova-compute[231753]: DEBUG nova.compute.manager [None req-dddd7b3f-2585-47c3-8458-1fd8e251b0a3 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:37:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:03 user nova-compute[231753]: DEBUG nova.compute.manager [req-13f48579-4483-47ac-920c-6f83c76b9d77 req-8d993650-3bee-4da9-adf3-3e4a5b3f1bc4 service nova] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Received event network-vif-unplugged-353d55fe-9e9d-49c7-81ef-d210995d1190 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:37:03 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-13f48579-4483-47ac-920c-6f83c76b9d77 req-8d993650-3bee-4da9-adf3-3e4a5b3f1bc4 service nova] Acquiring lock "3d25aef1-5ef1-42a9-be32-1e26077f7b74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:03 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-13f48579-4483-47ac-920c-6f83c76b9d77 req-8d993650-3bee-4da9-adf3-3e4a5b3f1bc4 service nova] Lock "3d25aef1-5ef1-42a9-be32-1e26077f7b74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:03 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-13f48579-4483-47ac-920c-6f83c76b9d77 req-8d993650-3bee-4da9-adf3-3e4a5b3f1bc4 service nova] Lock "3d25aef1-5ef1-42a9-be32-1e26077f7b74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:03 user nova-compute[231753]: DEBUG nova.compute.manager [req-13f48579-4483-47ac-920c-6f83c76b9d77 req-8d993650-3bee-4da9-adf3-3e4a5b3f1bc4 service nova] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] No waiting events found dispatching network-vif-unplugged-353d55fe-9e9d-49c7-81ef-d210995d1190 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:37:03 user nova-compute[231753]: DEBUG nova.compute.manager [req-13f48579-4483-47ac-920c-6f83c76b9d77 req-8d993650-3bee-4da9-adf3-3e4a5b3f1bc4 service nova] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Received event network-vif-unplugged-353d55fe-9e9d-49c7-81ef-d210995d1190 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:37:03 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:03 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:03 user nova-compute[231753]: DEBUG nova.objects.instance [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lazy-loading 'flavor' on Instance uuid 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:37:03 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.090s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:03 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Instance destroyed successfully.
Jul 29 13:37:03 user nova-compute[231753]: DEBUG nova.objects.instance [None req-dddd7b3f-2585-47c3-8458-1fd8e251b0a3 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lazy-loading 'resources' on Instance uuid 3d25aef1-5ef1-42a9-be32-1e26077f7b74 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:37:03 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-dddd7b3f-2585-47c3-8458-1fd8e251b0a3 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:35:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1229995759',display_name='tempest-ServersNegativeTestJSON-server-1229995759',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1229995759',id=11,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:35:20Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35a6a49685124aaf93030ca59169dde5',ramdisk_id='',reservation_id='r-is0sptb9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1215130688',owner_user_name='tempest-ServersNegativeTestJSON-1215130688-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:35:21Z,user_data=None,user_id='0f99f3a73b4e4831b25e63b2ef8362c9',uuid=3d25aef1-5ef1-42a9-be32-1e26077f7b74,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "353d55fe-9e9d-49c7-81ef-d210995d1190", "address": "fa:16:3e:82:50:33", "network": {"id": "092d27a5-871f-4865-ac97-fbb701a5c807", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-907499567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a6a49685124aaf93030ca59169dde5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap353d55fe-9e", "ovs_interfaceid": "353d55fe-9e9d-49c7-81ef-d210995d1190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:37:03 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-dddd7b3f-2585-47c3-8458-1fd8e251b0a3 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Converting VIF {"id": "353d55fe-9e9d-49c7-81ef-d210995d1190", "address": "fa:16:3e:82:50:33", "network": {"id": "092d27a5-871f-4865-ac97-fbb701a5c807", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-907499567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a6a49685124aaf93030ca59169dde5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap353d55fe-9e", "ovs_interfaceid": "353d55fe-9e9d-49c7-81ef-d210995d1190", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:37:03 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-dddd7b3f-2585-47c3-8458-1fd8e251b0a3 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:82:50:33,bridge_name='br-int',has_traffic_filtering=True,id=353d55fe-9e9d-49c7-81ef-d210995d1190,network=Network(092d27a5-871f-4865-ac97-fbb701a5c807),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap353d55fe-9e') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:37:03 user nova-compute[231753]: DEBUG os_vif [None req-dddd7b3f-2585-47c3-8458-1fd8e251b0a3 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:50:33,bridge_name='br-int',has_traffic_filtering=True,id=353d55fe-9e9d-49c7-81ef-d210995d1190,network=Network(092d27a5-871f-4865-ac97-fbb701a5c807),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap353d55fe-9e') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:37:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap353d55fe-9e, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:37:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:03 user nova-compute[231753]: INFO os_vif [None req-dddd7b3f-2585-47c3-8458-1fd8e251b0a3 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:82:50:33,bridge_name='br-int',has_traffic_filtering=True,id=353d55fe-9e9d-49c7-81ef-d210995d1190,network=Network(092d27a5-871f-4865-ac97-fbb701a5c807),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap353d55fe-9e')
Jul 29 13:37:03 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-dddd7b3f-2585-47c3-8458-1fd8e251b0a3 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Deleting instance files /opt/stack/data/nova/instances/3d25aef1-5ef1-42a9-be32-1e26077f7b74_del
Jul 29 13:37:03 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-dddd7b3f-2585-47c3-8458-1fd8e251b0a3 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Deletion of /opt/stack/data/nova/instances/3d25aef1-5ef1-42a9-be32-1e26077f7b74_del complete
Jul 29 13:37:03 user nova-compute[231753]: INFO nova.compute.manager [None req-dddd7b3f-2585-47c3-8458-1fd8e251b0a3 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Took 1.04 seconds to destroy the instance on the hypervisor.
Jul 29 13:37:03 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-dddd7b3f-2585-47c3-8458-1fd8e251b0a3 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:37:03 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:37:03 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:37:03 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:03 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:03 user nova-compute[231753]: INFO nova.compute.manager [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Attaching volume ff96d4b8-97db-4db7-821f-a3a64b4be6f7 to /dev/vdb
Jul 29 13:37:03 user nova-compute[231753]: DEBUG os_brick.utils [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:37:03 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:03 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:03 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5557bdaf-cd6c-41f0-af80-fb2b33044ef4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:03 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:04 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:04 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b7f89dc-06cc-45e7-bcf2-eae86bcbfe84]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:04 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:04 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:04 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4916c31c-2094-454f-a748-d2072f812cbc]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:04 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c6f3db-ea33-4ae5-93d2-7f46ced313f8]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:04 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:04 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:37:04 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:37:04 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:04 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:37:04 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:37:04 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d39c6d4d-570c-405b-bec7-39c9f82b5772]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:04 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:37:04 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:37:04 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:37:04 user nova-compute[231753]: DEBUG os_brick.utils [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] <== get_connector_properties: return (144ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:37:04 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Updating existing volume attachment record: afb83b66-8cd9-4629-a2c2-5f329a1a14df {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:37:04 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690637809.2923303, 8822efe3-e17a-4511-b75f-37f6a83616aa => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:37:04 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] VM Stopped (Lifecycle Event)
Jul 29 13:37:04 user nova-compute[231753]: DEBUG nova.compute.manager [None req-3482c668-1a47-47c0-a837-d5f662443001 None None] [instance: 8822efe3-e17a-4511-b75f-37f6a83616aa] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:37:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "4475f276-acc4-44f1-a5fa-6a7fb2165493" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "4475f276-acc4-44f1-a5fa-6a7fb2165493" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:04 user nova-compute[231753]: INFO nova.compute.manager [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Unshelving
Jul 29 13:37:04 user nova-compute[231753]: INFO nova.virt.block_device [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Booting with volume 0b2a5916-6c71-4b54-9944-8b2c623fcbb3 at /dev/vdc
Jul 29 13:37:04 user nova-compute[231753]: DEBUG os_brick.utils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:37:04 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:04 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:37:04 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:04 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3edc577-38d9-4251-8f13-23472683ba7d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:04 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:04 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Took 1.10 seconds to deallocate network for instance.
Jul 29 13:37:04 user nova-compute[231753]: DEBUG nova.compute.manager [req-4e062cc1-6cb4-4e9b-b6b1-ba2991abee35 req-053463d6-4b8f-4e72-a30a-665fdd4c42e6 service nova] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Received event network-vif-deleted-353d55fe-9e9d-49c7-81ef-d210995d1190 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:37:04 user nova-compute[231753]: INFO nova.compute.manager [req-4e062cc1-6cb4-4e9b-b6b1-ba2991abee35 req-053463d6-4b8f-4e72-a30a-665fdd4c42e6 service nova] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Neutron deleted interface 353d55fe-9e9d-49c7-81ef-d210995d1190; detaching it from the instance and deleting it from the info cache
Jul 29 13:37:04 user nova-compute[231753]: DEBUG nova.network.neutron [req-4e062cc1-6cb4-4e9b-b6b1-ba2991abee35 req-053463d6-4b8f-4e72-a30a-665fdd4c42e6 service nova] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:37:04 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.027s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:04 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c71be9-ad73-4cfe-851e-4cdc080a334e]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:04 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:04 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:04 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a759625-36fc-415c-85e2-fa779d809c0b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:04 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[959903ad-8721-4981-9e2f-f22f3f0a63a1]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:37:05 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:37:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-dddd7b3f-2585-47c3-8458-1fd8e251b0a3 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-dddd7b3f-2585-47c3-8458-1fd8e251b0a3 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:05 user nova-compute[231753]: DEBUG nova.compute.manager [req-4e062cc1-6cb4-4e9b-b6b1-ba2991abee35 req-053463d6-4b8f-4e72-a30a-665fdd4c42e6 service nova] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Detach interface failed, port_id=353d55fe-9e9d-49c7-81ef-d210995d1190, reason: Instance 3d25aef1-5ef1-42a9-be32-1e26077f7b74 could not be found. {{(pid=231753) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 13:37:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:37:05 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:37:05 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[050e6b82-bc62-43f4-a7ed-9a79ed32f16e]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:05 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:37:05 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:37:05 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:37:05 user nova-compute[231753]: DEBUG os_brick.utils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] <== get_connector_properties: return (164ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:37:05 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Updating existing volume attachment record: 0cf8b73c-baac-44c6-9550-11bf230ed602 {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:37:05 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-dddd7b3f-2585-47c3-8458-1fd8e251b0a3 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:37:05 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-dddd7b3f-2585-47c3-8458-1fd8e251b0a3 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:37:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-dddd7b3f-2585-47c3-8458-1fd8e251b0a3 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.425s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:05 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-dddd7b3f-2585-47c3-8458-1fd8e251b0a3 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Deleted allocations for instance 3d25aef1-5ef1-42a9-be32-1e26077f7b74
Jul 29 13:37:05 user nova-compute[231753]: DEBUG nova.compute.manager [req-7948f379-f963-4b92-b6d5-8651ff3b20c7 req-b7a3b747-cefb-4d42-b149-7b0dc45c56ad service nova] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Received event network-vif-plugged-353d55fe-9e9d-49c7-81ef-d210995d1190 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:37:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7948f379-f963-4b92-b6d5-8651ff3b20c7 req-b7a3b747-cefb-4d42-b149-7b0dc45c56ad service nova] Acquiring lock "3d25aef1-5ef1-42a9-be32-1e26077f7b74-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7948f379-f963-4b92-b6d5-8651ff3b20c7 req-b7a3b747-cefb-4d42-b149-7b0dc45c56ad service nova] Lock "3d25aef1-5ef1-42a9-be32-1e26077f7b74-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7948f379-f963-4b92-b6d5-8651ff3b20c7 req-b7a3b747-cefb-4d42-b149-7b0dc45c56ad service nova] Lock "3d25aef1-5ef1-42a9-be32-1e26077f7b74-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:05 user nova-compute[231753]: DEBUG nova.compute.manager [req-7948f379-f963-4b92-b6d5-8651ff3b20c7 req-b7a3b747-cefb-4d42-b149-7b0dc45c56ad service nova] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] No waiting events found dispatching network-vif-plugged-353d55fe-9e9d-49c7-81ef-d210995d1190 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:37:05 user nova-compute[231753]: WARNING nova.compute.manager [req-7948f379-f963-4b92-b6d5-8651ff3b20c7 req-b7a3b747-cefb-4d42-b149-7b0dc45c56ad service nova] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Received unexpected event network-vif-plugged-353d55fe-9e9d-49c7-81ef-d210995d1190 for instance with vm_state deleted and task_state None.
Jul 29 13:37:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-dddd7b3f-2585-47c3-8458-1fd8e251b0a3 tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lock "3d25aef1-5ef1-42a9-be32-1e26077f7b74" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.880s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:06 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HxbMradf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:37:07 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:37:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:37:07 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:37:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:37:07 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ab5c44-47b9-4329-b245-3d9c9d836e22]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:37:07 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad6e73b1-dc8b-42d3-8401-bde3a9f420e9]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4] added
Jul 29 13:37:07 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7771fa54-937a-4ef8-b3ab-bcfd4e6ed118]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[46891019-82ed-42c0-98f9-26cea7321899]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HxbMradf {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HxbMradf" returned: 0 in 0.043s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b8bb9d3-b788-485c-8464-f28d92197e33]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HxbMradf'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcc43c2-640b-43a2-a7be-d158e9808d6a]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b01a500-ccb1-448d-9171-6ecd765a1730]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 29 13:37:07 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 29 13:37:07 user nova-compute[231753]:  {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:37:07 user nova-compute[231753]: WARNING os_brick.initiator.connectors.iscsi [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 29 13:37:07 user nova-compute[231753]: 
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --login" returned: 0 in 0.070s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d67668b6-326a-4f1d-8bd4-cdedc02d1083]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4, portal: 172.16.0.220,3260]
Jul 29 13:37:07 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4, portal: 172.16.0.220,3260] successful.
Jul 29 13:37:07 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d56d5f2e-6749-4bd3-9bef-f1f024a5785e]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3ade9c-773e-4472-af5d-4afc333c0560]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:37:07 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:37:07 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] HCTL ('33', '-', '-', 0) found on session 13 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[16664fd1-aa5e-411f-96ce-f48aa5adaae5]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Searching for a device in session 13 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HxbMradf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "refresh_cache-b67b98f8-a7b3-499e-ba32-9520bbced960" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquired lock "refresh_cache-b67b98f8-a7b3-499e-ba32-9520bbced960" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Forcefully refreshing network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 13:37:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:08 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Updating instance_info_cache with network_info: [{"id": "a19600e4-052d-44b1-87b3-73605975e810", "address": "fa:16:3e:7a:6e:42", "network": {"id": "092d27a5-871f-4865-ac97-fbb701a5c807", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-907499567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a6a49685124aaf93030ca59169dde5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa19600e4-05", "ovs_interfaceid": "a19600e4-052d-44b1-87b3-73605975e810", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:37:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Releasing lock "refresh_cache-b67b98f8-a7b3-499e-ba32-9520bbced960" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:37:08 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Updated the network info_cache for instance {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 13:37:08 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:37:08 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:37:08 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:37:08 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:37:08 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:37:08 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:37:08 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 13:37:08 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:37:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:08 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 13:37:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:08 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.347s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:37:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] <== connect_volume: return (1349ms) {'type': 'block', 'scsi_wwn': '23430363036643831', 'path': '/dev/sdb'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:37:08 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430363036643831', 'path': '/dev/sdb'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:37:08 user nova-compute[231753]: DEBUG nova.objects.instance [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lazy-loading 'flavor' on Instance uuid 63fad324-aac2-4d60-b4ce-a32a5736657d {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:37:08 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 13:37:08 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:37:08 user nova-compute[231753]:   <source dev="/dev/sdb"/>
Jul 29 13:37:08 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:37:08 user nova-compute[231753]:   <serial>a62778d4-32b0-41ef-b7df-716d38fbcba4</serial>
Jul 29 13:37:08 user nova-compute[231753]: </disk>
Jul 29 13:37:08 user nova-compute[231753]:  {{(pid=231753) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 13:37:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:37:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] No BDM found with device name vdb, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:37:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] No VIF found with MAC fa:16:3e:df:12:9c, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:37:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02ec16d-24a3-450d-858d-3ad302086ac3/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-90a7e141-4465-46e9-a3d8-3559aeb279d4 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.697s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02ec16d-24a3-450d-858d-3ad302086ac3/disk --force-share --output=json" returned: 0 in 0.200s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02ec16d-24a3-450d-858d-3ad302086ac3/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b02ec16d-24a3-450d-858d-3ad302086ac3/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e7da3f-33d9-4f58-8c98-72869b679850/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e7da3f-33d9-4f58-8c98-72869b679850/disk --force-share --output=json" returned: 0 in 0.211s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e7da3f-33d9-4f58-8c98-72869b679850/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e7da3f-33d9-4f58-8c98-72869b679850/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fed0e1e-c8a7-43cc-bef6-14410111d3cb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fed0e1e-c8a7-43cc-bef6-14410111d3cb/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fed0e1e-c8a7-43cc-bef6-14410111d3cb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fed0e1e-c8a7-43cc-bef6-14410111d3cb/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rywvfqid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:37:12 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:37:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:37:12 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:37:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:37:12 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:37:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:12 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:37:12 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:37:12 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=7267MB free_disk=25.50525665283203GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG nova.compute.manager [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Stashing vm_state: active {{(pid=231753) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dbf16f2-5c6e-490a-8cc8-27043a926090]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:37:12 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[98658e27-9798-46cf-9cd7-e1d5e40de672]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7] added
Jul 29 13:37:12 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3233b8-6cc8-41fc-9adf-28b64ad05dbd]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[df39dc11-cd91-49ec-b1bb-acb36ef4bb92]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rywvfqid {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:12 user nova-compute[231753]: INFO nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Updating resource usage from migration 9511cb2a-137a-4059-93c7-22c78e5e7652
Jul 29 13:37:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rywvfqid" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[062b5115-662c-42c2-8622-d9c3268a371f]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rywvfqid'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b67b98f8-a7b3-499e-ba32-9520bbced960 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 299b7f21-b198-437b-9d5c-1269d5e9b7c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b02ec16d-24a3-450d-858d-3ad302086ac3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 3fed0e1e-c8a7-43cc-bef6-14410111d3cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b5e7da3f-33d9-4f58-8c98-72869b679850 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 7e2615c1-b03e-4076-bcd9-3585fb11b8ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8ea52d41-7ec3-44d7-8421-133000ee887b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[855759c9-5d19-4b68-a597-19af9b06b7c0]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4263600f-41e3-4053-a76b-4517e30a5691]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:37:12 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:37:12 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.166s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c48b3f0c-f719-47cd-80a3-07f479f68619]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7, portal: 172.16.0.220,3260]
Jul 29 13:37:12 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7, portal: 172.16.0.220,3260] successful.
Jul 29 13:37:12 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 4475f276-acc4-44f1-a5fa-6a7fb2165493 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1761}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Migration 9511cb2a-137a-4059-93c7-22c78e5e7652 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 63fad324-aac2-4d60-b4ce-a32a5736657d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f0c2e70-36cb-4be5-a198-07fa8556fe77]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4afb17c-d048-4cdd-9600-0d31fb06f5a9]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:37:12 user nova-compute[231753]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:37:12 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:37:12 user nova-compute[231753]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:37:12 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.420s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] HCTL ('34', '-', '-', 0) found on session 14 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfdd4f1-0a7e-4f63-a2ac-e5fd88ef75dc]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: None {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:37:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:13 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:37:13 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:37:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 13:37:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.808s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.440s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:13 user nova-compute[231753]: DEBUG nova.objects.instance [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lazy-loading 'pci_requests' on Instance uuid 63fad324-aac2-4d60-b4ce-a32a5736657d {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:37:13 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:37:13 user nova-compute[231753]: INFO nova.compute.claims [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Claim successful on node user
Jul 29 13:37:13 user nova-compute[231753]: DEBUG nova.objects.instance [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lazy-loading 'resources' on Instance uuid 63fad324-aac2-4d60-b4ce-a32a5736657d {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:37:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:13 user nova-compute[231753]: DEBUG nova.objects.instance [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lazy-loading 'pci_devices' on Instance uuid 63fad324-aac2-4d60-b4ce-a32a5736657d {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:37:13 user nova-compute[231753]: INFO nova.compute.resource_tracker [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Updating resource usage from migration 9511cb2a-137a-4059-93c7-22c78e5e7652
Jul 29 13:37:13 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:37:13 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:37:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.565s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:13 user nova-compute[231753]: INFO nova.compute.manager [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Migrating
Jul 29 13:37:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:37:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Acquired lock "compute-rpcapi-router" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:37:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.485s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:13 user nova-compute[231753]: DEBUG nova.objects.instance [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lazy-loading 'pci_requests' on Instance uuid 4475f276-acc4-44f1-a5fa-6a7fb2165493 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:37:13 user nova-compute[231753]: INFO nova.compute.rpcapi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Automatically selected compute RPC version 6.2 from minimum service version 66
Jul 29 13:37:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Releasing lock "compute-rpcapi-router" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:37:13 user nova-compute[231753]: DEBUG nova.objects.instance [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lazy-loading 'numa_topology' on Instance uuid 4475f276-acc4-44f1-a5fa-6a7fb2165493 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:37:13 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:13 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:37:13 user nova-compute[231753]: INFO nova.compute.claims [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Claim successful on node user
Jul 29 13:37:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Acquiring lock "refresh_cache-63fad324-aac2-4d60-b4ce-a32a5736657d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:37:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Acquired lock "refresh_cache-63fad324-aac2-4d60-b4ce-a32a5736657d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:37:13 user nova-compute[231753]: DEBUG nova.network.neutron [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:37:13 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Searching for a device in session 14 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:37:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rywvfqid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:37:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.462s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:37:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] <== connect_volume: return (1464ms) {'type': 'block', 'scsi_wwn': '26366653338663166', 'path': '/dev/sdc'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:37:13 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366653338663166', 'path': '/dev/sdc'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:37:13 user nova-compute[231753]: DEBUG nova.objects.instance [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lazy-loading 'flavor' on Instance uuid 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:37:13 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 13:37:13 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:37:13 user nova-compute[231753]:   <source dev="/dev/sdc"/>
Jul 29 13:37:13 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:37:13 user nova-compute[231753]:   <serial>ff96d4b8-97db-4db7-821f-a3a64b4be6f7</serial>
Jul 29 13:37:13 user nova-compute[231753]: </disk>
Jul 29 13:37:13 user nova-compute[231753]:  {{(pid=231753) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 13:37:14 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:37:14 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:37:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.496s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:37:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] No BDM found with device name vdb, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:37:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] No VIF found with MAC fa:16:3e:0c:e3:a3, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:37:14 user nova-compute[231753]: DEBUG nova.network.neutron [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Updating instance_info_cache with network_info: [{"id": "fadc1466-5336-4230-b0f1-4fe4053f216a", "address": "fa:16:3e:df:12:9c", "network": {"id": "8897db8c-6e92-4b9e-b7ee-a69230eb07f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1596242231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a8a3e0bcef4bbc979ef187e4ed48cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc1466-53", "ovs_interfaceid": "fadc1466-5336-4230-b0f1-4fe4053f216a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:37:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Releasing lock "refresh_cache-63fad324-aac2-4d60-b4ce-a32a5736657d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:37:14 user nova-compute[231753]: INFO nova.network.neutron [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Updating port d219916c-23c3-4319-ad8e-9d04e9399ab7 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 29 13:37:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-26af0503-e45c-41bc-ad04-b2f5996f9212 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.587s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Starting migrate_disk_and_power_off {{(pid=231753) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 29 13:37:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG nova.compute.manager [req-bd1d04a1-9461-4223-9b82-1153c79cb35b req-e096915f-3789-47fd-945a-fe5b9f9685fe service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Received event network-vif-unplugged-fadc1466-5336-4230-b0f1-4fe4053f216a {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bd1d04a1-9461-4223-9b82-1153c79cb35b req-e096915f-3789-47fd-945a-fe5b9f9685fe service nova] Acquiring lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bd1d04a1-9461-4223-9b82-1153c79cb35b req-e096915f-3789-47fd-945a-fe5b9f9685fe service nova] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bd1d04a1-9461-4223-9b82-1153c79cb35b req-e096915f-3789-47fd-945a-fe5b9f9685fe service nova] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG nova.compute.manager [req-bd1d04a1-9461-4223-9b82-1153c79cb35b req-e096915f-3789-47fd-945a-fe5b9f9685fe service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] No waiting events found dispatching network-vif-unplugged-fadc1466-5336-4230-b0f1-4fe4053f216a {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:37:15 user nova-compute[231753]: WARNING nova.compute.manager [req-bd1d04a1-9461-4223-9b82-1153c79cb35b req-e096915f-3789-47fd-945a-fe5b9f9685fe service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Received unexpected event network-vif-unplugged-fadc1466-5336-4230-b0f1-4fe4053f216a for instance with vm_state active and task_state resize_migrating.
Jul 29 13:37:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "refresh_cache-4475f276-acc4-44f1-a5fa-6a7fb2165493" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquired lock "refresh_cache-4475f276-acc4-44f1-a5fa-6a7fb2165493" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG nova.network.neutron [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:37:15 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Instance destroyed successfully.
Jul 29 13:37:15 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:33:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-800445599',display_name='tempest-ServerActionsTestOtherB-server-800445599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-800445599',id=1,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK3mwTAZBOJzlYUFtbhzSHDzTYFwqvVO3PSQcWrwJtS4OLSJuALDnCfY5kQP9dq+tAP99lu02YS+c2OW9ZUPQROMcosGuWuOlguzRCIeVSykNGGMYttb7ShY1vz/IoqmQ==',key_name='tempest-keypair-1690887276',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:33:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='74a8a3e0bcef4bbc979ef187e4ed48cc',ramdisk_id='',reservation_id='r-zypim8f0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1624737976',owner_user_name='tempest-ServerActionsTestOtherB-1624737976-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:37:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7361505253f84cf28c8688caf4a0cd16',uuid=63fad324-aac2-4d60-b4ce-a32a5736657d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fadc1466-5336-4230-b0f1-4fe4053f216a", "address": "fa:16:3e:df:12:9c", "network": {"id": "8897db8c-6e92-4b9e-b7ee-a69230eb07f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1596242231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1596242231-network", "vif_mac": "fa:16:3e:df:12:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a8a3e0bcef4bbc979ef187e4ed48cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc1466-53", "ovs_interfaceid": "fadc1466-5336-4230-b0f1-4fe4053f216a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Converting VIF {"id": "fadc1466-5336-4230-b0f1-4fe4053f216a", "address": "fa:16:3e:df:12:9c", "network": {"id": "8897db8c-6e92-4b9e-b7ee-a69230eb07f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1596242231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1596242231-network", "vif_mac": "fa:16:3e:df:12:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a8a3e0bcef4bbc979ef187e4ed48cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc1466-53", "ovs_interfaceid": "fadc1466-5336-4230-b0f1-4fe4053f216a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:12:9c,bridge_name='br-int',has_traffic_filtering=True,id=fadc1466-5336-4230-b0f1-4fe4053f216a,network=Network(8897db8c-6e92-4b9e-b7ee-a69230eb07f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfadc1466-53') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG os_vif [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:12:9c,bridge_name='br-int',has_traffic_filtering=True,id=fadc1466-5336-4230-b0f1-4fe4053f216a,network=Network(8897db8c-6e92-4b9e-b7ee-a69230eb07f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfadc1466-53') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfadc1466-53, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:37:15 user nova-compute[231753]: INFO os_vif [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:12:9c,bridge_name='br-int',has_traffic_filtering=True,id=fadc1466-5336-4230-b0f1-4fe4053f216a,network=Network(8897db8c-6e92-4b9e-b7ee-a69230eb07f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfadc1466-53')
Jul 29 13:37:15 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HxbMradf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:37:15 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:37:15 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[88969458-5a57-4a2a-9fee-b593401577a3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:37:15 user nova-compute[231753]: No targets found.
Jul 29 13:37:15 user nova-compute[231753]: iSNS:
Jul 29 13:37:15 user nova-compute[231753]: No targets found.
Jul 29 13:37:15 user nova-compute[231753]: STATIC:
Jul 29 13:37:15 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4
Jul 29 13:37:15 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:37:15 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:37:15 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7
Jul 29 13:37:15 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:37:15 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:37:15 user nova-compute[231753]: FIRMWARE:
Jul 29 13:37:15 user nova-compute[231753]: No targets found.
Jul 29 13:37:15 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:37:15 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:37:15 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.029s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7543513a-668d-42c9-9c18-bf861d82852f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[33a99e34-687a-4987-b276-1135c8528f9b]: (4, ('tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)\ntcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:37:15 user nova-compute[231753]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:37:15 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsi session list stdout=tcp: [13] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:37:15 user nova-compute[231753]: tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:37:15 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c98328d30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4'): ({'sdb'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Removing single pathed devices sdb {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55b1e47-3c84-4113-836f-8cc5a975bd13]: (4, ('path checker states:\nup                  1\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.028s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[527cee01-66cf-43e6-a79d-2acbc9ee0c2b]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Flushing IO for device /dev/sdb {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[87470488-58f5-48e6-b43f-6b033ec2d50c]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.060s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[93489868-d2fd-4cee-b76b-ddb98a576077]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] SCSI volumes sdb have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[faa08187-3e78-4e33-9673-b667b1cce2b8]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.086s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4210004-30cb-4549-8e58-17ba1495ec59]: (4, ('Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4, portal: 172.16.0.220,3260]\nLogout of [sid: 13, target: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4, portal: 172.16.0.220,3260]
Jul 29 13:37:15 user nova-compute[231753]: Logout of [sid: 13, target: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4, portal: 172.16.0.220,3260] successful.
Jul 29 13:37:15 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[da97ba9d-590b-4fe9-a089-4963ec71874c]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.387s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] <== disconnect_volume: return (389ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:37:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:16 user nova-compute[231753]: DEBUG nova.network.neutron [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Updating instance_info_cache with network_info: [{"id": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "address": "fa:16:3e:52:5c:6f", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd219916c-23", "ovs_interfaceid": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:37:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Releasing lock "refresh_cache-4475f276-acc4-44f1-a5fa-6a7fb2165493" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:37:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:37:16 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Creating image(s)
Jul 29 13:37:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "/opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "/opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "/opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:16 user nova-compute[231753]: DEBUG nova.objects.instance [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lazy-loading 'trusted_certs' on Instance uuid 4475f276-acc4-44f1-a5fa-6a7fb2165493 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:37:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "6f045084b8ef31baff8b1025ae02f2f7a1a8c7bc" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "6f045084b8ef31baff8b1025ae02f2f7a1a8c7bc" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f045084b8ef31baff8b1025ae02f2f7a1a8c7bc.part --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:17 user nova-compute[231753]: DEBUG nova.compute.manager [req-8a0f0788-d96c-4b54-8114-c0d63103bc50 req-0b3010cf-4e60-4255-a932-9d1146d8dfcc service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Received event network-changed-d219916c-23c3-4319-ad8e-9d04e9399ab7 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:37:17 user nova-compute[231753]: DEBUG nova.compute.manager [req-8a0f0788-d96c-4b54-8114-c0d63103bc50 req-0b3010cf-4e60-4255-a932-9d1146d8dfcc service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Refreshing instance network info cache due to event network-changed-d219916c-23c3-4319-ad8e-9d04e9399ab7. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:37:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8a0f0788-d96c-4b54-8114-c0d63103bc50 req-0b3010cf-4e60-4255-a932-9d1146d8dfcc service nova] Acquiring lock "refresh_cache-4475f276-acc4-44f1-a5fa-6a7fb2165493" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:37:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8a0f0788-d96c-4b54-8114-c0d63103bc50 req-0b3010cf-4e60-4255-a932-9d1146d8dfcc service nova] Acquired lock "refresh_cache-4475f276-acc4-44f1-a5fa-6a7fb2165493" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:37:17 user nova-compute[231753]: DEBUG nova.network.neutron [req-8a0f0788-d96c-4b54-8114-c0d63103bc50 req-0b3010cf-4e60-4255-a932-9d1146d8dfcc service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Refreshing network info cache for port d219916c-23c3-4319-ad8e-9d04e9399ab7 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:37:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk --force-share --output=json" returned: 0 in 1.412s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:37:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d_resize/disk /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:17 user nova-compute[231753]: INFO nova.compute.manager [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Rebuilding instance
Jul 29 13:37:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f045084b8ef31baff8b1025ae02f2f7a1a8c7bc.part --force-share --output=json" returned: 0 in 0.161s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:17 user nova-compute[231753]: DEBUG nova.virt.images [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] 8a35de86-8711-45d3-a18a-d1010e6aa412 was qcow2, converting to raw {{(pid=231753) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 29 13:37:17 user nova-compute[231753]: DEBUG nova.privsep.utils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=231753) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 29 13:37:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6f045084b8ef31baff8b1025ae02f2f7a1a8c7bc.part /opt/stack/data/nova/instances/_base/6f045084b8ef31baff8b1025ae02f2f7a1a8c7bc.converted {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:17 user nova-compute[231753]: DEBUG nova.objects.instance [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lazy-loading 'trusted_certs' on Instance uuid 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:37:17 user nova-compute[231753]: DEBUG nova.compute.manager [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG nova.objects.instance [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lazy-loading 'pci_requests' on Instance uuid 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG nova.objects.instance [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lazy-loading 'pci_devices' on Instance uuid 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG nova.objects.instance [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lazy-loading 'resources' on Instance uuid 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG nova.objects.instance [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lazy-loading 'migration_context' on Instance uuid 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG nova.objects.instance [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Trying to apply a migration context that does not seem to be set for this instance {{(pid=231753) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/6f045084b8ef31baff8b1025ae02f2f7a1a8c7bc.part /opt/stack/data/nova/instances/_base/6f045084b8ef31baff8b1025ae02f2f7a1a8c7bc.converted" returned: 0 in 0.769s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f045084b8ef31baff8b1025ae02f2f7a1a8c7bc.converted --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] CMD "cp -r /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d_resize/disk /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk" returned: 0 in 0.964s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG nova.network.neutron [req-8a0f0788-d96c-4b54-8114-c0d63103bc50 req-0b3010cf-4e60-4255-a932-9d1146d8dfcc service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Updated VIF entry in instance network info cache for port d219916c-23c3-4319-ad8e-9d04e9399ab7. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG nova.network.neutron [req-8a0f0788-d96c-4b54-8114-c0d63103bc50 req-0b3010cf-4e60-4255-a932-9d1146d8dfcc service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Updating instance_info_cache with network_info: [{"id": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "address": "fa:16:3e:52:5c:6f", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd219916c-23", "ovs_interfaceid": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d_resize/disk.info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk.info {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8a0f0788-d96c-4b54-8114-c0d63103bc50 req-0b3010cf-4e60-4255-a932-9d1146d8dfcc service nova] Releasing lock "refresh_cache-4475f276-acc4-44f1-a5fa-6a7fb2165493" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG nova.compute.manager [req-8a0f0788-d96c-4b54-8114-c0d63103bc50 req-0b3010cf-4e60-4255-a932-9d1146d8dfcc service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Received event network-vif-plugged-fadc1466-5336-4230-b0f1-4fe4053f216a {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8a0f0788-d96c-4b54-8114-c0d63103bc50 req-0b3010cf-4e60-4255-a932-9d1146d8dfcc service nova] Acquiring lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8a0f0788-d96c-4b54-8114-c0d63103bc50 req-0b3010cf-4e60-4255-a932-9d1146d8dfcc service nova] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8a0f0788-d96c-4b54-8114-c0d63103bc50 req-0b3010cf-4e60-4255-a932-9d1146d8dfcc service nova] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG nova.compute.manager [req-8a0f0788-d96c-4b54-8114-c0d63103bc50 req-0b3010cf-4e60-4255-a932-9d1146d8dfcc service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] No waiting events found dispatching network-vif-plugged-fadc1466-5336-4230-b0f1-4fe4053f216a {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:37:18 user nova-compute[231753]: WARNING nova.compute.manager [req-8a0f0788-d96c-4b54-8114-c0d63103bc50 req-0b3010cf-4e60-4255-a932-9d1146d8dfcc service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Received unexpected event network-vif-plugged-fadc1466-5336-4230-b0f1-4fe4053f216a for instance with vm_state active and task_state resize_migrating.
Jul 29 13:37:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] CMD "cp -r /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d_resize/disk.info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk.info" returned: 0 in 0.050s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f045084b8ef31baff8b1025ae02f2f7a1a8c7bc.converted --force-share --output=json" returned: 0 in 0.158s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "6f045084b8ef31baff8b1025ae02f2f7a1a8c7bc" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.490s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f045084b8ef31baff8b1025ae02f2f7a1a8c7bc --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690637823.6930165, 3d25aef1-5ef1-42a9-be32-1e26077f7b74 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:37:18 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] VM Stopped (Lifecycle Event)
Jul 29 13:37:18 user nova-compute[231753]: DEBUG nova.compute.manager [req-c4d0f7d3-ed1e-4f03-bccf-771a24bc0c49 req-733c1abf-a5ee-4a69-9463-c2776986c549 service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Received event network-vif-unplugged-2a7981fb-647d-4610-9da2-3b162f366dfe {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c4d0f7d3-ed1e-4f03-bccf-771a24bc0c49 req-733c1abf-a5ee-4a69-9463-c2776986c549 service nova] Acquiring lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c4d0f7d3-ed1e-4f03-bccf-771a24bc0c49 req-733c1abf-a5ee-4a69-9463-c2776986c549 service nova] Lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c4d0f7d3-ed1e-4f03-bccf-771a24bc0c49 req-733c1abf-a5ee-4a69-9463-c2776986c549 service nova] Lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG nova.compute.manager [req-c4d0f7d3-ed1e-4f03-bccf-771a24bc0c49 req-733c1abf-a5ee-4a69-9463-c2776986c549 service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] No waiting events found dispatching network-vif-unplugged-2a7981fb-647d-4610-9da2-3b162f366dfe {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:37:18 user nova-compute[231753]: WARNING nova.compute.manager [req-c4d0f7d3-ed1e-4f03-bccf-771a24bc0c49 req-733c1abf-a5ee-4a69-9463-c2776986c549 service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Received unexpected event network-vif-unplugged-2a7981fb-647d-4610-9da2-3b162f366dfe for instance with vm_state active and task_state rebuilding.
Jul 29 13:37:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG nova.compute.manager [None req-87963fdf-6ec6-4c56-ac3b-c360c6c20342 None None] [instance: 3d25aef1-5ef1-42a9-be32-1e26077f7b74] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f045084b8ef31baff8b1025ae02f2f7a1a8c7bc --force-share --output=json" returned: 0 in 0.173s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "6f045084b8ef31baff8b1025ae02f2f7a1a8c7bc" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "6f045084b8ef31baff8b1025ae02f2f7a1a8c7bc" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f045084b8ef31baff8b1025ae02f2f7a1a8c7bc --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f045084b8ef31baff8b1025ae02f2f7a1a8c7bc --force-share --output=json" returned: 0 in 0.185s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6f045084b8ef31baff8b1025ae02f2f7a1a8c7bc,backing_fmt=raw /opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:19 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Instance destroyed successfully.
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/6f045084b8ef31baff8b1025ae02f2f7a1a8c7bc,backing_fmt=raw /opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/disk 1073741824" returned: 0 in 0.067s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "6f045084b8ef31baff8b1025ae02f2f7a1a8c7bc" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.265s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f045084b8ef31baff8b1025ae02f2f7a1a8c7bc --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:19 user nova-compute[231753]: INFO nova.compute.manager [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Detaching volume ff96d4b8-97db-4db7-821f-a3a64b4be6f7
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/6f045084b8ef31baff8b1025ae02f2f7a1a8c7bc --force-share --output=json" returned: 0 in 0.218s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG nova.objects.instance [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lazy-loading 'migration_context' on Instance uuid 4475f276-acc4-44f1-a5fa-6a7fb2165493 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:37:19 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Rebasing disk image.
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:19 user nova-compute[231753]: INFO nova.virt.block_device [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Attempting to driver detach volume ff96d4b8-97db-4db7-821f-a3a64b4be6f7 from mountpoint /dev/vdb
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-f49a6a96-946a-42a1-901a-0a747f8198bc tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Acquiring lock "b02ec16d-24a3-450d-858d-3ad302086ac3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-f49a6a96-946a-42a1-901a-0a747f8198bc tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Lock "b02ec16d-24a3-450d-858d-3ad302086ac3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-f49a6a96-946a-42a1-901a-0a747f8198bc tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Acquiring lock "b02ec16d-24a3-450d-858d-3ad302086ac3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-f49a6a96-946a-42a1-901a-0a747f8198bc tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Lock "b02ec16d-24a3-450d-858d-3ad302086ac3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-f49a6a96-946a-42a1-901a-0a747f8198bc tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Lock "b02ec16d-24a3-450d-858d-3ad302086ac3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:19 user nova-compute[231753]: INFO nova.compute.manager [None req-f49a6a96-946a-42a1-901a-0a747f8198bc tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Terminating instance
Jul 29 13:37:19 user nova-compute[231753]: DEBUG nova.compute.manager [None req-f49a6a96-946a-42a1-901a-0a747f8198bc tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Attempting to detach device vdb from instance 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb from the persistent domain config. {{(pid=231753) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:37:19 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:37:19 user nova-compute[231753]:   <source dev="/dev/sdc"/>
Jul 29 13:37:19 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:37:19 user nova-compute[231753]:   <serial>ff96d4b8-97db-4db7-821f-a3a64b4be6f7</serial>
Jul 29 13:37:19 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 13:37:19 user nova-compute[231753]: </disk>
Jul 29 13:37:19 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:37:19 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Successfully detached device vdb from instance 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb from the persistent domain config.
Jul 29 13:37:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rywvfqid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:37:19 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 29 13:37:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.007s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.159s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a -F raw /opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/disk {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[029ec954-bd96-4fd4-ac04-89085bec23cc]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:37:19 user nova-compute[231753]: No targets found.
Jul 29 13:37:19 user nova-compute[231753]: iSNS:
Jul 29 13:37:19 user nova-compute[231753]: No targets found.
Jul 29 13:37:19 user nova-compute[231753]: STATIC:
Jul 29 13:37:19 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7
Jul 29 13:37:19 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:37:19 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:37:19 user nova-compute[231753]: FIRMWARE:
Jul 29 13:37:19 user nova-compute[231753]: No targets found.
Jul 29 13:37:19 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:37:19 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:37:19 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7d2ee6f-3f33-44fc-b3dd-f6b24ca72f96]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ce14b5a-27b1-419c-99ff-d4cdf38c6274]: (4, ('tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:37:19 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsi session list stdout=tcp: [14] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:37:19 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c9828d360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7'): ({'sdc'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Removing single pathed devices sdc {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa22e0e-a75c-4b3a-836d-30f1bd2f4172]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.054s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e373af3-8974-4e54-bdd8-ea3acdb1605d]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Flushing IO for device /dev/sdc {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.111s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[38a72059-f211-4196-98f4-af59be3d2d92]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.070s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f63004-7897-4a02-a25e-2e1a8714ac27]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] SCSI volumes sdc have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.108s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee508311-7ed8-4529-8f36-8276dc3499bb]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.131s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[93b422cb-008e-4d4a-b675-c594908f85dd]: (4, ('Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7, portal: 172.16.0.220,3260]\nLogout of [sid: 14, target: iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7, portal: 172.16.0.220,3260]
Jul 29 13:37:20 user nova-compute[231753]: Logout of [sid: 14, target: iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7, portal: 172.16.0.220,3260] successful.
Jul 29 13:37:20 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ea6770-03fe-456c-a4f6-1b0d71843a8a]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.682s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] <== disconnect_volume: return (688ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG nova.compute.manager [req-e0d83679-6ead-4967-bde3-cc33983bc793 req-40f62d9a-b5d3-48a8-b44e-ceeb40379436 service nova] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Received event network-vif-unplugged-c6299ccb-7770-4eaf-8e2e-ecea8da9f324 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e0d83679-6ead-4967-bde3-cc33983bc793 req-40f62d9a-b5d3-48a8-b44e-ceeb40379436 service nova] Acquiring lock "b02ec16d-24a3-450d-858d-3ad302086ac3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e0d83679-6ead-4967-bde3-cc33983bc793 req-40f62d9a-b5d3-48a8-b44e-ceeb40379436 service nova] Lock "b02ec16d-24a3-450d-858d-3ad302086ac3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e0d83679-6ead-4967-bde3-cc33983bc793 req-40f62d9a-b5d3-48a8-b44e-ceeb40379436 service nova] Lock "b02ec16d-24a3-450d-858d-3ad302086ac3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG nova.compute.manager [req-e0d83679-6ead-4967-bde3-cc33983bc793 req-40f62d9a-b5d3-48a8-b44e-ceeb40379436 service nova] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] No waiting events found dispatching network-vif-unplugged-c6299ccb-7770-4eaf-8e2e-ecea8da9f324 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG nova.compute.manager [req-e0d83679-6ead-4967-bde3-cc33983bc793 req-40f62d9a-b5d3-48a8-b44e-ceeb40379436 service nova] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Received event network-vif-unplugged-c6299ccb-7770-4eaf-8e2e-ecea8da9f324 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:20 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Instance destroyed successfully.
Jul 29 13:37:20 user nova-compute[231753]: DEBUG nova.objects.instance [None req-f49a6a96-946a-42a1-901a-0a747f8198bc tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Lazy-loading 'resources' on Instance uuid b02ec16d-24a3-450d-858d-3ad302086ac3 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG nova.network.neutron [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Port fadc1466-5336-4230-b0f1-4fe4053f216a binding to destination host user is already ACTIVE {{(pid=231753) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-f49a6a96-946a-42a1-901a-0a747f8198bc tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:33:47Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeSwap-server-612828864',display_name='tempest-TestVolumeSwap-server-612828864',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumeswap-server-612828864',id=8,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBRF2WDBYR/Cv7wHxMyVxmUVVl1gYUYS9XuEQkxdyPZYUD95wRBa2/uQ6hwvoeX5p/jJ0QbopdJOYkaOK1NA5P7ZGDyWvVQnewPm7tpEOgc4r75LqokbY0c9dcx2rbPVhw==',key_name='tempest-keypair-873333226',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:34:04Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cd8ee7b983944e2abe660fffe40b274c',ramdisk_id='',reservation_id='r-ktg9g089',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeSwap-2006247747',owner_user_name='tempest-TestVolumeSwap-2006247747-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:34:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c6e954b6a3a14f5b973e98b1d4d81910',uuid=b02ec16d-24a3-450d-858d-3ad302086ac3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c6299ccb-7770-4eaf-8e2e-ecea8da9f324", "address": "fa:16:3e:8d:e7:c6", "network": {"id": "b41abe8c-4b7a-43eb-be54-286ef7161f43", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1689635352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8ee7b983944e2abe660fffe40b274c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6299ccb-77", "ovs_interfaceid": "c6299ccb-7770-4eaf-8e2e-ecea8da9f324", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-f49a6a96-946a-42a1-901a-0a747f8198bc tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Converting VIF {"id": "c6299ccb-7770-4eaf-8e2e-ecea8da9f324", "address": "fa:16:3e:8d:e7:c6", "network": {"id": "b41abe8c-4b7a-43eb-be54-286ef7161f43", "bridge": "br-int", "label": "tempest-TestVolumeSwap-1689635352-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.125", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cd8ee7b983944e2abe660fffe40b274c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc6299ccb-77", "ovs_interfaceid": "c6299ccb-7770-4eaf-8e2e-ecea8da9f324", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-f49a6a96-946a-42a1-901a-0a747f8198bc tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8d:e7:c6,bridge_name='br-int',has_traffic_filtering=True,id=c6299ccb-7770-4eaf-8e2e-ecea8da9f324,network=Network(b41abe8c-4b7a-43eb-be54-286ef7161f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6299ccb-77') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG os_vif [None req-f49a6a96-946a-42a1-901a-0a747f8198bc tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:e7:c6,bridge_name='br-int',has_traffic_filtering=True,id=c6299ccb-7770-4eaf-8e2e-ecea8da9f324,network=Network(b41abe8c-4b7a-43eb-be54-286ef7161f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6299ccb-77') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc6299ccb-77, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:20 user nova-compute[231753]: INFO os_vif [None req-f49a6a96-946a-42a1-901a-0a747f8198bc tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8d:e7:c6,bridge_name='br-int',has_traffic_filtering=True,id=c6299ccb-7770-4eaf-8e2e-ecea8da9f324,network=Network(b41abe8c-4b7a-43eb-be54-286ef7161f43),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc6299ccb-77')
Jul 29 13:37:20 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-f49a6a96-946a-42a1-901a-0a747f8198bc tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Deleting instance files /opt/stack/data/nova/instances/b02ec16d-24a3-450d-858d-3ad302086ac3_del
Jul 29 13:37:20 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-f49a6a96-946a-42a1-901a-0a747f8198bc tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Deletion of /opt/stack/data/nova/instances/b02ec16d-24a3-450d-858d-3ad302086ac3_del complete
Jul 29 13:37:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Acquiring lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:20 user nova-compute[231753]: INFO nova.compute.manager [None req-f49a6a96-946a-42a1-901a-0a747f8198bc tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Took 1.27 seconds to destroy the instance on the hypervisor.
Jul 29 13:37:20 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-f49a6a96-946a-42a1-901a-0a747f8198bc tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG nova.compute.manager [req-6bcb1cff-892b-4ccb-8fe8-d623bebe1149 req-0880ab76-50a8-4744-ac06-5d0ac34af39f service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Received event network-vif-plugged-2a7981fb-647d-4610-9da2-3b162f366dfe {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6bcb1cff-892b-4ccb-8fe8-d623bebe1149 req-0880ab76-50a8-4744-ac06-5d0ac34af39f service nova] Acquiring lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6bcb1cff-892b-4ccb-8fe8-d623bebe1149 req-0880ab76-50a8-4744-ac06-5d0ac34af39f service nova] Lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6bcb1cff-892b-4ccb-8fe8-d623bebe1149 req-0880ab76-50a8-4744-ac06-5d0ac34af39f service nova] Lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG nova.compute.manager [req-6bcb1cff-892b-4ccb-8fe8-d623bebe1149 req-0880ab76-50a8-4744-ac06-5d0ac34af39f service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] No waiting events found dispatching network-vif-plugged-2a7981fb-647d-4610-9da2-3b162f366dfe {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:37:20 user nova-compute[231753]: WARNING nova.compute.manager [req-6bcb1cff-892b-4ccb-8fe8-d623bebe1149 req-0880ab76-50a8-4744-ac06-5d0ac34af39f service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Received unexpected event network-vif-plugged-2a7981fb-647d-4610-9da2-3b162f366dfe for instance with vm_state active and task_state rebuilding.
Jul 29 13:37:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Acquiring lock "refresh_cache-63fad324-aac2-4d60-b4ce-a32a5736657d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Acquired lock "refresh_cache-63fad324-aac2-4d60-b4ce-a32a5736657d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:37:20 user nova-compute[231753]: DEBUG nova.network.neutron [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:37:21 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Instance destroyed successfully.
Jul 29 13:37:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:33:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1236712368',display_name='tempest-ServerActionsTestOtherA-server-259014365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1236712368',id=3,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuWQgyAL1ZhtINiMb8bBadRX1/6ZehT6zfTT2DNFW6eh8iXvfW0Pq6raR1PDnzRXJlqkmjwTrVF+AwsdLN+yPf0k+X1yx9QfVmcJaO2ivlK/Orc5S8LFrDXUE7UuYGgdQ==',key_name='tempest-keypair-820646002',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:33:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='afff9d3d250643c58da9bc5cf5756d1e',ramdisk_id='',reservation_id='r-8q0q0qkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1666416634',owner_user_name='tempest-ServerActionsTestOtherA-1666416634-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:37:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='748938c3fbfb4244ab946dcfe4762435',uuid=3b510aaa-49b1-43a9-aba4-fe1ee529b4fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a7981fb-647d-4610-9da2-3b162f366dfe", "address": "fa:16:3e:0c:e3:a3", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7981fb-64", "ovs_interfaceid": "2a7981fb-647d-4610-9da2-3b162f366dfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Converting VIF {"id": "2a7981fb-647d-4610-9da2-3b162f366dfe", "address": "fa:16:3e:0c:e3:a3", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7981fb-64", "ovs_interfaceid": "2a7981fb-647d-4610-9da2-3b162f366dfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:e3:a3,bridge_name='br-int',has_traffic_filtering=True,id=2a7981fb-647d-4610-9da2-3b162f366dfe,network=Network(f99d9e39-7a5f-481e-905f-4d5a4e920b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a7981fb-64') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG os_vif [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:e3:a3,bridge_name='br-int',has_traffic_filtering=True,id=2a7981fb-647d-4610-9da2-3b162f366dfe,network=Network(f99d9e39-7a5f-481e-905f-4d5a4e920b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a7981fb-64') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a7981fb-64, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:37:21 user nova-compute[231753]: INFO os_vif [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:e3:a3,bridge_name='br-int',has_traffic_filtering=True,id=2a7981fb-647d-4610-9da2-3b162f366dfe,network=Network(f99d9e39-7a5f-481e-905f-4d5a4e920b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a7981fb-64')
Jul 29 13:37:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rywvfqid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:37:21 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 29 13:37:21 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 21 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'iscsiadm -m discoverydb -o show -P 1' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: Exception during request[166d11f9-a828-49ab-b321-0f85d1862a35]: Unexpected error while running command.
Jul 29 13:37:21 user nova-compute[231753]: Command: iscsiadm -m discoverydb -o show -P 1
Jul 29 13:37:21 user nova-compute[231753]: Exit code: 21
Jul 29 13:37:21 user nova-compute[231753]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Jul 29 13:37:21 user nova-compute[231753]: Stderr: '' {{(pid=242780) _process_cmd /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:479}}
Jul 29 13:37:21 user nova-compute[231753]: Traceback (most recent call last):
Jul 29 13:37:21 user nova-compute[231753]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 476, in _process_cmd
Jul 29 13:37:21 user nova-compute[231753]:     ret = func(*f_args, **f_kwargs)
Jul 29 13:37:21 user nova-compute[231753]:   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 274, in _wrap
Jul 29 13:37:21 user nova-compute[231753]:     return func(*args, **kwargs)
Jul 29 13:37:21 user nova-compute[231753]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 197, in execute_root
Jul 29 13:37:21 user nova-compute[231753]:     return custom_execute(*cmd, shell=False, run_as_root=False, **kwargs)
Jul 29 13:37:21 user nova-compute[231753]:   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 145, in custom_execute
Jul 29 13:37:21 user nova-compute[231753]:     return putils.execute(on_execute=on_execute,
Jul 29 13:37:21 user nova-compute[231753]:   File "/usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py", line 438, in execute
Jul 29 13:37:21 user nova-compute[231753]:     raise ProcessExecutionError(exit_code=_returncode,
Jul 29 13:37:21 user nova-compute[231753]: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Jul 29 13:37:21 user nova-compute[231753]: Command: iscsiadm -m discoverydb -o show -P 1
Jul 29 13:37:21 user nova-compute[231753]: Exit code: 21
Jul 29 13:37:21 user nova-compute[231753]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Jul 29 13:37:21 user nova-compute[231753]: Stderr: ''
Jul 29 13:37:21 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[166d11f9-a828-49ab-b321-0f85d1862a35]: (5, 'oslo_concurrency.processutils.ProcessExecutionError', ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n', '', 21, 'iscsiadm -m discoverydb -o show -P 1', None)) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:21 user nova-compute[231753]: ERROR os_brick.initiator.connectors.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Exception encountered during portal discovery: oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Jul 29 13:37:21 user nova-compute[231753]: Command: iscsiadm -m discoverydb -o show -P 1
Jul 29 13:37:21 user nova-compute[231753]: Exit code: 21
Jul 29 13:37:21 user nova-compute[231753]: Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Jul 29 13:37:21 user nova-compute[231753]: Stderr: ''
Jul 29 13:37:21 user nova-compute[231753]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Jul 29 13:37:21 user nova-compute[231753]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/nova/nova/compute/manager.py", line 4115, in _do_rebuild_instance
Jul 29 13:37:21 user nova-compute[231753]: ERROR os_brick.initiator.connectors.iscsi     self.driver.rebuild(**kwargs)
Jul 29 13:37:21 user nova-compute[231753]: ERROR os_brick.initiator.connectors.iscsi   File "/opt/stack/nova/nova/virt/driver.py", line 378, in rebuild
Jul 29 13:37:21 user nova-compute[231753]: ERROR os_brick.initiator.connectors.iscsi     raise NotImplementedError()
Jul 29 13:37:21 user nova-compute[231753]: ERROR os_brick.initiator.connectors.iscsi NotImplementedError
Jul 29 13:37:21 user nova-compute[231753]: ERROR os_brick.initiator.connectors.iscsi 
Jul 29 13:37:21 user nova-compute[231753]: ERROR os_brick.initiator.connectors.iscsi During handling of the above exception, another exception occurred:
Jul 29 13:37:21 user nova-compute[231753]: ERROR os_brick.initiator.connectors.iscsi 
Jul 29 13:37:21 user nova-compute[231753]: ERROR os_brick.initiator.connectors.iscsi Traceback (most recent call last):
Jul 29 13:37:21 user nova-compute[231753]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 206, in _get_ips_iqns_luns
Jul 29 13:37:21 user nova-compute[231753]: ERROR os_brick.initiator.connectors.iscsi     ips_iqns_luns = method(connection_properties)
Jul 29 13:37:21 user nova-compute[231753]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 365, in _get_discoverydb_portals
Jul 29 13:37:21 user nova-compute[231753]: ERROR os_brick.initiator.connectors.iscsi     out = self._run_iscsiadm_bare(['-m', 'discoverydb',
Jul 29 13:37:21 user nova-compute[231753]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py", line 1177, in _run_iscsiadm_bare
Jul 29 13:37:21 user nova-compute[231753]: ERROR os_brick.initiator.connectors.iscsi     (out, err) = self._execute('iscsiadm',
Jul 29 13:37:21 user nova-compute[231753]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/executor.py", line 55, in _execute
Jul 29 13:37:21 user nova-compute[231753]: ERROR os_brick.initiator.connectors.iscsi     result = self.__execute(*args, **kwargs)
Jul 29 13:37:21 user nova-compute[231753]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py", line 172, in execute
Jul 29 13:37:21 user nova-compute[231753]: ERROR os_brick.initiator.connectors.iscsi     return execute_root(*cmd, **kwargs)
Jul 29 13:37:21 user nova-compute[231753]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/priv_context.py", line 271, in _wrap
Jul 29 13:37:21 user nova-compute[231753]: ERROR os_brick.initiator.connectors.iscsi     return self.channel.remote_call(name, args, kwargs,
Jul 29 13:37:21 user nova-compute[231753]: ERROR os_brick.initiator.connectors.iscsi   File "/usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py", line 215, in remote_call
Jul 29 13:37:21 user nova-compute[231753]: ERROR os_brick.initiator.connectors.iscsi     raise exc_type(*result[2])
Jul 29 13:37:21 user nova-compute[231753]: ERROR os_brick.initiator.connectors.iscsi oslo_concurrency.processutils.ProcessExecutionError: Unexpected error while running command.
Jul 29 13:37:21 user nova-compute[231753]: ERROR os_brick.initiator.connectors.iscsi Command: iscsiadm -m discoverydb -o show -P 1
Jul 29 13:37:21 user nova-compute[231753]: ERROR os_brick.initiator.connectors.iscsi Exit code: 21
Jul 29 13:37:21 user nova-compute[231753]: ERROR os_brick.initiator.connectors.iscsi Stdout: 'SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nNo targets found.\nFIRMWARE:\nNo targets found.\n'
Jul 29 13:37:21 user nova-compute[231753]: ERROR os_brick.initiator.connectors.iscsi Stderr: ''
Jul 29 13:37:21 user nova-compute[231753]: ERROR os_brick.initiator.connectors.iscsi 
Jul 29 13:37:21 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Skipping cleanup Unable to find target portal 172.16.0.220:3260. {{(pid=231753) _cleanup_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:923}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.042s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] <== disconnect_volume: return (44ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:37:21 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Deleting instance files /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb_del
Jul 29 13:37:21 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Deletion of /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb_del complete
Jul 29 13:37:21 user nova-compute[231753]: INFO nova.virt.block_device [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Booting with volume ff96d4b8-97db-4db7-821f-a3a64b4be6f7 at /dev/vdb
Jul 29 13:37:21 user nova-compute[231753]: DEBUG os_brick.utils [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cad882-08a2-43e9-bf26-aa43992fa6f6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:37:21 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Took 1.18 seconds to deallocate network for instance.
Jul 29 13:37:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[08614b01-2055-44e1-a6ec-8d16b99fb36d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG nova.compute.manager [req-b9f286f7-8bc1-4f75-94ae-95206e4c68e1 req-0fe814c1-dfb5-4910-8626-ee9fee25a229 service nova] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Received event network-vif-deleted-c6299ccb-7770-4eaf-8e2e-ecea8da9f324 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6a769d-708f-4840-9916-dd8960a5b3ae]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57d4f4b-ba5a-410b-946f-b923aa66cddb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-f49a6a96-946a-42a1-901a-0a747f8198bc tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-f49a6a96-946a-42a1-901a-0a747f8198bc tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:37:21 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:37:21 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[68c55826-b4f0-4e70-af25-d2a073ae50e2]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG os_brick.utils [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:37:21 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Updating existing volume attachment record: afb5ce33-97d9-46da-852b-e303a7298a6a {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG nova.network.neutron [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Updating instance_info_cache with network_info: [{"id": "fadc1466-5336-4230-b0f1-4fe4053f216a", "address": "fa:16:3e:df:12:9c", "network": {"id": "8897db8c-6e92-4b9e-b7ee-a69230eb07f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1596242231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a8a3e0bcef4bbc979ef187e4ed48cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc1466-53", "ovs_interfaceid": "fadc1466-5336-4230-b0f1-4fe4053f216a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Releasing lock "refresh_cache-63fad324-aac2-4d60-b4ce-a32a5736657d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG os_brick.utils [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-f49a6a96-946a-42a1-901a-0a747f8198bc tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3abbb0d7-67d6-4f57-bde9-11c913205bd5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-f49a6a96-946a-42a1-901a-0a747f8198bc tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c60337f3-3287-4289-83c9-8bdb6c5cd03c]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8758e66-20e2-43ce-934f-9558b9d28243]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-f49a6a96-946a-42a1-901a-0a747f8198bc tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.432s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[17cd0b33-8c1d-4244-a911-907f83593118]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:37:22 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-f49a6a96-946a-42a1-901a-0a747f8198bc tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Deleted allocations for instance b02ec16d-24a3-450d-858d-3ad302086ac3
Jul 29 13:37:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:37:22 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9844ecf6-8ddb-4aa7-98dd-6db5fddb536a]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG os_brick.utils [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] <== get_connector_properties: return (166ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-f49a6a96-946a-42a1-901a-0a747f8198bc tempest-TestVolumeSwap-2006247747 tempest-TestVolumeSwap-2006247747-project-member] Lock "b02ec16d-24a3-450d-858d-3ad302086ac3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.114s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a -F raw /opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/disk" returned: 0 in 3.090s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Ensure instance console log exists: /opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Start _get_guest_xml network_info=[{"id": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "address": "fa:16:3e:52:5c:6f", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd219916c-23", "ovs_interfaceid": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c6f733d2860e47667d149258d88fa5ff',container_format='bare',created_at=2023-07-29T13:35:10Z,direct_url=<?>,disk_format='qcow2',id=8a35de86-8711-45d3-a18a-d1010e6aa412,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1694184066-shelved',owner='d53ebbb5f2e440dfa0cf3950232b4853',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-29T13:35:16Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MxXsLgzw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attached', 'instance': '4475f276-acc4-44f1-a5fa-6a7fb2165493', 'attached_at': '', 'detached_at': '', 'volume_id': '0b2a5916-6c71-4b54-9944-8b2c623fcbb3', 'serial': '0b2a5916-6c71-4b54-9944-8b2c623fcbb3'}, 'guest_format': None, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '0cf8b73c-baac-44c6-9550-11bf230ed602', 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:37:22 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:37:22 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:37:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c6f733d2860e47667d149258d88fa5ff',container_format='bare',created_at=2023-07-29T13:35:10Z,direct_url=<?>,disk_format='qcow2',id=8a35de86-8711-45d3-a18a-d1010e6aa412,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1694184066-shelved',owner='d53ebbb5f2e440dfa0cf3950232b4853',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-29T13:35:16Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG nova.objects.instance [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lazy-loading 'vcpu_model' on Instance uuid 4475f276-acc4-44f1-a5fa-6a7fb2165493 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MxXsLgzw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:37:22 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:37:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:37:22 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:37:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:37:22 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:37:22 user nova-compute[231753]: DEBUG nova.compute.manager [req-f5a64ba2-7bd1-461f-aa81-5031cf67dfba req-1d8571ea-5a3d-4b91-b767-acea2af72a92 service nova] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Received event network-vif-plugged-c6299ccb-7770-4eaf-8e2e-ecea8da9f324 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-f5a64ba2-7bd1-461f-aa81-5031cf67dfba req-1d8571ea-5a3d-4b91-b767-acea2af72a92 service nova] Acquiring lock "b02ec16d-24a3-450d-858d-3ad302086ac3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-f5a64ba2-7bd1-461f-aa81-5031cf67dfba req-1d8571ea-5a3d-4b91-b767-acea2af72a92 service nova] Lock "b02ec16d-24a3-450d-858d-3ad302086ac3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-f5a64ba2-7bd1-461f-aa81-5031cf67dfba req-1d8571ea-5a3d-4b91-b767-acea2af72a92 service nova] Lock "b02ec16d-24a3-450d-858d-3ad302086ac3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG nova.compute.manager [req-f5a64ba2-7bd1-461f-aa81-5031cf67dfba req-1d8571ea-5a3d-4b91-b767-acea2af72a92 service nova] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] No waiting events found dispatching network-vif-plugged-c6299ccb-7770-4eaf-8e2e-ecea8da9f324 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:37:22 user nova-compute[231753]: WARNING nova.compute.manager [req-f5a64ba2-7bd1-461f-aa81-5031cf67dfba req-1d8571ea-5a3d-4b91-b767-acea2af72a92 service nova] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Received unexpected event network-vif-plugged-c6299ccb-7770-4eaf-8e2e-ecea8da9f324 for instance with vm_state deleted and task_state None.
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[250dc8b9-97c8-4cd9-a6a2-139d6507c5ab]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:37:22 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc958361-0419-4401-bf75-a964ea1d6ed1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3] added
Jul 29 13:37:22 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d0f0df-f94e-4fa0-b28f-e735ddf00188]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac8ac3eb-86c2-4834-b0ba-bc76a635a4e4]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MxXsLgzw {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v MxXsLgzw" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aeb7bac-e99c-4392-9632-95c3660fd076]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'MxXsLgzw'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.039s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[10948267-e1da-4efe-9062-4574a84552ef]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3328b690-cc3d-4421-9a5e-fa0160a1f2fe]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 29 13:37:22 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 29 13:37:22 user nova-compute[231753]:  {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:37:22 user nova-compute[231753]: WARNING os_brick.initiator.connectors.iscsi [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 29 13:37:22 user nova-compute[231753]: 
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 -p 172.16.0.220:3260 --login" returned: 0 in 0.047s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[73de51c9-d6a7-43de-babe-8abe213a26f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3, portal: 172.16.0.220,3260]
Jul 29 13:37:22 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3, portal: 172.16.0.220,3260] successful.
Jul 29 13:37:22 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.031s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c47d3bb-b7c5-4dab-8f45-61867eac6fa7]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8be7f291-574f-43d9-9c0f-8bf2a80899ba]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)
Jul 29 13:37:22 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)
Jul 29 13:37:22 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.319s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] HCTL ('33', '-', '-', 0) found on session 15 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:37:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:23 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c45a6942-b171-49ce-9212-d5745ba1a164]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:23 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Searching for a device in session 15 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:37:23 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MxXsLgzw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:37:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:37:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '26232333964633631', 'path': '/dev/sdb'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:37:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26232333964633631', 'path': '/dev/sdb'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:37:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-29T13:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1694184066',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1694184066',id=2,image_ref='8a35de86-8711-45d3-a18a-d1010e6aa412',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-991697156',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:33:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d53ebbb5f2e440dfa0cf3950232b4853',ramdisk_id='',reservation_id='r-k5ymi4kt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-460717858',owner_user_name='tempest-AttachVolumeShelveTestJSON-460717858-project-member',shelved_at='2023-07-29T13:35:16.290848',shelved_host='user',shelved_image_id='8a35de86-8711-45d3-a18a-d1010e6aa412'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:37:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='932b5bd757f94be29d52035fd9f70293',uuid=4475f276-acc4-44f1-a5fa-6a7fb2165493,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "address": "fa:16:3e:52:5c:6f", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd219916c-23", "ovs_interfaceid": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:37:24 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Converting VIF {"id": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "address": "fa:16:3e:52:5c:6f", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd219916c-23", "ovs_interfaceid": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:37:24 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:5c:6f,bridge_name='br-int',has_traffic_filtering=True,id=d219916c-23c3-4319-ad8e-9d04e9399ab7,network=Network(9be19067-cc29-4c67-95a0-cf37f95f9fc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd219916c-23') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:37:24 user nova-compute[231753]: DEBUG nova.objects.instance [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lazy-loading 'pci_devices' on Instance uuid 4475f276-acc4-44f1-a5fa-6a7fb2165493 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:37:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:37:24 user nova-compute[231753]:   <uuid>4475f276-acc4-44f1-a5fa-6a7fb2165493</uuid>
Jul 29 13:37:24 user nova-compute[231753]:   <name>instance-00000002</name>
Jul 29 13:37:24 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:37:24 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:37:24 user nova-compute[231753]:   <metadata>
Jul 29 13:37:24 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:37:24 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:37:24 user nova-compute[231753]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1694184066</nova:name>
Jul 29 13:37:24 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:37:22</nova:creationTime>
Jul 29 13:37:24 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:37:24 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:37:24 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:37:24 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:37:24 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:37:24 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:37:24 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:37:24 user nova-compute[231753]:       <nova:owner>
Jul 29 13:37:24 user nova-compute[231753]:         <nova:user uuid="932b5bd757f94be29d52035fd9f70293">tempest-AttachVolumeShelveTestJSON-460717858-project-member</nova:user>
Jul 29 13:37:24 user nova-compute[231753]:         <nova:project uuid="d53ebbb5f2e440dfa0cf3950232b4853">tempest-AttachVolumeShelveTestJSON-460717858</nova:project>
Jul 29 13:37:24 user nova-compute[231753]:       </nova:owner>
Jul 29 13:37:24 user nova-compute[231753]:       <nova:root type="image" uuid="8a35de86-8711-45d3-a18a-d1010e6aa412"/>
Jul 29 13:37:24 user nova-compute[231753]:       <nova:ports>
Jul 29 13:37:24 user nova-compute[231753]:         <nova:port uuid="d219916c-23c3-4319-ad8e-9d04e9399ab7">
Jul 29 13:37:24 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 29 13:37:24 user nova-compute[231753]:         </nova:port>
Jul 29 13:37:24 user nova-compute[231753]:       </nova:ports>
Jul 29 13:37:24 user nova-compute[231753]:     </nova:instance>
Jul 29 13:37:24 user nova-compute[231753]:   </metadata>
Jul 29 13:37:24 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:37:24 user nova-compute[231753]:     <system>
Jul 29 13:37:24 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:37:24 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:37:24 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:37:24 user nova-compute[231753]:       <entry name="serial">4475f276-acc4-44f1-a5fa-6a7fb2165493</entry>
Jul 29 13:37:24 user nova-compute[231753]:       <entry name="uuid">4475f276-acc4-44f1-a5fa-6a7fb2165493</entry>
Jul 29 13:37:24 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:37:24 user nova-compute[231753]:     </system>
Jul 29 13:37:24 user nova-compute[231753]:   </sysinfo>
Jul 29 13:37:24 user nova-compute[231753]:   <os>
Jul 29 13:37:24 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:37:24 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:37:24 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:37:24 user nova-compute[231753]:   </os>
Jul 29 13:37:24 user nova-compute[231753]:   <features>
Jul 29 13:37:24 user nova-compute[231753]:     <acpi/>
Jul 29 13:37:24 user nova-compute[231753]:     <apic/>
Jul 29 13:37:24 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:37:24 user nova-compute[231753]:   </features>
Jul 29 13:37:24 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:37:24 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:37:24 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:37:24 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:37:24 user nova-compute[231753]:   </clock>
Jul 29 13:37:24 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:37:24 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:37:24 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:37:24 user nova-compute[231753]:   </cpu>
Jul 29 13:37:24 user nova-compute[231753]:   <devices>
Jul 29 13:37:24 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:37:24 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:37:24 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/disk"/>
Jul 29 13:37:24 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:37:24 user nova-compute[231753]:     </disk>
Jul 29 13:37:24 user nova-compute[231753]:     <disk type="block" device="disk">
Jul 29 13:37:24 user nova-compute[231753]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:37:24 user nova-compute[231753]:       <source dev="/dev/sdb"/>
Jul 29 13:37:24 user nova-compute[231753]:       <target dev="vdc" bus="virtio"/>
Jul 29 13:37:24 user nova-compute[231753]:       <serial>0b2a5916-6c71-4b54-9944-8b2c623fcbb3</serial>
Jul 29 13:37:24 user nova-compute[231753]:     </disk>
Jul 29 13:37:24 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:37:24 user nova-compute[231753]:       <mac address="fa:16:3e:52:5c:6f"/>
Jul 29 13:37:24 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:37:24 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:37:24 user nova-compute[231753]:       <target dev="tapd219916c-23"/>
Jul 29 13:37:24 user nova-compute[231753]:     </interface>
Jul 29 13:37:24 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:37:24 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/console.log" append="off"/>
Jul 29 13:37:24 user nova-compute[231753]:     </serial>
Jul 29 13:37:24 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:37:24 user nova-compute[231753]:     <video>
Jul 29 13:37:24 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:37:24 user nova-compute[231753]:     </video>
Jul 29 13:37:24 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:37:24 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:37:24 user nova-compute[231753]:     </rng>
Jul 29 13:37:24 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:37:24 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:37:24 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:37:24 user nova-compute[231753]:     </memballoon>
Jul 29 13:37:24 user nova-compute[231753]:   </devices>
Jul 29 13:37:24 user nova-compute[231753]: </domain>
Jul 29 13:37:24 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:37:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-29T13:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1694184066',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1694184066',id=2,image_ref='8a35de86-8711-45d3-a18a-d1010e6aa412',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-991697156',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:33:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d53ebbb5f2e440dfa0cf3950232b4853',ramdisk_id='',reservation_id='r-k5ymi4kt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-460717858',owner_user_name='tempest-AttachVolumeShelveTestJSON-460717858-project-member',shelved_at='2023-07-29T13:35:16.290848',shelved_host='user',shelved_image_id='8a35de86-8711-45d3-a18a-d1010e6aa412'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:37:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='932b5bd757f94be29d52035fd9f70293',uuid=4475f276-acc4-44f1-a5fa-6a7fb2165493,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "address": "fa:16:3e:52:5c:6f", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd219916c-23", "ovs_interfaceid": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:37:24 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Converting VIF {"id": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "address": "fa:16:3e:52:5c:6f", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd219916c-23", "ovs_interfaceid": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:37:24 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:5c:6f,bridge_name='br-int',has_traffic_filtering=True,id=d219916c-23c3-4319-ad8e-9d04e9399ab7,network=Network(9be19067-cc29-4c67-95a0-cf37f95f9fc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd219916c-23') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:37:24 user nova-compute[231753]: DEBUG os_vif [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:5c:6f,bridge_name='br-int',has_traffic_filtering=True,id=d219916c-23c3-4319-ad8e-9d04e9399ab7,network=Network(9be19067-cc29-4c67-95a0-cf37f95f9fc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd219916c-23') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:37:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:37:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:37:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd219916c-23, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:37:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd219916c-23, col_values=(('external_ids', {'iface-id': 'd219916c-23c3-4319-ad8e-9d04e9399ab7', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:5c:6f', 'vm-uuid': '4475f276-acc4-44f1-a5fa-6a7fb2165493'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:37:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:37:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:24 user nova-compute[231753]: INFO os_vif [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:5c:6f,bridge_name='br-int',has_traffic_filtering=True,id=d219916c-23c3-4319-ad8e-9d04e9399ab7,network=Network(9be19067-cc29-4c67-95a0-cf37f95f9fc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd219916c-23')
Jul 29 13:37:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:37:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] No BDM found with device name vdc, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:37:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] No VIF found with MAC fa:16:3e:52:5c:6f, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:37:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:26 user nova-compute[231753]: DEBUG nova.compute.manager [req-b356d4f3-a424-440d-8c8f-75f4db38b475 req-15b35ef5-0782-4309-942f-4160896d50a4 service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Received event network-vif-plugged-d219916c-23c3-4319-ad8e-9d04e9399ab7 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:37:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b356d4f3-a424-440d-8c8f-75f4db38b475 req-15b35ef5-0782-4309-942f-4160896d50a4 service nova] Acquiring lock "4475f276-acc4-44f1-a5fa-6a7fb2165493-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b356d4f3-a424-440d-8c8f-75f4db38b475 req-15b35ef5-0782-4309-942f-4160896d50a4 service nova] Lock "4475f276-acc4-44f1-a5fa-6a7fb2165493-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b356d4f3-a424-440d-8c8f-75f4db38b475 req-15b35ef5-0782-4309-942f-4160896d50a4 service nova] Lock "4475f276-acc4-44f1-a5fa-6a7fb2165493-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:26 user nova-compute[231753]: DEBUG nova.compute.manager [req-b356d4f3-a424-440d-8c8f-75f4db38b475 req-15b35ef5-0782-4309-942f-4160896d50a4 service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] No waiting events found dispatching network-vif-plugged-d219916c-23c3-4319-ad8e-9d04e9399ab7 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:37:26 user nova-compute[231753]: WARNING nova.compute.manager [req-b356d4f3-a424-440d-8c8f-75f4db38b475 req-15b35ef5-0782-4309-942f-4160896d50a4 service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Received unexpected event network-vif-plugged-d219916c-23c3-4319-ad8e-9d04e9399ab7 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 29 13:37:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:27 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637847.8982735, 4475f276-acc4-44f1-a5fa-6a7fb2165493 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:37:27 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] VM Resumed (Lifecycle Event)
Jul 29 13:37:27 user nova-compute[231753]: DEBUG nova.compute.manager [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:37:27 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:37:27 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Instance spawned successfully.
Jul 29 13:37:27 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:37:27 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:37:27 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:37:27 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637847.9025736, 4475f276-acc4-44f1-a5fa-6a7fb2165493 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:37:27 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] VM Started (Lifecycle Event)
Jul 29 13:37:27 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:37:27 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:37:27 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:37:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:28 user nova-compute[231753]: DEBUG nova.compute.manager [req-748ebb1e-2de0-4b42-90a0-0c5fd955c307 req-af5f65bc-b2ce-4a18-83f4-1314589db8d0 service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Received event network-vif-plugged-d219916c-23c3-4319-ad8e-9d04e9399ab7 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:37:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-748ebb1e-2de0-4b42-90a0-0c5fd955c307 req-af5f65bc-b2ce-4a18-83f4-1314589db8d0 service nova] Acquiring lock "4475f276-acc4-44f1-a5fa-6a7fb2165493-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-748ebb1e-2de0-4b42-90a0-0c5fd955c307 req-af5f65bc-b2ce-4a18-83f4-1314589db8d0 service nova] Lock "4475f276-acc4-44f1-a5fa-6a7fb2165493-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-748ebb1e-2de0-4b42-90a0-0c5fd955c307 req-af5f65bc-b2ce-4a18-83f4-1314589db8d0 service nova] Lock "4475f276-acc4-44f1-a5fa-6a7fb2165493-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:28 user nova-compute[231753]: DEBUG nova.compute.manager [req-748ebb1e-2de0-4b42-90a0-0c5fd955c307 req-af5f65bc-b2ce-4a18-83f4-1314589db8d0 service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] No waiting events found dispatching network-vif-plugged-d219916c-23c3-4319-ad8e-9d04e9399ab7 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:37:28 user nova-compute[231753]: WARNING nova.compute.manager [req-748ebb1e-2de0-4b42-90a0-0c5fd955c307 req-af5f65bc-b2ce-4a18-83f4-1314589db8d0 service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Received unexpected event network-vif-plugged-d219916c-23c3-4319-ad8e-9d04e9399ab7 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 29 13:37:28 user nova-compute[231753]: DEBUG nova.compute.manager [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:37:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d2c9ac9c-7820-4d3f-a6d5-3a4e6f5d5d78 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "4475f276-acc4-44f1-a5fa-6a7fb2165493" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 23.607s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:37:29 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Creating image(s)
Jul 29 13:37:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "/opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "/opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "/opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.154s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.167s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk 1073741824" returned: 0 in 0.054s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.226s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Starting finish_migration {{(pid=231753) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Instance directory exists: not creating {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 29 13:37:30 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Creating image(s)
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.objects.instance [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lazy-loading 'trusted_certs' on Instance uuid 63fad324-aac2-4d60-b4ce-a32a5736657d {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.147s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.147s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Checking if we can resize image /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk. size=21474836480 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Cannot resize image /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Ensure instance console log exists: /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Start _get_guest_xml network_info=[{"id": "2a7981fb-647d-4610-9da2-3b162f366dfe", "address": "fa:16:3e:0c:e3:a3", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7981fb-64", "ovs_interfaceid": "2a7981fb-647d-4610-9da2-3b162f366dfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rywvfqid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '3b510aaa-49b1-43a9-aba4-fe1ee529b4fb', 'attached_at': '', 'detached_at': '', 'volume_id': 'ff96d4b8-97db-4db7-821f-a3a64b4be6f7', 'serial': 'ff96d4b8-97db-4db7-821f-a3a64b4be6f7'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': 'afb5ce33-97d9-46da-852b-e303a7298a6a', 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:37:30 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 29 13:37:30 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.objects.instance [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rywvfqid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:37:30 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 29 13:37:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:37:30 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 29 13:37:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:37:30 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690637835.5179794, 63fad324-aac2-4d60-b4ce-a32a5736657d => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:37:30 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] VM Stopped (Lifecycle Event)
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Running cmd (subprocess): qemu-img resize /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk 21474836480 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d271979-2226-4fb0-9b65-a73de7de045e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:37:30 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.compute.manager [None req-39884713-33e0-45af-8039-6781aa4a1874 None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.compute.manager [None req-39884713-33e0-45af-8039-6781aa4a1874 None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e209b76-0591-42a6-a6e3-45d6f6b0d0ab]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7] added
Jul 29 13:37:30 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:30 user nova-compute[231753]: INFO nova.compute.manager [None req-39884713-33e0-45af-8039-6781aa4a1874 None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2e93b6d-c2f3-4af3-aeea-59082218985d]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] CMD "qemu-img resize /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk 21474836480" returned: 0 in 0.102s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Did not create local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Ensure instance console log exists: /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Start _get_guest_xml network_info=[{"id": "fadc1466-5336-4230-b0f1-4fe4053f216a", "address": "fa:16:3e:df:12:9c", "network": {"id": "8897db8c-6e92-4b9e-b7ee-a69230eb07f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1596242231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1596242231-network", "vif_mac": "fa:16:3e:df:12:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a8a3e0bcef4bbc979ef187e4ed48cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc1466-53", "ovs_interfaceid": "fadc1466-5336-4230-b0f1-4fe4053f216a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HxbMradf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '63fad324-aac2-4d60-b4ce-a32a5736657d', 'attached_at': '2023-07-29T13:37:30.000000', 'detached_at': '', 'volume_id': 'a62778d4-32b0-41ef-b7df-716d38fbcba4', 'serial': 'a62778d4-32b0-41ef-b7df-716d38fbcba4'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '6d7d7b49-5113-4f2f-9688-8d3a05e27f95', 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.105s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a628c342-a37e-4446-92cf-e2a1e38d06e3]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rywvfqid {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:30 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:37:30 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rywvfqid" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.objects.instance [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lazy-loading 'vcpu_model' on Instance uuid 63fad324-aac2-4d60-b4ce-a32a5736657d {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e41e9bad-bb6d-48a3-bbfd-827d4bfdefcc]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rywvfqid'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HxbMradf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:37:30 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:37:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[23f3c489-8366-4078-a809-5455728626fc]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffdf4f49-00bb-47ea-a4cd-63242b9cf873]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)
Jul 29 13:37:30 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)
Jul 29 13:37:30 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --login" returned: 0 in 0.059s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[080d7666-6e84-43ec-85d1-83d3cdf0a2e1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7, portal: 172.16.0.220,3260]
Jul 29 13:37:30 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7, portal: 172.16.0.220,3260] successful.
Jul 29 13:37:30 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c37c8a-21c2-4f5d-9bb3-080ae0c1cc96]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddeaf68c-c32c-496e-ade1-51eb51311191]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)
Jul 29 13:37:30 user nova-compute[231753]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:37:30 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)
Jul 29 13:37:30 user nova-compute[231753]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:37:30 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.451s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] HCTL ('34', '-', '-', 0) found on session 16 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:31 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b588dc02-fc3b-4490-bf52-367b028c318a]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:31 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: None {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Searching for a device in session 16 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rywvfqid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.484s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] <== connect_volume: return (1485ms) {'type': 'block', 'scsi_wwn': '26366653338663166', 'path': '/dev/sdc'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26366653338663166', 'path': '/dev/sdc'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.189s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:37:32 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:37:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:37:32 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:37:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-29T13:33:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1236712368',display_name='tempest-ServerActionsTestOtherA-server-259014365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1236712368',id=3,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuWQgyAL1ZhtINiMb8bBadRX1/6ZehT6zfTT2DNFW6eh8iXvfW0Pq6raR1PDnzRXJlqkmjwTrVF+AwsdLN+yPf0k+X1yx9QfVmcJaO2ivlK/Orc5S8LFrDXUE7UuYGgdQ==',key_name='tempest-keypair-820646002',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:33:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='afff9d3d250643c58da9bc5cf5756d1e',ramdisk_id='',reservation_id='r-8q0q0qkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1666416634',owner_user_name='tempest-ServerActionsTestOtherA-1666416634-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:37:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='748938c3fbfb4244ab946dcfe4762435',uuid=3b510aaa-49b1-43a9-aba4-fe1ee529b4fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a7981fb-647d-4610-9da2-3b162f366dfe", "address": "fa:16:3e:0c:e3:a3", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7981fb-64", "ovs_interfaceid": "2a7981fb-647d-4610-9da2-3b162f366dfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Converting VIF {"id": "2a7981fb-647d-4610-9da2-3b162f366dfe", "address": "fa:16:3e:0c:e3:a3", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7981fb-64", "ovs_interfaceid": "2a7981fb-647d-4610-9da2-3b162f366dfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:e3:a3,bridge_name='br-int',has_traffic_filtering=True,id=2a7981fb-647d-4610-9da2-3b162f366dfe,network=Network(f99d9e39-7a5f-481e-905f-4d5a4e920b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a7981fb-64') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:37:32 user nova-compute[231753]:   <uuid>3b510aaa-49b1-43a9-aba4-fe1ee529b4fb</uuid>
Jul 29 13:37:32 user nova-compute[231753]:   <name>instance-00000003</name>
Jul 29 13:37:32 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:37:32 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:37:32 user nova-compute[231753]:   <metadata>
Jul 29 13:37:32 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:37:32 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:37:32 user nova-compute[231753]:       <nova:name>tempest-ServerActionsTestOtherA-server-259014365</nova:name>
Jul 29 13:37:32 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:37:30</nova:creationTime>
Jul 29 13:37:32 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:37:32 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:37:32 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:37:32 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:37:32 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:37:32 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:37:32 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:37:32 user nova-compute[231753]:       <nova:owner>
Jul 29 13:37:32 user nova-compute[231753]:         <nova:user uuid="748938c3fbfb4244ab946dcfe4762435">tempest-ServerActionsTestOtherA-1666416634-project-member</nova:user>
Jul 29 13:37:32 user nova-compute[231753]:         <nova:project uuid="afff9d3d250643c58da9bc5cf5756d1e">tempest-ServerActionsTestOtherA-1666416634</nova:project>
Jul 29 13:37:32 user nova-compute[231753]:       </nova:owner>
Jul 29 13:37:32 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:37:32 user nova-compute[231753]:       <nova:ports>
Jul 29 13:37:32 user nova-compute[231753]:         <nova:port uuid="2a7981fb-647d-4610-9da2-3b162f366dfe">
Jul 29 13:37:32 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 29 13:37:32 user nova-compute[231753]:         </nova:port>
Jul 29 13:37:32 user nova-compute[231753]:       </nova:ports>
Jul 29 13:37:32 user nova-compute[231753]:     </nova:instance>
Jul 29 13:37:32 user nova-compute[231753]:   </metadata>
Jul 29 13:37:32 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:37:32 user nova-compute[231753]:     <system>
Jul 29 13:37:32 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:37:32 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:37:32 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:37:32 user nova-compute[231753]:       <entry name="serial">3b510aaa-49b1-43a9-aba4-fe1ee529b4fb</entry>
Jul 29 13:37:32 user nova-compute[231753]:       <entry name="uuid">3b510aaa-49b1-43a9-aba4-fe1ee529b4fb</entry>
Jul 29 13:37:32 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:37:32 user nova-compute[231753]:     </system>
Jul 29 13:37:32 user nova-compute[231753]:   </sysinfo>
Jul 29 13:37:32 user nova-compute[231753]:   <os>
Jul 29 13:37:32 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:37:32 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:37:32 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:37:32 user nova-compute[231753]:   </os>
Jul 29 13:37:32 user nova-compute[231753]:   <features>
Jul 29 13:37:32 user nova-compute[231753]:     <acpi/>
Jul 29 13:37:32 user nova-compute[231753]:     <apic/>
Jul 29 13:37:32 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:37:32 user nova-compute[231753]:   </features>
Jul 29 13:37:32 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:37:32 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:37:32 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:37:32 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:37:32 user nova-compute[231753]:   </clock>
Jul 29 13:37:32 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:37:32 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:37:32 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:37:32 user nova-compute[231753]:   </cpu>
Jul 29 13:37:32 user nova-compute[231753]:   <devices>
Jul 29 13:37:32 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:37:32 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:37:32 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk"/>
Jul 29 13:37:32 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:37:32 user nova-compute[231753]:     </disk>
Jul 29 13:37:32 user nova-compute[231753]:     <disk type="block" device="disk">
Jul 29 13:37:32 user nova-compute[231753]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:37:32 user nova-compute[231753]:       <source dev="/dev/sdc"/>
Jul 29 13:37:32 user nova-compute[231753]:       <target dev="vdb" bus="virtio"/>
Jul 29 13:37:32 user nova-compute[231753]:       <serial>ff96d4b8-97db-4db7-821f-a3a64b4be6f7</serial>
Jul 29 13:37:32 user nova-compute[231753]:     </disk>
Jul 29 13:37:32 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:37:32 user nova-compute[231753]:       <mac address="fa:16:3e:0c:e3:a3"/>
Jul 29 13:37:32 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:37:32 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:37:32 user nova-compute[231753]:       <target dev="tap2a7981fb-64"/>
Jul 29 13:37:32 user nova-compute[231753]:     </interface>
Jul 29 13:37:32 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:37:32 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/console.log" append="off"/>
Jul 29 13:37:32 user nova-compute[231753]:     </serial>
Jul 29 13:37:32 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:37:32 user nova-compute[231753]:     <video>
Jul 29 13:37:32 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:37:32 user nova-compute[231753]:     </video>
Jul 29 13:37:32 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:37:32 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:37:32 user nova-compute[231753]:     </rng>
Jul 29 13:37:32 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:37:32 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:37:32 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:37:32 user nova-compute[231753]:     </memballoon>
Jul 29 13:37:32 user nova-compute[231753]:   </devices>
Jul 29 13:37:32 user nova-compute[231753]: </domain>
Jul 29 13:37:32 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-29T13:33:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1236712368',display_name='tempest-ServerActionsTestOtherA-server-259014365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1236712368',id=3,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuWQgyAL1ZhtINiMb8bBadRX1/6ZehT6zfTT2DNFW6eh8iXvfW0Pq6raR1PDnzRXJlqkmjwTrVF+AwsdLN+yPf0k+X1yx9QfVmcJaO2ivlK/Orc5S8LFrDXUE7UuYGgdQ==',key_name='tempest-keypair-820646002',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:33:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='afff9d3d250643c58da9bc5cf5756d1e',ramdisk_id='',reservation_id='r-8q0q0qkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1666416634',owner_user_name='tempest-ServerActionsTestOtherA-1666416634-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:37:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='748938c3fbfb4244ab946dcfe4762435',uuid=3b510aaa-49b1-43a9-aba4-fe1ee529b4fb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a7981fb-647d-4610-9da2-3b162f366dfe", "address": "fa:16:3e:0c:e3:a3", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7981fb-64", "ovs_interfaceid": "2a7981fb-647d-4610-9da2-3b162f366dfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Converting VIF {"id": "2a7981fb-647d-4610-9da2-3b162f366dfe", "address": "fa:16:3e:0c:e3:a3", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7981fb-64", "ovs_interfaceid": "2a7981fb-647d-4610-9da2-3b162f366dfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:e3:a3,bridge_name='br-int',has_traffic_filtering=True,id=2a7981fb-647d-4610-9da2-3b162f366dfe,network=Network(f99d9e39-7a5f-481e-905f-4d5a4e920b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a7981fb-64') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG os_vif [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:e3:a3,bridge_name='br-int',has_traffic_filtering=True,id=2a7981fb-647d-4610-9da2-3b162f366dfe,network=Network(f99d9e39-7a5f-481e-905f-4d5a4e920b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a7981fb-64') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a281f473-c39b-45af-9b6a-4fcf327374fd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:37:32 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2a7981fb-64, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2a7981fb-64, col_values=(('external_ids', {'iface-id': '2a7981fb-647d-4610-9da2-3b162f366dfe', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0c:e3:a3', 'vm-uuid': '3b510aaa-49b1-43a9-aba4-fe1ee529b4fb'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:32 user nova-compute[231753]: INFO os_vif [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:e3:a3,bridge_name='br-int',has_traffic_filtering=True,id=2a7981fb-647d-4610-9da2-3b162f366dfe,network=Network(f99d9e39-7a5f-481e-905f-4d5a4e920b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a7981fb-64')
Jul 29 13:37:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b989ca-4cb3-4be8-9adb-f79e6c805f84]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4] added
Jul 29 13:37:32 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7099ec-0919-44c5-8593-d3d4d2fe3289]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f334d4f-abc0-40bf-afa6-58b8cf927c95]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HxbMradf {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] No BDM found with device name vdb, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] No VIF found with MAC fa:16:3e:0c:e3:a3, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HxbMradf" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[da686f84-63e9-4244-9e27-0dee6cd80d10]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HxbMradf'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[88ed814c-a3e4-4d47-a2d7-69bc859d13c3]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[148f1c1a-4867-4f89-a719-7d2951272e61]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)
Jul 29 13:37:32 user nova-compute[231753]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:37:32 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)
Jul 29 13:37:32 user nova-compute[231753]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:37:32 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --login" returned: 0 in 0.130s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e34a49f-caa7-434d-9a13-e8e906a8f51b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4, portal: 172.16.0.220,3260]
Jul 29 13:37:32 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4, portal: 172.16.0.220,3260] successful.
Jul 29 13:37:32 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[27bd4094-bf2c-4d4b-9d3d-516639c548b9]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2e61ba-7d9b-4463-b872-0218d977753e]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)
Jul 29 13:37:32 user nova-compute[231753]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:37:32 user nova-compute[231753]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:37:32 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)
Jul 29 13:37:32 user nova-compute[231753]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:37:32 user nova-compute[231753]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:37:32 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.389s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] HCTL ('35', '-', '-', 0) found on session 17 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a5e30c-da5b-4785-b9a1-3cfd66e85210]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Searching for a device in session 17 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:37:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HxbMradf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:37:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.425s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:37:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] <== connect_volume: return (2613ms) {'type': 'block', 'scsi_wwn': '23430363036643831', 'path': '/dev/sdd'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:37:33 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430363036643831', 'path': '/dev/sdd'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:37:33 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:33:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-800445599',display_name='tempest-ServerActionsTestOtherB-server-800445599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-800445599',id=1,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK3mwTAZBOJzlYUFtbhzSHDzTYFwqvVO3PSQcWrwJtS4OLSJuALDnCfY5kQP9dq+tAP99lu02YS+c2OW9ZUPQROMcosGuWuOlguzRCIeVSykNGGMYttb7ShY1vz/IoqmQ==',key_name='tempest-keypair-1690887276',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:33:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='74a8a3e0bcef4bbc979ef187e4ed48cc',ramdisk_id='',reservation_id='r-zypim8f0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1624737976',owner_user_name='tempest-ServerActionsTestOtherB-1624737976-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:37:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7361505253f84cf28c8688caf4a0cd16',uuid=63fad324-aac2-4d60-b4ce-a32a5736657d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fadc1466-5336-4230-b0f1-4fe4053f216a", "address": "fa:16:3e:df:12:9c", "network": {"id": "8897db8c-6e92-4b9e-b7ee-a69230eb07f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1596242231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1596242231-network", "vif_mac": "fa:16:3e:df:12:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a8a3e0bcef4bbc979ef187e4ed48cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc1466-53", "ovs_interfaceid": "fadc1466-5336-4230-b0f1-4fe4053f216a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:37:33 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Converting VIF {"id": "fadc1466-5336-4230-b0f1-4fe4053f216a", "address": "fa:16:3e:df:12:9c", "network": {"id": "8897db8c-6e92-4b9e-b7ee-a69230eb07f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1596242231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1596242231-network", "vif_mac": "fa:16:3e:df:12:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a8a3e0bcef4bbc979ef187e4ed48cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc1466-53", "ovs_interfaceid": "fadc1466-5336-4230-b0f1-4fe4053f216a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:37:33 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:12:9c,bridge_name='br-int',has_traffic_filtering=True,id=fadc1466-5336-4230-b0f1-4fe4053f216a,network=Network(8897db8c-6e92-4b9e-b7ee-a69230eb07f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfadc1466-53') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:37:33 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:37:33 user nova-compute[231753]:   <uuid>63fad324-aac2-4d60-b4ce-a32a5736657d</uuid>
Jul 29 13:37:33 user nova-compute[231753]:   <name>instance-00000001</name>
Jul 29 13:37:33 user nova-compute[231753]:   <memory>2097152</memory>
Jul 29 13:37:33 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:37:33 user nova-compute[231753]:   <metadata>
Jul 29 13:37:33 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:37:33 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:37:33 user nova-compute[231753]:       <nova:name>tempest-ServerActionsTestOtherB-server-800445599</nova:name>
Jul 29 13:37:33 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:37:30</nova:creationTime>
Jul 29 13:37:33 user nova-compute[231753]:       <nova:flavor name="m1.small">
Jul 29 13:37:33 user nova-compute[231753]:         <nova:memory>2048</nova:memory>
Jul 29 13:37:33 user nova-compute[231753]:         <nova:disk>20</nova:disk>
Jul 29 13:37:33 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:37:33 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:37:33 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:37:33 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:37:33 user nova-compute[231753]:       <nova:owner>
Jul 29 13:37:33 user nova-compute[231753]:         <nova:user uuid="7361505253f84cf28c8688caf4a0cd16">tempest-ServerActionsTestOtherB-1624737976-project-member</nova:user>
Jul 29 13:37:33 user nova-compute[231753]:         <nova:project uuid="74a8a3e0bcef4bbc979ef187e4ed48cc">tempest-ServerActionsTestOtherB-1624737976</nova:project>
Jul 29 13:37:33 user nova-compute[231753]:       </nova:owner>
Jul 29 13:37:33 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:37:33 user nova-compute[231753]:       <nova:ports>
Jul 29 13:37:33 user nova-compute[231753]:         <nova:port uuid="fadc1466-5336-4230-b0f1-4fe4053f216a">
Jul 29 13:37:33 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 29 13:37:33 user nova-compute[231753]:         </nova:port>
Jul 29 13:37:33 user nova-compute[231753]:       </nova:ports>
Jul 29 13:37:33 user nova-compute[231753]:     </nova:instance>
Jul 29 13:37:33 user nova-compute[231753]:   </metadata>
Jul 29 13:37:33 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:37:33 user nova-compute[231753]:     <system>
Jul 29 13:37:33 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:37:33 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:37:33 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:37:33 user nova-compute[231753]:       <entry name="serial">63fad324-aac2-4d60-b4ce-a32a5736657d</entry>
Jul 29 13:37:33 user nova-compute[231753]:       <entry name="uuid">63fad324-aac2-4d60-b4ce-a32a5736657d</entry>
Jul 29 13:37:33 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:37:33 user nova-compute[231753]:     </system>
Jul 29 13:37:33 user nova-compute[231753]:   </sysinfo>
Jul 29 13:37:33 user nova-compute[231753]:   <os>
Jul 29 13:37:33 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:37:33 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:37:33 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:37:33 user nova-compute[231753]:   </os>
Jul 29 13:37:33 user nova-compute[231753]:   <features>
Jul 29 13:37:33 user nova-compute[231753]:     <acpi/>
Jul 29 13:37:33 user nova-compute[231753]:     <apic/>
Jul 29 13:37:33 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:37:33 user nova-compute[231753]:   </features>
Jul 29 13:37:33 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:37:33 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:37:33 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:37:33 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:37:33 user nova-compute[231753]:   </clock>
Jul 29 13:37:33 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:37:33 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:37:33 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:37:33 user nova-compute[231753]:   </cpu>
Jul 29 13:37:33 user nova-compute[231753]:   <devices>
Jul 29 13:37:33 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:37:33 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:37:33 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk"/>
Jul 29 13:37:33 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:37:33 user nova-compute[231753]:     </disk>
Jul 29 13:37:33 user nova-compute[231753]:     <disk type="block" device="disk">
Jul 29 13:37:33 user nova-compute[231753]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:37:33 user nova-compute[231753]:       <source dev="/dev/sdd"/>
Jul 29 13:37:33 user nova-compute[231753]:       <target dev="vdb" bus="virtio"/>
Jul 29 13:37:33 user nova-compute[231753]:       <serial>a62778d4-32b0-41ef-b7df-716d38fbcba4</serial>
Jul 29 13:37:33 user nova-compute[231753]:     </disk>
Jul 29 13:37:33 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:37:33 user nova-compute[231753]:       <mac address="fa:16:3e:df:12:9c"/>
Jul 29 13:37:33 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:37:33 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:37:33 user nova-compute[231753]:       <target dev="tapfadc1466-53"/>
Jul 29 13:37:33 user nova-compute[231753]:     </interface>
Jul 29 13:37:33 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:37:33 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/console.log" append="off"/>
Jul 29 13:37:33 user nova-compute[231753]:     </serial>
Jul 29 13:37:33 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:37:33 user nova-compute[231753]:     <video>
Jul 29 13:37:33 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:37:33 user nova-compute[231753]:     </video>
Jul 29 13:37:33 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:37:33 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:37:33 user nova-compute[231753]:     </rng>
Jul 29 13:37:33 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:37:33 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:37:33 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:37:33 user nova-compute[231753]:     </memballoon>
Jul 29 13:37:33 user nova-compute[231753]:   </devices>
Jul 29 13:37:33 user nova-compute[231753]: </domain>
Jul 29 13:37:33 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:37:33 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:33:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-800445599',display_name='tempest-ServerActionsTestOtherB-server-800445599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-800445599',id=1,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK3mwTAZBOJzlYUFtbhzSHDzTYFwqvVO3PSQcWrwJtS4OLSJuALDnCfY5kQP9dq+tAP99lu02YS+c2OW9ZUPQROMcosGuWuOlguzRCIeVSykNGGMYttb7ShY1vz/IoqmQ==',key_name='tempest-keypair-1690887276',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:33:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='74a8a3e0bcef4bbc979ef187e4ed48cc',ramdisk_id='',reservation_id='r-zypim8f0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1624737976',owner_user_name='tempest-ServerActionsTestOtherB-1624737976-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:37:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7361505253f84cf28c8688caf4a0cd16',uuid=63fad324-aac2-4d60-b4ce-a32a5736657d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fadc1466-5336-4230-b0f1-4fe4053f216a", "address": "fa:16:3e:df:12:9c", "network": {"id": "8897db8c-6e92-4b9e-b7ee-a69230eb07f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1596242231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1596242231-network", "vif_mac": "fa:16:3e:df:12:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a8a3e0bcef4bbc979ef187e4ed48cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc1466-53", "ovs_interfaceid": "fadc1466-5336-4230-b0f1-4fe4053f216a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:37:33 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Converting VIF {"id": "fadc1466-5336-4230-b0f1-4fe4053f216a", "address": "fa:16:3e:df:12:9c", "network": {"id": "8897db8c-6e92-4b9e-b7ee-a69230eb07f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1596242231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1596242231-network", "vif_mac": "fa:16:3e:df:12:9c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a8a3e0bcef4bbc979ef187e4ed48cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc1466-53", "ovs_interfaceid": "fadc1466-5336-4230-b0f1-4fe4053f216a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:37:33 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:12:9c,bridge_name='br-int',has_traffic_filtering=True,id=fadc1466-5336-4230-b0f1-4fe4053f216a,network=Network(8897db8c-6e92-4b9e-b7ee-a69230eb07f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfadc1466-53') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:37:33 user nova-compute[231753]: DEBUG os_vif [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:12:9c,bridge_name='br-int',has_traffic_filtering=True,id=fadc1466-5336-4230-b0f1-4fe4053f216a,network=Network(8897db8c-6e92-4b9e-b7ee-a69230eb07f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfadc1466-53') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:37:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:37:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:37:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfadc1466-53, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:37:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfadc1466-53, col_values=(('external_ids', {'iface-id': 'fadc1466-5336-4230-b0f1-4fe4053f216a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:12:9c', 'vm-uuid': '63fad324-aac2-4d60-b4ce-a32a5736657d'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:37:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:37:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:33 user nova-compute[231753]: INFO os_vif [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:12:9c,bridge_name='br-int',has_traffic_filtering=True,id=fadc1466-5336-4230-b0f1-4fe4053f216a,network=Network(8897db8c-6e92-4b9e-b7ee-a69230eb07f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfadc1466-53')
Jul 29 13:37:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:33 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:37:33 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] No BDM found with device name vdb, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:37:33 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] No VIF found with MAC fa:16:3e:df:12:9c, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:37:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:33 user nova-compute[231753]: DEBUG nova.compute.manager [req-0e26055e-3e48-4918-b194-40a12374d3dd req-c80defac-653e-4c33-a65a-195490e609d5 service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Received event network-vif-plugged-2a7981fb-647d-4610-9da2-3b162f366dfe {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:37:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0e26055e-3e48-4918-b194-40a12374d3dd req-c80defac-653e-4c33-a65a-195490e609d5 service nova] Acquiring lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0e26055e-3e48-4918-b194-40a12374d3dd req-c80defac-653e-4c33-a65a-195490e609d5 service nova] Lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0e26055e-3e48-4918-b194-40a12374d3dd req-c80defac-653e-4c33-a65a-195490e609d5 service nova] Lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:33 user nova-compute[231753]: DEBUG nova.compute.manager [req-0e26055e-3e48-4918-b194-40a12374d3dd req-c80defac-653e-4c33-a65a-195490e609d5 service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] No waiting events found dispatching network-vif-plugged-2a7981fb-647d-4610-9da2-3b162f366dfe {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:37:33 user nova-compute[231753]: WARNING nova.compute.manager [req-0e26055e-3e48-4918-b194-40a12374d3dd req-c80defac-653e-4c33-a65a-195490e609d5 service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Received unexpected event network-vif-plugged-2a7981fb-647d-4610-9da2-3b162f366dfe for instance with vm_state active and task_state rebuild_spawning.
Jul 29 13:37:34 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690637839.0486863, 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:37:34 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] VM Stopped (Lifecycle Event)
Jul 29 13:37:34 user nova-compute[231753]: DEBUG nova.compute.manager [None req-1abc2f11-f5cc-40d0-959f-708b7e4914e0 None None] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:37:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:35 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690637840.466427, b02ec16d-24a3-450d-858d-3ad302086ac3 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:37:35 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] VM Stopped (Lifecycle Event)
Jul 29 13:37:35 user nova-compute[231753]: DEBUG nova.compute.manager [None req-5ed68ee8-ad84-49b0-af10-1639221c87e7 None None] [instance: b02ec16d-24a3-450d-858d-3ad302086ac3] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:37:35 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:35 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:35 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:35 user nova-compute[231753]: DEBUG nova.compute.manager [req-36f67b99-2379-4a60-a072-ee0490a39eec req-9a86d058-9f80-4a87-977c-e743f755184e service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Received event network-vif-plugged-2a7981fb-647d-4610-9da2-3b162f366dfe {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:37:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-36f67b99-2379-4a60-a072-ee0490a39eec req-9a86d058-9f80-4a87-977c-e743f755184e service nova] Acquiring lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-36f67b99-2379-4a60-a072-ee0490a39eec req-9a86d058-9f80-4a87-977c-e743f755184e service nova] Lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-36f67b99-2379-4a60-a072-ee0490a39eec req-9a86d058-9f80-4a87-977c-e743f755184e service nova] Lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:35 user nova-compute[231753]: DEBUG nova.compute.manager [req-36f67b99-2379-4a60-a072-ee0490a39eec req-9a86d058-9f80-4a87-977c-e743f755184e service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] No waiting events found dispatching network-vif-plugged-2a7981fb-647d-4610-9da2-3b162f366dfe {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:37:35 user nova-compute[231753]: WARNING nova.compute.manager [req-36f67b99-2379-4a60-a072-ee0490a39eec req-9a86d058-9f80-4a87-977c-e743f755184e service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Received unexpected event network-vif-plugged-2a7981fb-647d-4610-9da2-3b162f366dfe for instance with vm_state active and task_state rebuild_spawning.
Jul 29 13:37:36 user nova-compute[231753]: DEBUG nova.compute.manager [req-3f812b77-a473-4a8a-ab0e-5ec4a9c113bc req-d8ad04be-c764-4d16-b4ee-1ef3392a4c0b service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Received event network-vif-plugged-fadc1466-5336-4230-b0f1-4fe4053f216a {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:37:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3f812b77-a473-4a8a-ab0e-5ec4a9c113bc req-d8ad04be-c764-4d16-b4ee-1ef3392a4c0b service nova] Acquiring lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3f812b77-a473-4a8a-ab0e-5ec4a9c113bc req-d8ad04be-c764-4d16-b4ee-1ef3392a4c0b service nova] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3f812b77-a473-4a8a-ab0e-5ec4a9c113bc req-d8ad04be-c764-4d16-b4ee-1ef3392a4c0b service nova] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:36 user nova-compute[231753]: DEBUG nova.compute.manager [req-3f812b77-a473-4a8a-ab0e-5ec4a9c113bc req-d8ad04be-c764-4d16-b4ee-1ef3392a4c0b service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] No waiting events found dispatching network-vif-plugged-fadc1466-5336-4230-b0f1-4fe4053f216a {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:37:36 user nova-compute[231753]: WARNING nova.compute.manager [req-3f812b77-a473-4a8a-ab0e-5ec4a9c113bc req-d8ad04be-c764-4d16-b4ee-1ef3392a4c0b service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Received unexpected event network-vif-plugged-fadc1466-5336-4230-b0f1-4fe4053f216a for instance with vm_state active and task_state resize_finish.
Jul 29 13:37:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:37 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637857.2936692, 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:37:37 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] VM Resumed (Lifecycle Event)
Jul 29 13:37:37 user nova-compute[231753]: DEBUG nova.compute.manager [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:37:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:37:37 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Instance spawned successfully.
Jul 29 13:37:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:37:37 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:37:37 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:37:37 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 29 13:37:37 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637857.2972364, 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:37:37 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] VM Started (Lifecycle Event)
Jul 29 13:37:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:37:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:37:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:37:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:37:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:37:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:37:37 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:37:37 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:37:37 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 29 13:37:37 user nova-compute[231753]: DEBUG nova.compute.manager [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:37:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:37 user nova-compute[231753]: DEBUG nova.objects.instance [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Trying to apply a migration context that does not seem to be set for this instance {{(pid=231753) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 29 13:37:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-028ae856-425f-4a17-ac3d-2795a930c21a tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.077s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:38 user nova-compute[231753]: DEBUG nova.compute.manager [req-93b372f9-d2b2-4e52-a8d0-0c4a5889cf7a req-cad0b567-6f9f-4f22-838e-a6a6e73b66b8 service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Received event network-vif-plugged-fadc1466-5336-4230-b0f1-4fe4053f216a {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:37:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-93b372f9-d2b2-4e52-a8d0-0c4a5889cf7a req-cad0b567-6f9f-4f22-838e-a6a6e73b66b8 service nova] Acquiring lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-93b372f9-d2b2-4e52-a8d0-0c4a5889cf7a req-cad0b567-6f9f-4f22-838e-a6a6e73b66b8 service nova] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-93b372f9-d2b2-4e52-a8d0-0c4a5889cf7a req-cad0b567-6f9f-4f22-838e-a6a6e73b66b8 service nova] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:38 user nova-compute[231753]: DEBUG nova.compute.manager [req-93b372f9-d2b2-4e52-a8d0-0c4a5889cf7a req-cad0b567-6f9f-4f22-838e-a6a6e73b66b8 service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] No waiting events found dispatching network-vif-plugged-fadc1466-5336-4230-b0f1-4fe4053f216a {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:37:38 user nova-compute[231753]: WARNING nova.compute.manager [req-93b372f9-d2b2-4e52-a8d0-0c4a5889cf7a req-cad0b567-6f9f-4f22-838e-a6a6e73b66b8 service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Received unexpected event network-vif-plugged-fadc1466-5336-4230-b0f1-4fe4053f216a for instance with vm_state active and task_state resize_finish.
Jul 29 13:37:38 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637858.2438416, 63fad324-aac2-4d60-b4ce-a32a5736657d => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:37:38 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] VM Resumed (Lifecycle Event)
Jul 29 13:37:38 user nova-compute[231753]: DEBUG nova.compute.manager [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:37:38 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Instance running successfully.
Jul 29 13:37:38 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Failed to set time: agent not configured {{(pid=231753) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 29 13:37:38 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d91147fa-dd50-4c7a-8d83-0fab653a996d tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] finish_migration finished successfully. {{(pid=231753) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 29 13:37:38 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:37:38 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:37:38 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 29 13:37:38 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637858.2494051, 63fad324-aac2-4d60-b4ce-a32a5736657d => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:37:38 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] VM Started (Lifecycle Event)
Jul 29 13:37:38 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:37:38 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:37:38 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 29 13:37:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:50 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:50 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:55 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Acquiring lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:55 user nova-compute[231753]: DEBUG nova.compute.manager [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:37:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:37:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:37:56 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:37:56 user nova-compute[231753]: INFO nova.compute.claims [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Claim successful on node user
Jul 29 13:37:56 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:37:56 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:37:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.454s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:37:56 user nova-compute[231753]: DEBUG nova.compute.manager [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:37:56 user nova-compute[231753]: DEBUG nova.compute.manager [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:37:56 user nova-compute[231753]: DEBUG nova.network.neutron [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:37:56 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:37:56 user nova-compute[231753]: DEBUG nova.compute.manager [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:37:56 user nova-compute[231753]: INFO nova.virt.block_device [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Booting with volume b82c6905-a234-45d8-945c-ab8abef447d0 at /dev/vda
Jul 29 13:37:56 user nova-compute[231753]: DEBUG os_brick.utils [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:37:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:56 user nova-compute[231753]: DEBUG nova.policy [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '85b304003a524464a7d013228d650d3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '11bd37c7c8524d2b961e5b1aa1e92e9e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:37:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:56 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f365e69d-d562-4025-8bed-672a25df467d]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:56 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cb39aae-a9fd-4e33-9197-55ecf16f7738]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:37:56 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[19085c32-823e-4d82-96ba-7b2a74713f4b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:56 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9484d01c-dd33-4a14-8145-35adf6455a25]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:37:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:37:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:37:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:37:56 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:37:56 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9f6740-33dc-4c84-8cac-bf221295fb58]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:37:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:37:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:37:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:37:56 user nova-compute[231753]: DEBUG os_brick.utils [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] <== get_connector_properties: return (158ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:37:56 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Updating existing volume attachment record: f5450ed6-8b0c-439d-966d-e148c59e365a {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:37:57 user nova-compute[231753]: DEBUG nova.network.neutron [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Successfully created port: 984d64db-ae0d-45be-a0cd-3bcc5b00008b {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:37:58 user nova-compute[231753]: DEBUG nova.network.neutron [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Successfully created port: 2789bcf9-55ed-4893-85f4-7595c6df0400 {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:37:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:58 user nova-compute[231753]: DEBUG nova.network.neutron [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Successfully created port: f0ade4f6-225a-4c66-a2f5-d5793cfa7a96 {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:37:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:37:59 user nova-compute[231753]: DEBUG nova.network.neutron [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Successfully created port: a795944f-ca69-4b3d-90b6-bf61d16fa1a8 {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:38:00 user nova-compute[231753]: DEBUG nova.network.neutron [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Successfully created port: a4a0b15f-494b-4934-8b4f-fb8df577a60d {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:38:01 user nova-compute[231753]: DEBUG nova.network.neutron [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Successfully updated port: 984d64db-ae0d-45be-a0cd-3bcc5b00008b {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:38:01 user nova-compute[231753]: DEBUG nova.compute.manager [req-01a66091-d9b8-458a-a334-1f1c2537a371 req-be187d8f-635f-4508-a866-8ed616d3a771 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-changed-984d64db-ae0d-45be-a0cd-3bcc5b00008b {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:01 user nova-compute[231753]: DEBUG nova.compute.manager [req-01a66091-d9b8-458a-a334-1f1c2537a371 req-be187d8f-635f-4508-a866-8ed616d3a771 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Refreshing instance network info cache due to event network-changed-984d64db-ae0d-45be-a0cd-3bcc5b00008b. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:38:01 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-01a66091-d9b8-458a-a334-1f1c2537a371 req-be187d8f-635f-4508-a866-8ed616d3a771 service nova] Acquiring lock "refresh_cache-894f5e40-e585-41c0-9dd8-e94d8a9400ef" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:38:01 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-01a66091-d9b8-458a-a334-1f1c2537a371 req-be187d8f-635f-4508-a866-8ed616d3a771 service nova] Acquired lock "refresh_cache-894f5e40-e585-41c0-9dd8-e94d8a9400ef" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:38:01 user nova-compute[231753]: DEBUG nova.network.neutron [req-01a66091-d9b8-458a-a334-1f1c2537a371 req-be187d8f-635f-4508-a866-8ed616d3a771 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Refreshing network info cache for port 984d64db-ae0d-45be-a0cd-3bcc5b00008b {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:38:01 user nova-compute[231753]: DEBUG nova.network.neutron [req-01a66091-d9b8-458a-a334-1f1c2537a371 req-be187d8f-635f-4508-a866-8ed616d3a771 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:38:01 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:01 user nova-compute[231753]: DEBUG nova.network.neutron [req-01a66091-d9b8-458a-a334-1f1c2537a371 req-be187d8f-635f-4508-a866-8ed616d3a771 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:38:01 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-01a66091-d9b8-458a-a334-1f1c2537a371 req-be187d8f-635f-4508-a866-8ed616d3a771 service nova] Releasing lock "refresh_cache-894f5e40-e585-41c0-9dd8-e94d8a9400ef" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:38:02 user nova-compute[231753]: DEBUG nova.network.neutron [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Successfully updated port: dcd40805-07c1-45d2-a795-f3085231f735 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:38:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:03 user nova-compute[231753]: DEBUG nova.compute.manager [req-c3587866-a410-47ba-9427-61c89c0cda15 req-8914409f-e30a-4049-b408-da77e6fab6f0 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-changed-dcd40805-07c1-45d2-a795-f3085231f735 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:03 user nova-compute[231753]: DEBUG nova.compute.manager [req-c3587866-a410-47ba-9427-61c89c0cda15 req-8914409f-e30a-4049-b408-da77e6fab6f0 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Refreshing instance network info cache due to event network-changed-dcd40805-07c1-45d2-a795-f3085231f735. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:38:03 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c3587866-a410-47ba-9427-61c89c0cda15 req-8914409f-e30a-4049-b408-da77e6fab6f0 service nova] Acquiring lock "refresh_cache-894f5e40-e585-41c0-9dd8-e94d8a9400ef" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:38:03 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c3587866-a410-47ba-9427-61c89c0cda15 req-8914409f-e30a-4049-b408-da77e6fab6f0 service nova] Acquired lock "refresh_cache-894f5e40-e585-41c0-9dd8-e94d8a9400ef" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:38:03 user nova-compute[231753]: DEBUG nova.network.neutron [req-c3587866-a410-47ba-9427-61c89c0cda15 req-8914409f-e30a-4049-b408-da77e6fab6f0 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Refreshing network info cache for port dcd40805-07c1-45d2-a795-f3085231f735 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:38:03 user nova-compute[231753]: DEBUG nova.network.neutron [req-c3587866-a410-47ba-9427-61c89c0cda15 req-8914409f-e30a-4049-b408-da77e6fab6f0 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:38:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:03 user nova-compute[231753]: DEBUG nova.network.neutron [req-c3587866-a410-47ba-9427-61c89c0cda15 req-8914409f-e30a-4049-b408-da77e6fab6f0 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:38:03 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c3587866-a410-47ba-9427-61c89c0cda15 req-8914409f-e30a-4049-b408-da77e6fab6f0 service nova] Releasing lock "refresh_cache-894f5e40-e585-41c0-9dd8-e94d8a9400ef" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:38:03 user nova-compute[231753]: DEBUG nova.network.neutron [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Successfully updated port: 4a95b92c-9a5b-4fd4-bbfd-36063a073c11 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:38:05 user nova-compute[231753]: INFO nova.virt.block_device [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Booting with volume 84ca643c-1d19-4f8d-b0a5-25eb9179b1be at /dev/vdb
Jul 29 13:38:05 user nova-compute[231753]: DEBUG os_brick.utils [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:38:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:05 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9458810-c7ec-4d1b-9779-833c8fa6066f]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:05 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b442f6-0a78-4cc7-bdc6-fd8160511b92]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:05 user nova-compute[231753]: DEBUG nova.compute.manager [req-62b1df25-f8d9-4d49-bc7d-735f3284391e req-fab8dd12-706d-46c4-b3e7-28a407457808 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-changed-4a95b92c-9a5b-4fd4-bbfd-36063a073c11 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:05 user nova-compute[231753]: DEBUG nova.compute.manager [req-62b1df25-f8d9-4d49-bc7d-735f3284391e req-fab8dd12-706d-46c4-b3e7-28a407457808 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Refreshing instance network info cache due to event network-changed-4a95b92c-9a5b-4fd4-bbfd-36063a073c11. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:38:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-62b1df25-f8d9-4d49-bc7d-735f3284391e req-fab8dd12-706d-46c4-b3e7-28a407457808 service nova] Acquiring lock "refresh_cache-894f5e40-e585-41c0-9dd8-e94d8a9400ef" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:38:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-62b1df25-f8d9-4d49-bc7d-735f3284391e req-fab8dd12-706d-46c4-b3e7-28a407457808 service nova] Acquired lock "refresh_cache-894f5e40-e585-41c0-9dd8-e94d8a9400ef" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:38:05 user nova-compute[231753]: DEBUG nova.network.neutron [req-62b1df25-f8d9-4d49-bc7d-735f3284391e req-fab8dd12-706d-46c4-b3e7-28a407457808 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Refreshing network info cache for port 4a95b92c-9a5b-4fd4-bbfd-36063a073c11 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:38:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:05 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[43029e48-4e27-46a6-a1e1-e9af58010bd0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:05 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[05378177-a533-4778-8bec-085e1f7ede97]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:38:05 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:38:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:38:05 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:38:05 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a210f70-f68c-4374-95b4-668209e1d523]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:05 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:38:05 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:38:05 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:38:05 user nova-compute[231753]: DEBUG os_brick.utils [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] <== get_connector_properties: return (216ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:38:05 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Updating existing volume attachment record: 802aead6-b1de-44bb-b6c1-fe9c54eb8d35 {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:38:05 user nova-compute[231753]: DEBUG nova.network.neutron [req-62b1df25-f8d9-4d49-bc7d-735f3284391e req-fab8dd12-706d-46c4-b3e7-28a407457808 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:38:05 user nova-compute[231753]: DEBUG nova.network.neutron [req-62b1df25-f8d9-4d49-bc7d-735f3284391e req-fab8dd12-706d-46c4-b3e7-28a407457808 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:38:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-62b1df25-f8d9-4d49-bc7d-735f3284391e req-fab8dd12-706d-46c4-b3e7-28a407457808 service nova] Releasing lock "refresh_cache-894f5e40-e585-41c0-9dd8-e94d8a9400ef" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:38:07 user nova-compute[231753]: DEBUG nova.network.neutron [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Successfully updated port: 2789bcf9-55ed-4893-85f4-7595c6df0400 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:38:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:07 user nova-compute[231753]: DEBUG nova.compute.manager [req-fc7a6f61-011a-4fca-99d7-938178e83718 req-37ee6aa5-83a0-4f8a-b0a4-a86303e3ed04 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-changed-2789bcf9-55ed-4893-85f4-7595c6df0400 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:07 user nova-compute[231753]: DEBUG nova.compute.manager [req-fc7a6f61-011a-4fca-99d7-938178e83718 req-37ee6aa5-83a0-4f8a-b0a4-a86303e3ed04 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Refreshing instance network info cache due to event network-changed-2789bcf9-55ed-4893-85f4-7595c6df0400. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:38:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-fc7a6f61-011a-4fca-99d7-938178e83718 req-37ee6aa5-83a0-4f8a-b0a4-a86303e3ed04 service nova] Acquiring lock "refresh_cache-894f5e40-e585-41c0-9dd8-e94d8a9400ef" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:38:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-fc7a6f61-011a-4fca-99d7-938178e83718 req-37ee6aa5-83a0-4f8a-b0a4-a86303e3ed04 service nova] Acquired lock "refresh_cache-894f5e40-e585-41c0-9dd8-e94d8a9400ef" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:38:07 user nova-compute[231753]: DEBUG nova.network.neutron [req-fc7a6f61-011a-4fca-99d7-938178e83718 req-37ee6aa5-83a0-4f8a-b0a4-a86303e3ed04 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Refreshing network info cache for port 2789bcf9-55ed-4893-85f4-7595c6df0400 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:38:07 user nova-compute[231753]: DEBUG nova.compute.manager [req-50466fb4-5913-4a1e-bb7a-8b61dda6543e req-fbf8d2c1-6717-40cc-af15-6e052253ba75 service nova] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Received event network-changed-47c9a3cb-360f-4fd1-8233-37b32039d047 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:07 user nova-compute[231753]: DEBUG nova.compute.manager [req-50466fb4-5913-4a1e-bb7a-8b61dda6543e req-fbf8d2c1-6717-40cc-af15-6e052253ba75 service nova] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Refreshing instance network info cache due to event network-changed-47c9a3cb-360f-4fd1-8233-37b32039d047. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:38:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-50466fb4-5913-4a1e-bb7a-8b61dda6543e req-fbf8d2c1-6717-40cc-af15-6e052253ba75 service nova] Acquiring lock "refresh_cache-3fed0e1e-c8a7-43cc-bef6-14410111d3cb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:38:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-50466fb4-5913-4a1e-bb7a-8b61dda6543e req-fbf8d2c1-6717-40cc-af15-6e052253ba75 service nova] Acquired lock "refresh_cache-3fed0e1e-c8a7-43cc-bef6-14410111d3cb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:38:07 user nova-compute[231753]: DEBUG nova.network.neutron [req-50466fb4-5913-4a1e-bb7a-8b61dda6543e req-fbf8d2c1-6717-40cc-af15-6e052253ba75 service nova] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Refreshing network info cache for port 47c9a3cb-360f-4fd1-8233-37b32039d047 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:38:07 user nova-compute[231753]: DEBUG nova.network.neutron [req-fc7a6f61-011a-4fca-99d7-938178e83718 req-37ee6aa5-83a0-4f8a-b0a4-a86303e3ed04 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:38:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Acquiring lock "3fed0e1e-c8a7-43cc-bef6-14410111d3cb" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "3fed0e1e-c8a7-43cc-bef6-14410111d3cb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:07 user nova-compute[231753]: DEBUG nova.network.neutron [req-fc7a6f61-011a-4fca-99d7-938178e83718 req-37ee6aa5-83a0-4f8a-b0a4-a86303e3ed04 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:38:07 user nova-compute[231753]: DEBUG nova.objects.instance [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lazy-loading 'flavor' on Instance uuid 3fed0e1e-c8a7-43cc-bef6-14410111d3cb {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:38:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-fc7a6f61-011a-4fca-99d7-938178e83718 req-37ee6aa5-83a0-4f8a-b0a4-a86303e3ed04 service nova] Releasing lock "refresh_cache-894f5e40-e585-41c0-9dd8-e94d8a9400ef" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:38:07 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Ignoring supplied device name: /dev/vdb
Jul 29 13:38:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "3fed0e1e-c8a7-43cc-bef6-14410111d3cb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.085s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Acquiring lock "3fed0e1e-c8a7-43cc-bef6-14410111d3cb" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "3fed0e1e-c8a7-43cc-bef6-14410111d3cb" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:07 user nova-compute[231753]: INFO nova.compute.manager [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Attaching volume 6bc82b7d-5f8e-4c78-9880-c589a410d3a0 to /dev/vdb
Jul 29 13:38:08 user nova-compute[231753]: DEBUG os_brick.utils [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:38:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:08 user nova-compute[231753]: DEBUG nova.network.neutron [req-50466fb4-5913-4a1e-bb7a-8b61dda6543e req-fbf8d2c1-6717-40cc-af15-6e052253ba75 service nova] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Updated VIF entry in instance network info cache for port 47c9a3cb-360f-4fd1-8233-37b32039d047. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:38:08 user nova-compute[231753]: DEBUG nova.network.neutron [req-50466fb4-5913-4a1e-bb7a-8b61dda6543e req-fbf8d2c1-6717-40cc-af15-6e052253ba75 service nova] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Updating instance_info_cache with network_info: [{"id": "47c9a3cb-360f-4fd1-8233-37b32039d047", "address": "fa:16:3e:3a:d8:c5", "network": {"id": "7f0a516e-a6d1-4198-b7f7-d1eef96625cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-408682612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd0f16e49ef48ff99752b6aec718358", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9a3cb-36", "ovs_interfaceid": "47c9a3cb-360f-4fd1-8233-37b32039d047", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:38:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:08 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fd89560-b90d-433f-ae89-0adab1b366d4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-50466fb4-5913-4a1e-bb7a-8b61dda6543e req-fbf8d2c1-6717-40cc-af15-6e052253ba75 service nova] Releasing lock "refresh_cache-3fed0e1e-c8a7-43cc-bef6-14410111d3cb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:38:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:08 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f31434-289a-4543-88e6-d1e4c237d53f]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:08 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[863203be-f3ba-4f4e-9051-3c8fab24dd55]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:08 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2afcd3-d83c-4020-b45d-9b08c37495b2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:38:08 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:38:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:38:08 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:38:08 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[13f05f7c-885f-44d7-b7a2-4256294d63dd]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:38:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:38:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:38:08 user nova-compute[231753]: DEBUG os_brick.utils [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:38:08 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Updating existing volume attachment record: b57f066c-0b82-4b82-809d-52bd81397ae7 {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:38:08 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "cf326e80-7293-4764-9411-ed05a5aeba23" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "cf326e80-7293-4764-9411-ed05a5aeba23" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:08 user nova-compute[231753]: DEBUG nova.compute.manager [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:38:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:09 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:38:09 user nova-compute[231753]: INFO nova.compute.claims [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Claim successful on node user
Jul 29 13:38:09 user nova-compute[231753]: DEBUG nova.network.neutron [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Successfully updated port: f0ade4f6-225a-4c66-a2f5-d5793cfa7a96 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:38:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:09 user nova-compute[231753]: DEBUG nova.compute.manager [req-4a4cf6cd-d48e-4db2-b7c0-6d6fadd6ef30 req-04859140-fc13-4529-9e07-3d2a70791645 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-changed-f0ade4f6-225a-4c66-a2f5-d5793cfa7a96 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:09 user nova-compute[231753]: DEBUG nova.compute.manager [req-4a4cf6cd-d48e-4db2-b7c0-6d6fadd6ef30 req-04859140-fc13-4529-9e07-3d2a70791645 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Refreshing instance network info cache due to event network-changed-f0ade4f6-225a-4c66-a2f5-d5793cfa7a96. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:38:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4a4cf6cd-d48e-4db2-b7c0-6d6fadd6ef30 req-04859140-fc13-4529-9e07-3d2a70791645 service nova] Acquiring lock "refresh_cache-894f5e40-e585-41c0-9dd8-e94d8a9400ef" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:38:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4a4cf6cd-d48e-4db2-b7c0-6d6fadd6ef30 req-04859140-fc13-4529-9e07-3d2a70791645 service nova] Acquired lock "refresh_cache-894f5e40-e585-41c0-9dd8-e94d8a9400ef" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:38:09 user nova-compute[231753]: DEBUG nova.network.neutron [req-4a4cf6cd-d48e-4db2-b7c0-6d6fadd6ef30 req-04859140-fc13-4529-9e07-3d2a70791645 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Refreshing network info cache for port f0ade4f6-225a-4c66-a2f5-d5793cfa7a96 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:38:09 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:38:09 user nova-compute[231753]: DEBUG nova.network.neutron [req-4a4cf6cd-d48e-4db2-b7c0-6d6fadd6ef30 req-04859140-fc13-4529-9e07-3d2a70791645 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:38:09 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:38:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.532s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:09 user nova-compute[231753]: DEBUG nova.compute.manager [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:38:09 user nova-compute[231753]: DEBUG nova.compute.manager [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:38:09 user nova-compute[231753]: DEBUG nova.network.neutron [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:38:09 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:38:09 user nova-compute[231753]: DEBUG nova.compute.manager [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:38:09 user nova-compute[231753]: DEBUG nova.policy [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '618ce2d56c3c4ee8ace871d308ca45fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01165e83a3143ad83f050790f2b63fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:38:09 user nova-compute[231753]: DEBUG nova.compute.manager [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:38:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:38:09 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Creating image(s)
Jul 29 13:38:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "/opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "/opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "/opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:10 user nova-compute[231753]: DEBUG nova.network.neutron [req-4a4cf6cd-d48e-4db2-b7c0-6d6fadd6ef30 req-04859140-fc13-4529-9e07-3d2a70791645 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:38:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4a4cf6cd-d48e-4db2-b7c0-6d6fadd6ef30 req-04859140-fc13-4529-9e07-3d2a70791645 service nova] Releasing lock "refresh_cache-894f5e40-e585-41c0-9dd8-e94d8a9400ef" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:38:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.192s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.177s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:10 user nova-compute[231753]: DEBUG nova.network.neutron [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Successfully updated port: a795944f-ca69-4b3d-90b6-bf61d16fa1a8 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:38:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk 1073741824" returned: 0 in 0.064s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.246s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.154s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:10 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Checking if we can resize image /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:38:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:10 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Cannot resize image /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:38:10 user nova-compute[231753]: DEBUG nova.objects.instance [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lazy-loading 'migration_context' on Instance uuid cf326e80-7293-4764-9411-ed05a5aeba23 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:38:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:38:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Ensure instance console log exists: /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:38:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:10 user nova-compute[231753]: DEBUG nova.network.neutron [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Successfully created port: fbd63de1-966b-4791-8c72-6a5e2d26a7e2 {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:38:11 user nova-compute[231753]: DEBUG nova.compute.manager [req-4f51fbaa-4d19-453b-8830-cb47fa72a1b4 req-9bc20f71-bb6d-48fe-90c4-0f92d20e3761 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-changed-a795944f-ca69-4b3d-90b6-bf61d16fa1a8 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:11 user nova-compute[231753]: DEBUG nova.compute.manager [req-4f51fbaa-4d19-453b-8830-cb47fa72a1b4 req-9bc20f71-bb6d-48fe-90c4-0f92d20e3761 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Refreshing instance network info cache due to event network-changed-a795944f-ca69-4b3d-90b6-bf61d16fa1a8. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:38:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4f51fbaa-4d19-453b-8830-cb47fa72a1b4 req-9bc20f71-bb6d-48fe-90c4-0f92d20e3761 service nova] Acquiring lock "refresh_cache-894f5e40-e585-41c0-9dd8-e94d8a9400ef" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:38:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4f51fbaa-4d19-453b-8830-cb47fa72a1b4 req-9bc20f71-bb6d-48fe-90c4-0f92d20e3761 service nova] Acquired lock "refresh_cache-894f5e40-e585-41c0-9dd8-e94d8a9400ef" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:38:11 user nova-compute[231753]: DEBUG nova.network.neutron [req-4f51fbaa-4d19-453b-8830-cb47fa72a1b4 req-9bc20f71-bb6d-48fe-90c4-0f92d20e3761 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Refreshing network info cache for port a795944f-ca69-4b3d-90b6-bf61d16fa1a8 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:38:11 user nova-compute[231753]: DEBUG nova.network.neutron [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Successfully updated port: a4a0b15f-494b-4934-8b4f-fb8df577a60d {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:38:11 user nova-compute[231753]: DEBUG nova.network.neutron [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Successfully updated port: fbd63de1-966b-4791-8c72-6a5e2d26a7e2 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:38:11 user nova-compute[231753]: DEBUG nova.compute.manager [req-da89aff5-2219-4bbe-892e-8560d52557bf req-25b22a0d-b190-474f-b56b-31f96199e9c0 service nova] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Received event network-changed-fbd63de1-966b-4791-8c72-6a5e2d26a7e2 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:11 user nova-compute[231753]: DEBUG nova.compute.manager [req-da89aff5-2219-4bbe-892e-8560d52557bf req-25b22a0d-b190-474f-b56b-31f96199e9c0 service nova] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Refreshing instance network info cache due to event network-changed-fbd63de1-966b-4791-8c72-6a5e2d26a7e2. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:38:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-da89aff5-2219-4bbe-892e-8560d52557bf req-25b22a0d-b190-474f-b56b-31f96199e9c0 service nova] Acquiring lock "refresh_cache-cf326e80-7293-4764-9411-ed05a5aeba23" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:38:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-da89aff5-2219-4bbe-892e-8560d52557bf req-25b22a0d-b190-474f-b56b-31f96199e9c0 service nova] Acquired lock "refresh_cache-cf326e80-7293-4764-9411-ed05a5aeba23" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:38:11 user nova-compute[231753]: DEBUG nova.network.neutron [req-da89aff5-2219-4bbe-892e-8560d52557bf req-25b22a0d-b190-474f-b56b-31f96199e9c0 service nova] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Refreshing network info cache for port fbd63de1-966b-4791-8c72-6a5e2d26a7e2 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:38:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Acquiring lock "refresh_cache-894f5e40-e585-41c0-9dd8-e94d8a9400ef" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:38:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "refresh_cache-cf326e80-7293-4764-9411-ed05a5aeba23" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:38:11 user nova-compute[231753]: DEBUG nova.network.neutron [req-4f51fbaa-4d19-453b-8830-cb47fa72a1b4 req-9bc20f71-bb6d-48fe-90c4-0f92d20e3761 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:38:11 user nova-compute[231753]: DEBUG nova.network.neutron [req-da89aff5-2219-4bbe-892e-8560d52557bf req-25b22a0d-b190-474f-b56b-31f96199e9c0 service nova] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:38:11 user nova-compute[231753]: DEBUG nova.network.neutron [req-da89aff5-2219-4bbe-892e-8560d52557bf req-25b22a0d-b190-474f-b56b-31f96199e9c0 service nova] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:38:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-da89aff5-2219-4bbe-892e-8560d52557bf req-25b22a0d-b190-474f-b56b-31f96199e9c0 service nova] Releasing lock "refresh_cache-cf326e80-7293-4764-9411-ed05a5aeba23" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:38:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquired lock "refresh_cache-cf326e80-7293-4764-9411-ed05a5aeba23" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:38:11 user nova-compute[231753]: DEBUG nova.network.neutron [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG nova.network.neutron [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG nova.network.neutron [req-4f51fbaa-4d19-453b-8830-cb47fa72a1b4 req-9bc20f71-bb6d-48fe-90c4-0f92d20e3761 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4f51fbaa-4d19-453b-8830-cb47fa72a1b4 req-9bc20f71-bb6d-48fe-90c4-0f92d20e3761 service nova] Releasing lock "refresh_cache-894f5e40-e585-41c0-9dd8-e94d8a9400ef" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Acquired lock "refresh_cache-894f5e40-e585-41c0-9dd8-e94d8a9400ef" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG nova.network.neutron [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG nova.network.neutron [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Updating instance_info_cache with network_info: [{"id": "fbd63de1-966b-4791-8c72-6a5e2d26a7e2", "address": "fa:16:3e:09:75:c0", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd63de1-96", "ovs_interfaceid": "fbd63de1-966b-4791-8c72-6a5e2d26a7e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Releasing lock "refresh_cache-cf326e80-7293-4764-9411-ed05a5aeba23" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG nova.compute.manager [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Instance network_info: |[{"id": "fbd63de1-966b-4791-8c72-6a5e2d26a7e2", "address": "fa:16:3e:09:75:c0", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd63de1-96", "ovs_interfaceid": "fbd63de1-966b-4791-8c72-6a5e2d26a7e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Start _get_guest_xml network_info=[{"id": "fbd63de1-966b-4791-8c72-6a5e2d26a7e2", "address": "fa:16:3e:09:75:c0", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd63de1-96", "ovs_interfaceid": "fbd63de1-966b-4791-8c72-6a5e2d26a7e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:38:12 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:38:12 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:38:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:38:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1544171267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1544171267',id=17,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c01165e83a3143ad83f050790f2b63fe',ramdisk_id='',reservation_id='r-0mwlo0g6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-93506270',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:38:10Z,user_data=None,user_id='618ce2d56c3c4ee8ace871d308ca45fb',uuid=cf326e80-7293-4764-9411-ed05a5aeba23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbd63de1-966b-4791-8c72-6a5e2d26a7e2", "address": "fa:16:3e:09:75:c0", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd63de1-96", "ovs_interfaceid": "fbd63de1-966b-4791-8c72-6a5e2d26a7e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Converting VIF {"id": "fbd63de1-966b-4791-8c72-6a5e2d26a7e2", "address": "fa:16:3e:09:75:c0", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd63de1-96", "ovs_interfaceid": "fbd63de1-966b-4791-8c72-6a5e2d26a7e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:75:c0,bridge_name='br-int',has_traffic_filtering=True,id=fbd63de1-966b-4791-8c72-6a5e2d26a7e2,network=Network(03362fcb-afd6-4b0a-af44-a54a848c59f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbd63de1-96') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG nova.objects.instance [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lazy-loading 'pci_devices' on Instance uuid cf326e80-7293-4764-9411-ed05a5aeba23 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:38:12 user nova-compute[231753]:   <uuid>cf326e80-7293-4764-9411-ed05a5aeba23</uuid>
Jul 29 13:38:12 user nova-compute[231753]:   <name>instance-00000011</name>
Jul 29 13:38:12 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:38:12 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:38:12 user nova-compute[231753]:   <metadata>
Jul 29 13:38:12 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:38:12 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:38:12 user nova-compute[231753]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1544171267</nova:name>
Jul 29 13:38:12 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:38:12</nova:creationTime>
Jul 29 13:38:12 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:38:12 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:38:12 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:38:12 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:38:12 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:38:12 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:38:12 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:38:12 user nova-compute[231753]:       <nova:owner>
Jul 29 13:38:12 user nova-compute[231753]:         <nova:user uuid="618ce2d56c3c4ee8ace871d308ca45fb">tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member</nova:user>
Jul 29 13:38:12 user nova-compute[231753]:         <nova:project uuid="c01165e83a3143ad83f050790f2b63fe">tempest-ServerBootFromVolumeStableRescueTest-93506270</nova:project>
Jul 29 13:38:12 user nova-compute[231753]:       </nova:owner>
Jul 29 13:38:12 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:38:12 user nova-compute[231753]:       <nova:ports>
Jul 29 13:38:12 user nova-compute[231753]:         <nova:port uuid="fbd63de1-966b-4791-8c72-6a5e2d26a7e2">
Jul 29 13:38:12 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 29 13:38:12 user nova-compute[231753]:         </nova:port>
Jul 29 13:38:12 user nova-compute[231753]:       </nova:ports>
Jul 29 13:38:12 user nova-compute[231753]:     </nova:instance>
Jul 29 13:38:12 user nova-compute[231753]:   </metadata>
Jul 29 13:38:12 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:38:12 user nova-compute[231753]:     <system>
Jul 29 13:38:12 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:38:12 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:38:12 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:38:12 user nova-compute[231753]:       <entry name="serial">cf326e80-7293-4764-9411-ed05a5aeba23</entry>
Jul 29 13:38:12 user nova-compute[231753]:       <entry name="uuid">cf326e80-7293-4764-9411-ed05a5aeba23</entry>
Jul 29 13:38:12 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:38:12 user nova-compute[231753]:     </system>
Jul 29 13:38:12 user nova-compute[231753]:   </sysinfo>
Jul 29 13:38:12 user nova-compute[231753]:   <os>
Jul 29 13:38:12 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:38:12 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:38:12 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:38:12 user nova-compute[231753]:   </os>
Jul 29 13:38:12 user nova-compute[231753]:   <features>
Jul 29 13:38:12 user nova-compute[231753]:     <acpi/>
Jul 29 13:38:12 user nova-compute[231753]:     <apic/>
Jul 29 13:38:12 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:38:12 user nova-compute[231753]:   </features>
Jul 29 13:38:12 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:38:12 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:38:12 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:38:12 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:38:12 user nova-compute[231753]:   </clock>
Jul 29 13:38:12 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:38:12 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:38:12 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:38:12 user nova-compute[231753]:   </cpu>
Jul 29 13:38:12 user nova-compute[231753]:   <devices>
Jul 29 13:38:12 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:38:12 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:38:12 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk"/>
Jul 29 13:38:12 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:38:12 user nova-compute[231753]:     </disk>
Jul 29 13:38:12 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:38:12 user nova-compute[231753]:       <mac address="fa:16:3e:09:75:c0"/>
Jul 29 13:38:12 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:38:12 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:38:12 user nova-compute[231753]:       <target dev="tapfbd63de1-96"/>
Jul 29 13:38:12 user nova-compute[231753]:     </interface>
Jul 29 13:38:12 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:38:12 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/console.log" append="off"/>
Jul 29 13:38:12 user nova-compute[231753]:     </serial>
Jul 29 13:38:12 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:38:12 user nova-compute[231753]:     <video>
Jul 29 13:38:12 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:38:12 user nova-compute[231753]:     </video>
Jul 29 13:38:12 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:38:12 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:38:12 user nova-compute[231753]:     </rng>
Jul 29 13:38:12 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:38:12 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:38:12 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:38:12 user nova-compute[231753]:     </memballoon>
Jul 29 13:38:12 user nova-compute[231753]:   </devices>
Jul 29 13:38:12 user nova-compute[231753]: </domain>
Jul 29 13:38:12 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:38:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1544171267',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1544171267',id=17,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c01165e83a3143ad83f050790f2b63fe',ramdisk_id='',reservation_id='r-0mwlo0g6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-93506270',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:38:10Z,user_data=None,user_id='618ce2d56c3c4ee8ace871d308ca45fb',uuid=cf326e80-7293-4764-9411-ed05a5aeba23,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fbd63de1-966b-4791-8c72-6a5e2d26a7e2", "address": "fa:16:3e:09:75:c0", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd63de1-96", "ovs_interfaceid": "fbd63de1-966b-4791-8c72-6a5e2d26a7e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Converting VIF {"id": "fbd63de1-966b-4791-8c72-6a5e2d26a7e2", "address": "fa:16:3e:09:75:c0", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd63de1-96", "ovs_interfaceid": "fbd63de1-966b-4791-8c72-6a5e2d26a7e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:09:75:c0,bridge_name='br-int',has_traffic_filtering=True,id=fbd63de1-966b-4791-8c72-6a5e2d26a7e2,network=Network(03362fcb-afd6-4b0a-af44-a54a848c59f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbd63de1-96') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG os_vif [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:75:c0,bridge_name='br-int',has_traffic_filtering=True,id=fbd63de1-966b-4791-8c72-6a5e2d26a7e2,network=Network(03362fcb-afd6-4b0a-af44-a54a848c59f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbd63de1-96') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfbd63de1-96, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfbd63de1-96, col_values=(('external_ids', {'iface-id': 'fbd63de1-966b-4791-8c72-6a5e2d26a7e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:09:75:c0', 'vm-uuid': 'cf326e80-7293-4764-9411-ed05a5aeba23'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:12 user nova-compute[231753]: INFO os_vif [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:09:75:c0,bridge_name='br-int',has_traffic_filtering=True,id=fbd63de1-966b-4791-8c72-6a5e2d26a7e2,network=Network(03362fcb-afd6-4b0a-af44-a54a848c59f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbd63de1-96')
Jul 29 13:38:12 user nova-compute[231753]: DEBUG nova.network.neutron [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:38:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] No VIF found with MAC fa:16:3e:09:75:c0, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:38:13 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:13 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:38:13 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:38:13 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 13:38:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "refresh_cache-299b7f21-b198-437b-9d5c-1269d5e9b7c8" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:38:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquired lock "refresh_cache-299b7f21-b198-437b-9d5c-1269d5e9b7c8" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:38:13 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Forcefully refreshing network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 13:38:13 user nova-compute[231753]: DEBUG nova.compute.manager [req-f415abc2-3481-48e0-8dfc-915c1cff809f req-fc76708c-7c25-4e8b-a619-81663c563468 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-changed-a4a0b15f-494b-4934-8b4f-fb8df577a60d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:13 user nova-compute[231753]: DEBUG nova.compute.manager [req-f415abc2-3481-48e0-8dfc-915c1cff809f req-fc76708c-7c25-4e8b-a619-81663c563468 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Refreshing instance network info cache due to event network-changed-a4a0b15f-494b-4934-8b4f-fb8df577a60d. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:38:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-f415abc2-3481-48e0-8dfc-915c1cff809f req-fc76708c-7c25-4e8b-a619-81663c563468 service nova] Acquiring lock "refresh_cache-894f5e40-e585-41c0-9dd8-e94d8a9400ef" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:38:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Acquiring lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:13 user nova-compute[231753]: DEBUG nova.compute.manager [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:38:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:13 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:38:13 user nova-compute[231753]: INFO nova.compute.claims [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Claim successful on node user
Jul 29 13:38:13 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Updating instance_info_cache with network_info: [{"id": "b66269be-ef4d-460f-9782-df3fc08e5450", "address": "fa:16:3e:1f:36:42", "network": {"id": "2e7ef980-929c-4ea5-86b7-d69bcfa4a209", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1403711156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44867a8743214d32a94bca3506295e92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb66269be-ef", "ovs_interfaceid": "b66269be-ef4d-460f-9782-df3fc08e5450", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:38:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Releasing lock "refresh_cache-299b7f21-b198-437b-9d5c-1269d5e9b7c8" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:38:13 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Updated the network info_cache for instance {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 13:38:13 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:38:13 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:38:13 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:38:13 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:38:13 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:38:13 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:38:13 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 13:38:13 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:38:13 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:14 user nova-compute[231753]: INFO nova.virt.block_device [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Booting with volume 845a966e-2db8-49d3-b406-6a630cd840b3 at /dev/vdc
Jul 29 13:38:14 user nova-compute[231753]: DEBUG os_brick.utils [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b0202b5-882a-4db6-92e5-2c2fe9832f97]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0188f8f-3f4b-4070-bc10-cedf0795ed58]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[642b4734-8538-4277-abef-f05382090f8e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0489c4-66f9-4964-bd85-2ba8881ada10]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:38:14 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:38:14 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f453d23-6812-4d90-8dc9-e52962958580]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG os_brick.utils [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] <== get_connector_properties: return (179ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Updating existing volume attachment record: ce26584f-8072-41ea-8ae7-9bf82950f12f {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.840s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG nova.compute.manager [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.614s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG nova.compute.manager [req-866bef0a-f019-422c-901b-8b70456954d3 req-b677cbad-ee9c-4b1d-83c1-8182b233418c service nova] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Received event network-vif-plugged-fbd63de1-966b-4791-8c72-6a5e2d26a7e2 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-866bef0a-f019-422c-901b-8b70456954d3 req-b677cbad-ee9c-4b1d-83c1-8182b233418c service nova] Acquiring lock "cf326e80-7293-4764-9411-ed05a5aeba23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-866bef0a-f019-422c-901b-8b70456954d3 req-b677cbad-ee9c-4b1d-83c1-8182b233418c service nova] Lock "cf326e80-7293-4764-9411-ed05a5aeba23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-866bef0a-f019-422c-901b-8b70456954d3 req-b677cbad-ee9c-4b1d-83c1-8182b233418c service nova] Lock "cf326e80-7293-4764-9411-ed05a5aeba23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG nova.compute.manager [req-866bef0a-f019-422c-901b-8b70456954d3 req-b677cbad-ee9c-4b1d-83c1-8182b233418c service nova] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] No waiting events found dispatching network-vif-plugged-fbd63de1-966b-4791-8c72-6a5e2d26a7e2 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:38:14 user nova-compute[231753]: WARNING nova.compute.manager [req-866bef0a-f019-422c-901b-8b70456954d3 req-b677cbad-ee9c-4b1d-83c1-8182b233418c service nova] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Received unexpected event network-vif-plugged-fbd63de1-966b-4791-8c72-6a5e2d26a7e2 for instance with vm_state building and task_state spawning.
Jul 29 13:38:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG nova.compute.manager [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG nova.network.neutron [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:38:14 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:38:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG nova.compute.manager [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG nova.policy [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '7f8f87b5aaeb4b18b013a85a579ac48b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '12b08b115e89482f9b81e621485c5eb6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG nova.compute.manager [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:38:14 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Creating image(s)
Jul 29 13:38:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Acquiring lock "/opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "/opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "/opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.168s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.168s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk 1073741824" returned: 0 in 0.052s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.227s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.155s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:15 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Checking if we can resize image /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:38:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:15 user nova-compute[231753]: DEBUG nova.network.neutron [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Successfully created port: 20213688-43ed-4115-bd0d-bc74791d95c4 {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:38:15 user nova-compute[231753]: DEBUG nova.network.neutron [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Updating instance_info_cache with network_info: [{"id": "984d64db-ae0d-45be-a0cd-3bcc5b00008b", "address": "fa:16:3e:4f:92:db", "network": {"id": "322b52d5-b11a-4c3c-a30b-adfbfee8d1b2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1087548543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap984d64db-ae", "ovs_interfaceid": "984d64db-ae0d-45be-a0cd-3bcc5b00008b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dcd40805-07c1-45d2-a795-f3085231f735", "address": "fa:16:3e:b4:73:7b", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcd40805-07", "ovs_interfaceid": "dcd40805-07c1-45d2-a795-f3085231f735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a95b92c-9a5b-4fd4-bbfd-36063a073c11", "address": "fa:16:3e:ff:85:55", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a95b92c-9a", "ovs_interfaceid": "4a95b92c-9a5b-4fd4-bbfd-36063a073c11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2789bcf9-55ed-4893-85f4-7595c6df0400", "address": "fa:16:3e:ae:53:f8", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2789bcf9-55", "ovs_interfaceid": "2789bcf9-55ed-4893-85f4-7595c6df0400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0ade4f6-225a-4c66-a2f5-d5793cfa7a96", "address": "fa:16:3e:43:c1:d4", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ade4f6-22", "ovs_interfaceid": "f0ade4f6-225a-4c66-a2f5-d5793cfa7a96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a795944f-ca69-4b3d-90b6-bf61d16fa1a8", "address": "fa:16:3e:47:62:b3", "network": {"id": "d45dd21d-a9cd-4c70-9b98-aae5f9179d8c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1287922789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa795944f-ca", "ovs_interfaceid": "a795944f-ca69-4b3d-90b6-bf61d16fa1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4a0b15f-494b-4934-8b4f-fb8df577a60d", "address": "fa:16:3e:a3:46:6e", "network": {"id": "d45dd21d-a9cd-4c70-9b98-aae5f9179d8c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1287922789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a0b15f-49", "ovs_interfaceid": "a4a0b15f-494b-4934-8b4f-fb8df577a60d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:38:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Releasing lock "refresh_cache-894f5e40-e585-41c0-9dd8-e94d8a9400ef" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:38:15 user nova-compute[231753]: DEBUG nova.compute.manager [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Instance network_info: |[{"id": "984d64db-ae0d-45be-a0cd-3bcc5b00008b", "address": "fa:16:3e:4f:92:db", "network": {"id": "322b52d5-b11a-4c3c-a30b-adfbfee8d1b2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1087548543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap984d64db-ae", "ovs_interfaceid": "984d64db-ae0d-45be-a0cd-3bcc5b00008b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dcd40805-07c1-45d2-a795-f3085231f735", "address": "fa:16:3e:b4:73:7b", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcd40805-07", "ovs_interfaceid": "dcd40805-07c1-45d2-a795-f3085231f735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a95b92c-9a5b-4fd4-bbfd-36063a073c11", "address": "fa:16:3e:ff:85:55", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a95b92c-9a", "ovs_interfaceid": "4a95b92c-9a5b-4fd4-bbfd-36063a073c11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2789bcf9-55ed-4893-85f4-7595c6df0400", "address": "fa:16:3e:ae:53:f8", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2789bcf9-55", "ovs_interfaceid": "2789bcf9-55ed-4893-85f4-7595c6df0400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0ade4f6-225a-4c66-a2f5-d5793cfa7a96", "address": "fa:16:3e:43:c1:d4", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ade4f6-22", "ovs_interfaceid": "f0ade4f6-225a-4c66-a2f5-d5793cfa7a96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a795944f-ca69-4b3d-90b6-bf61d16fa1a8", "address": "fa:16:3e:47:62:b3", "network": {"id": "d45dd21d-a9cd-4c70-9b98-aae5f9179d8c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1287922789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa795944f-ca", "ovs_interfaceid": "a795944f-ca69-4b3d-90b6-bf61d16fa1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4a0b15f-494b-4934-8b4f-fb8df577a60d", "address": "fa:16:3e:a3:46:6e", "network": {"id": "d45dd21d-a9cd-4c70-9b98-aae5f9179d8c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1287922789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a0b15f-49", "ovs_interfaceid": "a4a0b15f-494b-4934-8b4f-fb8df577a60d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:38:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-f415abc2-3481-48e0-8dfc-915c1cff809f req-fc76708c-7c25-4e8b-a619-81663c563468 service nova] Acquired lock "refresh_cache-894f5e40-e585-41c0-9dd8-e94d8a9400ef" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:38:15 user nova-compute[231753]: DEBUG nova.network.neutron [req-f415abc2-3481-48e0-8dfc-915c1cff809f req-fc76708c-7c25-4e8b-a619-81663c563468 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Refreshing network info cache for port a4a0b15f-494b-4934-8b4f-fb8df577a60d {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:38:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:15 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Cannot resize image /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:38:15 user nova-compute[231753]: DEBUG nova.objects.instance [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lazy-loading 'migration_context' on Instance uuid 55bfcd1f-2b51-4e10-84a3-e132b96111e3 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:38:15 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:38:15 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Ensure instance console log exists: /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:38:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG nova.network.neutron [req-f415abc2-3481-48e0-8dfc-915c1cff809f req-fc76708c-7c25-4e8b-a619-81663c563468 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Updated VIF entry in instance network info cache for port a4a0b15f-494b-4934-8b4f-fb8df577a60d. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG nova.network.neutron [req-f415abc2-3481-48e0-8dfc-915c1cff809f req-fc76708c-7c25-4e8b-a619-81663c563468 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Updating instance_info_cache with network_info: [{"id": "984d64db-ae0d-45be-a0cd-3bcc5b00008b", "address": "fa:16:3e:4f:92:db", "network": {"id": "322b52d5-b11a-4c3c-a30b-adfbfee8d1b2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1087548543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap984d64db-ae", "ovs_interfaceid": "984d64db-ae0d-45be-a0cd-3bcc5b00008b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dcd40805-07c1-45d2-a795-f3085231f735", "address": "fa:16:3e:b4:73:7b", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcd40805-07", "ovs_interfaceid": "dcd40805-07c1-45d2-a795-f3085231f735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a95b92c-9a5b-4fd4-bbfd-36063a073c11", "address": "fa:16:3e:ff:85:55", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a95b92c-9a", "ovs_interfaceid": "4a95b92c-9a5b-4fd4-bbfd-36063a073c11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2789bcf9-55ed-4893-85f4-7595c6df0400", "address": "fa:16:3e:ae:53:f8", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2789bcf9-55", "ovs_interfaceid": "2789bcf9-55ed-4893-85f4-7595c6df0400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0ade4f6-225a-4c66-a2f5-d5793cfa7a96", "address": "fa:16:3e:43:c1:d4", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ade4f6-22", "ovs_interfaceid": "f0ade4f6-225a-4c66-a2f5-d5793cfa7a96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a795944f-ca69-4b3d-90b6-bf61d16fa1a8", "address": "fa:16:3e:47:62:b3", "network": {"id": "d45dd21d-a9cd-4c70-9b98-aae5f9179d8c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1287922789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa795944f-ca", "ovs_interfaceid": "a795944f-ca69-4b3d-90b6-bf61d16fa1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4a0b15f-494b-4934-8b4f-fb8df577a60d", "address": "fa:16:3e:a3:46:6e", "network": {"id": "d45dd21d-a9cd-4c70-9b98-aae5f9179d8c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1287922789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a0b15f-49", "ovs_interfaceid": "a4a0b15f-494b-4934-8b4f-fb8df577a60d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-f415abc2-3481-48e0-8dfc-915c1cff809f req-fc76708c-7c25-4e8b-a619-81663c563468 service nova] Releasing lock "refresh_cache-894f5e40-e585-41c0-9dd8-e94d8a9400ef" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG nova.network.neutron [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Successfully updated port: 20213688-43ed-4115-bd0d-bc74791d95c4 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637896.4593718, cf326e80-7293-4764-9411-ed05a5aeba23 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:38:16 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] VM Resumed (Lifecycle Event)
Jul 29 13:38:16 user nova-compute[231753]: DEBUG nova.compute.manager [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Acquiring lock "refresh_cache-55bfcd1f-2b51-4e10-84a3-e132b96111e3" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Acquired lock "refresh_cache-55bfcd1f-2b51-4e10-84a3-e132b96111e3" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG nova.network.neutron [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:38:16 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Instance spawned successfully.
Jul 29 13:38:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG nova.compute.manager [req-53565020-f90e-46de-b041-5ace7485e3fc req-20d4beb4-2879-42f1-abf4-dd0f2e1a82f8 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Received event network-changed-20213688-43ed-4115-bd0d-bc74791d95c4 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG nova.compute.manager [req-53565020-f90e-46de-b041-5ace7485e3fc req-20d4beb4-2879-42f1-abf4-dd0f2e1a82f8 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Refreshing instance network info cache due to event network-changed-20213688-43ed-4115-bd0d-bc74791d95c4. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-53565020-f90e-46de-b041-5ace7485e3fc req-20d4beb4-2879-42f1-abf4-dd0f2e1a82f8 service nova] Acquiring lock "refresh_cache-55bfcd1f-2b51-4e10-84a3-e132b96111e3" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:38:16 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:38:16 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637896.464631, cf326e80-7293-4764-9411-ed05a5aeba23 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:38:16 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] VM Started (Lifecycle Event)
Jul 29 13:38:16 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:38:16 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:38:16 user nova-compute[231753]: INFO nova.compute.manager [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Took 6.71 seconds to spawn the instance on the hypervisor.
Jul 29 13:38:16 user nova-compute[231753]: DEBUG nova.compute.manager [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG nova.network.neutron [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG nova.compute.manager [req-5c3e83d2-93b8-47b0-8bf3-2aadb654f101 req-7614792f-7e56-42db-b19c-8b6eb339d036 service nova] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Received event network-vif-plugged-fbd63de1-966b-4791-8c72-6a5e2d26a7e2 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5c3e83d2-93b8-47b0-8bf3-2aadb654f101 req-7614792f-7e56-42db-b19c-8b6eb339d036 service nova] Acquiring lock "cf326e80-7293-4764-9411-ed05a5aeba23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5c3e83d2-93b8-47b0-8bf3-2aadb654f101 req-7614792f-7e56-42db-b19c-8b6eb339d036 service nova] Lock "cf326e80-7293-4764-9411-ed05a5aeba23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5c3e83d2-93b8-47b0-8bf3-2aadb654f101 req-7614792f-7e56-42db-b19c-8b6eb339d036 service nova] Lock "cf326e80-7293-4764-9411-ed05a5aeba23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG nova.compute.manager [req-5c3e83d2-93b8-47b0-8bf3-2aadb654f101 req-7614792f-7e56-42db-b19c-8b6eb339d036 service nova] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] No waiting events found dispatching network-vif-plugged-fbd63de1-966b-4791-8c72-6a5e2d26a7e2 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:38:16 user nova-compute[231753]: WARNING nova.compute.manager [req-5c3e83d2-93b8-47b0-8bf3-2aadb654f101 req-7614792f-7e56-42db-b19c-8b6eb339d036 service nova] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Received unexpected event network-vif-plugged-fbd63de1-966b-4791-8c72-6a5e2d26a7e2 for instance with vm_state building and task_state spawning.
Jul 29 13:38:16 user nova-compute[231753]: INFO nova.compute.manager [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Took 7.71 seconds to build instance.
Jul 29 13:38:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-361f34ff-378f-49da-9db0-ed407cbb3605 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "cf326e80-7293-4764-9411-ed05a5aeba23" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.809s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hJVTmcIG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:38:16 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:38:16 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:38:16 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:38:16 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:38:16 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:38:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0725c0ca-6a66-4059-9226-50ad0987a196]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:38:16 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f76c24aa-3522-4638-b152-456b7dd3d9c0]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0] added
Jul 29 13:38:16 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31a7f42-f322-4ec1-8cd8-e974554ff76f]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[821aead3-a21a-4938-8bc7-e5d5619119b1]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hJVTmcIG {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdd (vdb) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v hJVTmcIG" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[862b8262-f62b-4a2e-aaf4-c72b4899da8e]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'hJVTmcIG'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce3f8677-ffcf-4b39-af92-73b98223e630]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG nova.network.neutron [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Updating instance_info_cache with network_info: [{"id": "20213688-43ed-4115-bd0d-bc74791d95c4", "address": "fa:16:3e:5b:23:7c", "network": {"id": "e8ad7fa5-6e98-46f4-8062-0b9eddaa76a6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-253010414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b08b115e89482f9b81e621485c5eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20213688-43", "ovs_interfaceid": "20213688-43ed-4115-bd0d-bc74791d95c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a5c4bf-d173-457a-af9e-7da6ae1d9a20]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)
Jul 29 13:38:17 user nova-compute[231753]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:38:17 user nova-compute[231753]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:38:17 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)
Jul 29 13:38:17 user nova-compute[231753]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:38:17 user nova-compute[231753]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:38:17 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Releasing lock "refresh_cache-55bfcd1f-2b51-4e10-84a3-e132b96111e3" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG nova.compute.manager [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Instance network_info: |[{"id": "20213688-43ed-4115-bd0d-bc74791d95c4", "address": "fa:16:3e:5b:23:7c", "network": {"id": "e8ad7fa5-6e98-46f4-8062-0b9eddaa76a6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-253010414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b08b115e89482f9b81e621485c5eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20213688-43", "ovs_interfaceid": "20213688-43ed-4115-bd0d-bc74791d95c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-53565020-f90e-46de-b041-5ace7485e3fc req-20d4beb4-2879-42f1-abf4-dd0f2e1a82f8 service nova] Acquired lock "refresh_cache-55bfcd1f-2b51-4e10-84a3-e132b96111e3" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG nova.network.neutron [req-53565020-f90e-46de-b041-5ace7485e3fc req-20d4beb4-2879-42f1-abf4-dd0f2e1a82f8 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Refreshing network info cache for port 20213688-43ed-4115-bd0d-bc74791d95c4 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Start _get_guest_xml network_info=[{"id": "20213688-43ed-4115-bd0d-bc74791d95c4", "address": "fa:16:3e:5b:23:7c", "network": {"id": "e8ad7fa5-6e98-46f4-8062-0b9eddaa76a6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-253010414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b08b115e89482f9b81e621485c5eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20213688-43", "ovs_interfaceid": "20213688-43ed-4115-bd0d-bc74791d95c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:38:17 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:38:17 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:38:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:38:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-822050220',display_name='tempest-ServerStableDeviceRescueTest-server-822050220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-822050220',id=18,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLyGCBaoHjvQRU5y6VqE87h4pGKr395VS9nv3boXPwLjzRxAJ8a8DweQMoJzuHlYTrldK2HJUMuE4Q1Aln3tvz5msHzQk2ShH+h/Nolt0WeNgGFtEEy1LahJXGP/vcc1rA==',key_name='tempest-keypair-1028300193',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12b08b115e89482f9b81e621485c5eb6',ramdisk_id='',reservation_id='r-80ua53lw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1348314180',owner_user_name='tempest-ServerStableDeviceRescueTest-1348314180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:38:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f8f87b5aaeb4b18b013a85a579ac48b',uuid=55bfcd1f-2b51-4e10-84a3-e132b96111e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20213688-43ed-4115-bd0d-bc74791d95c4", "address": "fa:16:3e:5b:23:7c", "network": {"id": "e8ad7fa5-6e98-46f4-8062-0b9eddaa76a6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-253010414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b08b115e89482f9b81e621485c5eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20213688-43", "ovs_interfaceid": "20213688-43ed-4115-bd0d-bc74791d95c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Converting VIF {"id": "20213688-43ed-4115-bd0d-bc74791d95c4", "address": "fa:16:3e:5b:23:7c", "network": {"id": "e8ad7fa5-6e98-46f4-8062-0b9eddaa76a6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-253010414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b08b115e89482f9b81e621485c5eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20213688-43", "ovs_interfaceid": "20213688-43ed-4115-bd0d-bc74791d95c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:23:7c,bridge_name='br-int',has_traffic_filtering=True,id=20213688-43ed-4115-bd0d-bc74791d95c4,network=Network(e8ad7fa5-6e98-46f4-8062-0b9eddaa76a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20213688-43') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG nova.objects.instance [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lazy-loading 'pci_devices' on Instance uuid 55bfcd1f-2b51-4e10-84a3-e132b96111e3 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json" returned: 0 in 0.193s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 -p 172.16.0.220:3260 --login" returned: 0 in 0.092s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8064c30a-e71e-42b0-be45-9bca1d8e63f9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0, portal: 172.16.0.220,3260]
Jul 29 13:38:17 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0, portal: 172.16.0.220,3260] successful.
Jul 29 13:38:17 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:38:17 user nova-compute[231753]:   <uuid>55bfcd1f-2b51-4e10-84a3-e132b96111e3</uuid>
Jul 29 13:38:17 user nova-compute[231753]:   <name>instance-00000012</name>
Jul 29 13:38:17 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:38:17 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:38:17 user nova-compute[231753]:   <metadata>
Jul 29 13:38:17 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:38:17 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:38:17 user nova-compute[231753]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-822050220</nova:name>
Jul 29 13:38:17 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:38:17</nova:creationTime>
Jul 29 13:38:17 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:38:17 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:38:17 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:38:17 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:38:17 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:38:17 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:38:17 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:38:17 user nova-compute[231753]:       <nova:owner>
Jul 29 13:38:17 user nova-compute[231753]:         <nova:user uuid="7f8f87b5aaeb4b18b013a85a579ac48b">tempest-ServerStableDeviceRescueTest-1348314180-project-member</nova:user>
Jul 29 13:38:17 user nova-compute[231753]:         <nova:project uuid="12b08b115e89482f9b81e621485c5eb6">tempest-ServerStableDeviceRescueTest-1348314180</nova:project>
Jul 29 13:38:17 user nova-compute[231753]:       </nova:owner>
Jul 29 13:38:17 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:38:17 user nova-compute[231753]:       <nova:ports>
Jul 29 13:38:17 user nova-compute[231753]:         <nova:port uuid="20213688-43ed-4115-bd0d-bc74791d95c4">
Jul 29 13:38:17 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 29 13:38:17 user nova-compute[231753]:         </nova:port>
Jul 29 13:38:17 user nova-compute[231753]:       </nova:ports>
Jul 29 13:38:17 user nova-compute[231753]:     </nova:instance>
Jul 29 13:38:17 user nova-compute[231753]:   </metadata>
Jul 29 13:38:17 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:38:17 user nova-compute[231753]:     <system>
Jul 29 13:38:17 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:38:17 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:38:17 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:38:17 user nova-compute[231753]:       <entry name="serial">55bfcd1f-2b51-4e10-84a3-e132b96111e3</entry>
Jul 29 13:38:17 user nova-compute[231753]:       <entry name="uuid">55bfcd1f-2b51-4e10-84a3-e132b96111e3</entry>
Jul 29 13:38:17 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:38:17 user nova-compute[231753]:     </system>
Jul 29 13:38:17 user nova-compute[231753]:   </sysinfo>
Jul 29 13:38:17 user nova-compute[231753]:   <os>
Jul 29 13:38:17 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:38:17 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:38:17 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:38:17 user nova-compute[231753]:   </os>
Jul 29 13:38:17 user nova-compute[231753]:   <features>
Jul 29 13:38:17 user nova-compute[231753]:     <acpi/>
Jul 29 13:38:17 user nova-compute[231753]:     <apic/>
Jul 29 13:38:17 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:38:17 user nova-compute[231753]:   </features>
Jul 29 13:38:17 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:38:17 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:38:17 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:38:17 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:38:17 user nova-compute[231753]:   </clock>
Jul 29 13:38:17 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:38:17 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:38:17 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:38:17 user nova-compute[231753]:   </cpu>
Jul 29 13:38:17 user nova-compute[231753]:   <devices>
Jul 29 13:38:17 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:38:17 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:38:17 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk"/>
Jul 29 13:38:17 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:38:17 user nova-compute[231753]:     </disk>
Jul 29 13:38:17 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:38:17 user nova-compute[231753]:       <mac address="fa:16:3e:5b:23:7c"/>
Jul 29 13:38:17 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:38:17 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:38:17 user nova-compute[231753]:       <target dev="tap20213688-43"/>
Jul 29 13:38:17 user nova-compute[231753]:     </interface>
Jul 29 13:38:17 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:38:17 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/console.log" append="off"/>
Jul 29 13:38:17 user nova-compute[231753]:     </serial>
Jul 29 13:38:17 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:38:17 user nova-compute[231753]:     <video>
Jul 29 13:38:17 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:38:17 user nova-compute[231753]:     </video>
Jul 29 13:38:17 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:38:17 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:38:17 user nova-compute[231753]:     </rng>
Jul 29 13:38:17 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:38:17 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:38:17 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:38:17 user nova-compute[231753]:     </memballoon>
Jul 29 13:38:17 user nova-compute[231753]:   </devices>
Jul 29 13:38:17 user nova-compute[231753]: </domain>
Jul 29 13:38:17 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:38:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-822050220',display_name='tempest-ServerStableDeviceRescueTest-server-822050220',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-822050220',id=18,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLyGCBaoHjvQRU5y6VqE87h4pGKr395VS9nv3boXPwLjzRxAJ8a8DweQMoJzuHlYTrldK2HJUMuE4Q1Aln3tvz5msHzQk2ShH+h/Nolt0WeNgGFtEEy1LahJXGP/vcc1rA==',key_name='tempest-keypair-1028300193',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='12b08b115e89482f9b81e621485c5eb6',ramdisk_id='',reservation_id='r-80ua53lw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerStableDeviceRescueTest-1348314180',owner_user_name='tempest-ServerStableDeviceRescueTest-1348314180-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:38:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f8f87b5aaeb4b18b013a85a579ac48b',uuid=55bfcd1f-2b51-4e10-84a3-e132b96111e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "20213688-43ed-4115-bd0d-bc74791d95c4", "address": "fa:16:3e:5b:23:7c", "network": {"id": "e8ad7fa5-6e98-46f4-8062-0b9eddaa76a6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-253010414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b08b115e89482f9b81e621485c5eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20213688-43", "ovs_interfaceid": "20213688-43ed-4115-bd0d-bc74791d95c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Converting VIF {"id": "20213688-43ed-4115-bd0d-bc74791d95c4", "address": "fa:16:3e:5b:23:7c", "network": {"id": "e8ad7fa5-6e98-46f4-8062-0b9eddaa76a6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-253010414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b08b115e89482f9b81e621485c5eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20213688-43", "ovs_interfaceid": "20213688-43ed-4115-bd0d-bc74791d95c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:23:7c,bridge_name='br-int',has_traffic_filtering=True,id=20213688-43ed-4115-bd0d-bc74791d95c4,network=Network(e8ad7fa5-6e98-46f4-8062-0b9eddaa76a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20213688-43') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG os_vif [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:23:7c,bridge_name='br-int',has_traffic_filtering=True,id=20213688-43ed-4115-bd0d-bc74791d95c4,network=Network(e8ad7fa5-6e98-46f4-8062-0b9eddaa76a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20213688-43') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a98f0f6e-6a24-441c-b38a-98cb9608b1ec]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap20213688-43, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap20213688-43, col_values=(('external_ids', {'iface-id': '20213688-43ed-4115-bd0d-bc74791d95c4', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:23:7c', 'vm-uuid': '55bfcd1f-2b51-4e10-84a3-e132b96111e3'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:17 user nova-compute[231753]: INFO os_vif [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:23:7c,bridge_name='br-int',has_traffic_filtering=True,id=20213688-43ed-4115-bd0d-bc74791d95c4,network=Network(e8ad7fa5-6e98-46f4-8062-0b9eddaa76a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20213688-43')
Jul 29 13:38:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c4e251-3d26-41e5-a7dc-7749aa36396b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)
Jul 29 13:38:17 user nova-compute[231753]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:38:17 user nova-compute[231753]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:38:17 user nova-compute[231753]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 (non-flash)
Jul 29 13:38:17 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)
Jul 29 13:38:17 user nova-compute[231753]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:38:17 user nova-compute[231753]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:38:17 user nova-compute[231753]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 (non-flash)
Jul 29 13:38:17 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.472s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] HCTL ('36', '-', '-', 0) found on session 18 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e715f7b-8d38-49c4-8152-1924c50f4356]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Searching for a device in session 18 and hctl ['36', '*', '*', 0] yield: sde {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hJVTmcIG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] No VIF found with MAC fa:16:3e:5b:23:7c, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e7da3f-33d9-4f58-8c98-72869b679850/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e7da3f-33d9-4f58-8c98-72869b679850/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e7da3f-33d9-4f58-8c98-72869b679850/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG nova.network.neutron [req-53565020-f90e-46de-b041-5ace7485e3fc req-20d4beb4-2879-42f1-abf4-dd0f2e1a82f8 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Updated VIF entry in instance network info cache for port 20213688-43ed-4115-bd0d-bc74791d95c4. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG nova.network.neutron [req-53565020-f90e-46de-b041-5ace7485e3fc req-20d4beb4-2879-42f1-abf4-dd0f2e1a82f8 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Updating instance_info_cache with network_info: [{"id": "20213688-43ed-4115-bd0d-bc74791d95c4", "address": "fa:16:3e:5b:23:7c", "network": {"id": "e8ad7fa5-6e98-46f4-8062-0b9eddaa76a6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-253010414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b08b115e89482f9b81e621485c5eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20213688-43", "ovs_interfaceid": "20213688-43ed-4115-bd0d-bc74791d95c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b5e7da3f-33d9-4f58-8c98-72869b679850/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-53565020-f90e-46de-b041-5ace7485e3fc req-20d4beb4-2879-42f1-abf4-dd0f2e1a82f8 service nova] Releasing lock "refresh_cache-55bfcd1f-2b51-4e10-84a3-e132b96111e3" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:18 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.513s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:38:18 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] <== connect_volume: return (1519ms) {'type': 'block', 'scsi_wwn': '26363643234343838', 'path': '/dev/sde'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:38:18 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26363643234343838', 'path': '/dev/sde'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:38:18 user nova-compute[231753]: DEBUG nova.objects.instance [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lazy-loading 'flavor' on Instance uuid 3fed0e1e-c8a7-43cc-bef6-14410111d3cb {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:38:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:18 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 13:38:18 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:38:18 user nova-compute[231753]:   <source dev="/dev/sde"/>
Jul 29 13:38:18 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:38:18 user nova-compute[231753]:   <serial>6bc82b7d-5f8e-4c78-9880-c589a410d3a0</serial>
Jul 29 13:38:18 user nova-compute[231753]: </disk>
Jul 29 13:38:18 user nova-compute[231753]:  {{(pid=231753) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 13:38:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:18 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:38:18 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] No BDM found with device name vdb, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:38:18 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] No VIF found with MAC fa:16:3e:3a:d8:c5, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:38:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json" returned: 0 in 0.238s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d88802a6-5a0d-4889-9ea1-b54f19b2e190 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "3fed0e1e-c8a7-43cc-bef6-14410111d3cb" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.277s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:19 user nova-compute[231753]: DEBUG nova.compute.manager [req-6b7d3a53-4895-46f3-be2f-117c1c212e65 req-99b6131b-d8ea-43cb-a65a-623aca3d0128 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Received event network-vif-plugged-20213688-43ed-4115-bd0d-bc74791d95c4 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6b7d3a53-4895-46f3-be2f-117c1c212e65 req-99b6131b-d8ea-43cb-a65a-623aca3d0128 service nova] Acquiring lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6b7d3a53-4895-46f3-be2f-117c1c212e65 req-99b6131b-d8ea-43cb-a65a-623aca3d0128 service nova] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6b7d3a53-4895-46f3-be2f-117c1c212e65 req-99b6131b-d8ea-43cb-a65a-623aca3d0128 service nova] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:19 user nova-compute[231753]: DEBUG nova.compute.manager [req-6b7d3a53-4895-46f3-be2f-117c1c212e65 req-99b6131b-d8ea-43cb-a65a-623aca3d0128 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] No waiting events found dispatching network-vif-plugged-20213688-43ed-4115-bd0d-bc74791d95c4 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:38:19 user nova-compute[231753]: WARNING nova.compute.manager [req-6b7d3a53-4895-46f3-be2f-117c1c212e65 req-99b6131b-d8ea-43cb-a65a-623aca3d0128 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Received unexpected event network-vif-plugged-20213688-43ed-4115-bd0d-bc74791d95c4 for instance with vm_state building and task_state spawning.
Jul 29 13:38:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdb (vdc) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:38:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8/disk --force-share --output=json" returned: 0 in 0.259s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fed0e1e-c8a7-43cc-bef6-14410111d3cb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fed0e1e-c8a7-43cc-bef6-14410111d3cb/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fed0e1e-c8a7-43cc-bef6-14410111d3cb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3fed0e1e-c8a7-43cc-bef6-14410111d3cb/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637901.6366763, 55bfcd1f-2b51-4e10-84a3-e132b96111e3 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:38:22 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] VM Resumed (Lifecycle Event)
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.compute.manager [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.compute.manager [req-7ac370fc-3623-4fe4-b7b4-0991c4d5d63e req-74386075-d83b-480a-929a-32b95f9e5d74 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Received event network-vif-plugged-20213688-43ed-4115-bd0d-bc74791d95c4 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7ac370fc-3623-4fe4-b7b4-0991c4d5d63e req-74386075-d83b-480a-929a-32b95f9e5d74 service nova] Acquiring lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7ac370fc-3623-4fe4-b7b4-0991c4d5d63e req-74386075-d83b-480a-929a-32b95f9e5d74 service nova] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7ac370fc-3623-4fe4-b7b4-0991c4d5d63e req-74386075-d83b-480a-929a-32b95f9e5d74 service nova] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.compute.manager [req-7ac370fc-3623-4fe4-b7b4-0991c4d5d63e req-74386075-d83b-480a-929a-32b95f9e5d74 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] No waiting events found dispatching network-vif-plugged-20213688-43ed-4115-bd0d-bc74791d95c4 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:38:22 user nova-compute[231753]: WARNING nova.compute.manager [req-7ac370fc-3623-4fe4-b7b4-0991c4d5d63e req-74386075-d83b-480a-929a-32b95f9e5d74 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Received unexpected event network-vif-plugged-20213688-43ed-4115-bd0d-bc74791d95c4 for instance with vm_state building and task_state spawning.
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:38:22 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:38:22 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=7111MB free_disk=25.44983673095703GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 13:38:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:22 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Instance spawned successfully.
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:38:22 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637901.6374748, 55bfcd1f-2b51-4e10-84a3-e132b96111e3 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:38:22 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] VM Started (Lifecycle Event)
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:38:22 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Applying migration context for instance 63fad324-aac2-4d60-b4ce-a32a5736657d as it has an incoming, in-progress migration 9511cb2a-137a-4059-93c7-22c78e5e7652. Migration status is finished {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Jul 29 13:38:22 user nova-compute[231753]: INFO nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Updating resource usage from migration 9511cb2a-137a-4059-93c7-22c78e5e7652
Jul 29 13:38:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:22 user nova-compute[231753]: INFO nova.compute.manager [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Took 7.30 seconds to spawn the instance on the hypervisor.
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.compute.manager [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b67b98f8-a7b3-499e-ba32-9520bbced960 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 299b7f21-b198-437b-9d5c-1269d5e9b7c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 3fed0e1e-c8a7-43cc-bef6-14410111d3cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b5e7da3f-33d9-4f58-8c98-72869b679850 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 7e2615c1-b03e-4076-bcd9-3585fb11b8ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8ea52d41-7ec3-44d7-8421-133000ee887b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 4475f276-acc4-44f1-a5fa-6a7fb2165493 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Migration 9511cb2a-137a-4059-93c7-22c78e5e7652 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 63fad324-aac2-4d60-b4ce-a32a5736657d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 20, 'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 894f5e40-e585-41c0-9dd8-e94d8a9400ef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance cf326e80-7293-4764-9411-ed05a5aeba23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 55bfcd1f-2b51-4e10-84a3-e132b96111e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=31GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 13:38:22 user nova-compute[231753]: INFO nova.compute.manager [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Took 8.68 seconds to build instance.
Jul 29 13:38:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-cf384eb7-8c2a-44f3-94f1-bc7b89cdb593 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.793s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:38:22 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 13:38:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.788s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:38:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:38:23 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Creating image(s)
Jul 29 13:38:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Did not create local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 29 13:38:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Ensure instance console log exists: /opt/stack/data/nova/instances/894f5e40-e585-41c0-9dd8-e94d8a9400ef/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:38:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Start _get_guest_xml network_info=[{"id": "984d64db-ae0d-45be-a0cd-3bcc5b00008b", "address": "fa:16:3e:4f:92:db", "network": {"id": "322b52d5-b11a-4c3c-a30b-adfbfee8d1b2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1087548543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap984d64db-ae", "ovs_interfaceid": "984d64db-ae0d-45be-a0cd-3bcc5b00008b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dcd40805-07c1-45d2-a795-f3085231f735", "address": "fa:16:3e:b4:73:7b", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcd40805-07", "ovs_interfaceid": "dcd40805-07c1-45d2-a795-f3085231f735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a95b92c-9a5b-4fd4-bbfd-36063a073c11", "address": "fa:16:3e:ff:85:55", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a95b92c-9a", "ovs_interfaceid": "4a95b92c-9a5b-4fd4-bbfd-36063a073c11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2789bcf9-55ed-4893-85f4-7595c6df0400", "address": "fa:16:3e:ae:53:f8", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2789bcf9-55", "ovs_interfaceid": "2789bcf9-55ed-4893-85f4-7595c6df0400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0ade4f6-225a-4c66-a2f5-d5793cfa7a96", "address": "fa:16:3e:43:c1:d4", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ade4f6-22", "ovs_interfaceid": "f0ade4f6-225a-4c66-a2f5-d5793cfa7a96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a795944f-ca69-4b3d-90b6-bf61d16fa1a8", "address": "fa:16:3e:47:62:b3", "network": {"id": "d45dd21d-a9cd-4c70-9b98-aae5f9179d8c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1287922789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa795944f-ca", "ovs_interfaceid": "a795944f-ca69-4b3d-90b6-bf61d16fa1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4a0b15f-494b-4934-8b4f-fb8df577a60d", "address": "fa:16:3e:a3:46:6e", "network": {"id": "d45dd21d-a9cd-4c70-9b98-aae5f9179d8c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1287922789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a0b15f-49", "ovs_interfaceid": "a4a0b15f-494b-4934-8b4f-fb8df577a60d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uSQsjNbX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '894f5e40-e585-41c0-9dd8-e94d8a9400ef', 'attached_at': '', 'detached_at': '', 'volume_id': 'b82c6905-a234-45d8-945c-ab8abef447d0', 'serial': 'b82c6905-a234-45d8-945c-ab8abef447d0'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': 'f5450ed6-8b0c-439d-966d-e148c59e365a', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FkLqNyZH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '894f5e40-e585-41c0-9dd8-e94d8a9400ef', 'attached_at': '', 'detached_at': '', 'volume_id': '84ca643c-1d19-4f8d-b0a5-25eb9179b1be', 'serial': '84ca643c-1d19-4f8d-b0a5-25eb9179b1be'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '802aead6-b1de-44bb-b6c1-fe9c54eb8d35', 'boot_index': 1, 'disk_bus': 'virtio', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'enLdoxWs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '894f5e40-e585-41c0-9dd8-e94d8a9400ef', 'attached_at': '', 'detached_at': '', 'volume_id': '845a966e-2db8-49d3-b406-6a630cd840b3', 'serial': '845a966e-2db8-49d3-b406-6a630cd840b3'}, 'guest_format': None, 'mount_device': '/dev/vdc', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': 'ce26584f-8072-41ea-8ae7-9bf82950f12f', 'boot_index': 2, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:38:23 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:38:23 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:38:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:38:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:38:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:38:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:38:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:38:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:38:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:38:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:38:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:38:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:38:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:38:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:38:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:38:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:38:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:38:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:38:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:38:23 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uSQsjNbX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:38:23 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:38:23 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:38:23 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:38:23 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:38:23 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:38:24 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:38:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2031d931-55df-4238-a131-aeb8eb738a9a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:38:24 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a5da68-766a-48de-bcaa-b7a8b449a1b3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0] added
Jul 29 13:38:24 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.030s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8669d1f4-cfce-4f7c-a0f9-a64890987e64]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0134fdf-3e7f-4a8e-9d4d-871195e50104]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uSQsjNbX {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v uSQsjNbX" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[debce854-3d02-409e-a336-968be64e093e]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'uSQsjNbX'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[750a6322-24dd-4a54-8881-a4f918d22659]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[36150782-e53a-49c0-8c1b-a69b8286be70]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)
Jul 29 13:38:24 user nova-compute[231753]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:38:24 user nova-compute[231753]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:38:24 user nova-compute[231753]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 (non-flash)
Jul 29 13:38:24 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)
Jul 29 13:38:24 user nova-compute[231753]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:38:24 user nova-compute[231753]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:38:24 user nova-compute[231753]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 (non-flash)
Jul 29 13:38:24 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96c0ad1-17c9-4703-80be-178829cf3223]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0, portal: 172.16.0.220,3260]
Jul 29 13:38:24 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0, portal: 172.16.0.220,3260] successful.
Jul 29 13:38:24 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7614e17a-7517-4069-9c96-f30a399820ec]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e46adb9b-c09c-4bb6-b06e-b721e9c2af3f]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)
Jul 29 13:38:24 user nova-compute[231753]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:38:24 user nova-compute[231753]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:38:24 user nova-compute[231753]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 (non-flash)
Jul 29 13:38:24 user nova-compute[231753]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 (non-flash)
Jul 29 13:38:24 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)
Jul 29 13:38:24 user nova-compute[231753]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:38:24 user nova-compute[231753]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:38:24 user nova-compute[231753]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 (non-flash)
Jul 29 13:38:24 user nova-compute[231753]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 (non-flash)
Jul 29 13:38:24 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.340s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] HCTL ('37', '-', '-', 0) found on session 19 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c09d599-b664-47fd-b27a-c2665104d025]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Searching for a device in session 19 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:38:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uSQsjNbX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.380s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] <== connect_volume: return (1382ms) {'type': 'block', 'scsi_wwn': '23965373965396563', 'path': '/dev/sdf'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23965373965396563', 'path': '/dev/sdf'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FkLqNyZH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:38:25 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:38:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:38:25 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:38:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:38:25 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:38:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[09f4adcb-ea01-4cfb-83c3-009360fce2f2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:38:25 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[aaf45b70-dddb-4996-995c-374ef5036afe]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be] added
Jul 29 13:38:25 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9e6f154-6afa-49f3-a9bb-cbd8369b2e7b]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.029s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f80d88f8-8844-49fc-89e4-dea4103e4d82]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FkLqNyZH {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FkLqNyZH" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c95f32c8-a46b-4059-8531-dcae79bca712]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FkLqNyZH'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[52f943ad-7d21-4950-838d-af826dfb8475]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[40c1d43d-8239-4899-ba26-cb14453190a1]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)
Jul 29 13:38:25 user nova-compute[231753]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:38:25 user nova-compute[231753]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:38:25 user nova-compute[231753]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 (non-flash)
Jul 29 13:38:25 user nova-compute[231753]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 (non-flash)
Jul 29 13:38:25 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)
Jul 29 13:38:25 user nova-compute[231753]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:38:25 user nova-compute[231753]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:38:25 user nova-compute[231753]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 (non-flash)
Jul 29 13:38:25 user nova-compute[231753]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 (non-flash)
Jul 29 13:38:25 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be -p 172.16.0.220:3260 --login" returned: 0 in 0.097s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[143f9b8f-02ad-407b-8b9c-eedf84fb5030]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be, portal: 172.16.0.220,3260]
Jul 29 13:38:25 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be, portal: 172.16.0.220,3260] successful.
Jul 29 13:38:25 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.032s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee8c14b7-a562-46ca-bc2c-350abaa2cc33]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2dc9dd8-7495-4142-9db6-cf3800a473fa]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)
Jul 29 13:38:25 user nova-compute[231753]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:38:25 user nova-compute[231753]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:38:25 user nova-compute[231753]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 (non-flash)
Jul 29 13:38:25 user nova-compute[231753]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 (non-flash)
Jul 29 13:38:25 user nova-compute[231753]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be (non-flash)
Jul 29 13:38:25 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)
Jul 29 13:38:25 user nova-compute[231753]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:38:25 user nova-compute[231753]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:38:25 user nova-compute[231753]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 (non-flash)
Jul 29 13:38:25 user nova-compute[231753]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 (non-flash)
Jul 29 13:38:25 user nova-compute[231753]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be (non-flash)
Jul 29 13:38:25 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.401s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] HCTL ('38', '-', '-', 0) found on session 20 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6415f260-c5e0-4ec3-8e03-f541be0877ee]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Searching for a device in session 20 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:38:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FkLqNyZH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:38:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.468s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:38:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] <== connect_volume: return (1469ms) {'type': 'block', 'scsi_wwn': '23166326537376134', 'path': '/dev/sdg'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:38:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23166326537376134', 'path': '/dev/sdg'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:38:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:38:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'enLdoxWs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:38:26 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:38:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:38:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:38:26 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:38:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:38:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:38:26 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:38:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:26 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[458f51a9-4596-475e-996b-7b3b7f9f2fe3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:38:26 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:26 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9574350b-477b-44ba-889c-56b90b23427e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3] added
Jul 29 13:38:26 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e58b6ed-3b6d-4060-8886-dcc2e7350e0c]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee149ed7-4064-4665-b444-ae30453fccb5]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v enLdoxWs {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v enLdoxWs" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be6c853-fb54-40e4-a612-c62ca10bb708]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'enLdoxWs'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[514b5159-a128-4682-bede-a92774bbde98]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f69376c-bdcf-4e41-a85d-194b86f3256b]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)
Jul 29 13:38:27 user nova-compute[231753]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:38:27 user nova-compute[231753]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:38:27 user nova-compute[231753]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 (non-flash)
Jul 29 13:38:27 user nova-compute[231753]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 (non-flash)
Jul 29 13:38:27 user nova-compute[231753]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be (non-flash)
Jul 29 13:38:27 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)
Jul 29 13:38:27 user nova-compute[231753]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:38:27 user nova-compute[231753]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:38:27 user nova-compute[231753]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 (non-flash)
Jul 29 13:38:27 user nova-compute[231753]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 (non-flash)
Jul 29 13:38:27 user nova-compute[231753]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be (non-flash)
Jul 29 13:38:27 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 -p 172.16.0.220:3260 --login" returned: 0 in 0.099s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[130539ef-f246-458a-b765-c14fb9406936]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3, portal: 172.16.0.220,3260]
Jul 29 13:38:27 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3, portal: 172.16.0.220,3260] successful.
Jul 29 13:38:27 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c076afc-3914-4f72-a4a9-03f7982587d3]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[34e36cca-6263-4cb0-b1f9-4779182dc9b1]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)
Jul 29 13:38:27 user nova-compute[231753]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:38:27 user nova-compute[231753]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:38:27 user nova-compute[231753]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 (non-flash)
Jul 29 13:38:27 user nova-compute[231753]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 (non-flash)
Jul 29 13:38:27 user nova-compute[231753]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be (non-flash)
Jul 29 13:38:27 user nova-compute[231753]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 (non-flash)
Jul 29 13:38:27 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)
Jul 29 13:38:27 user nova-compute[231753]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:38:27 user nova-compute[231753]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:38:27 user nova-compute[231753]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 (non-flash)
Jul 29 13:38:27 user nova-compute[231753]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 (non-flash)
Jul 29 13:38:27 user nova-compute[231753]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be (non-flash)
Jul 29 13:38:27 user nova-compute[231753]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 (non-flash)
Jul 29 13:38:27 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.405s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] HCTL ('39', '-', '-', 0) found on session 21 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d04fe9-3bcc-4ee6-aabf-1dd9373eb899]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Searching for a device in session 21 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:38:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'enLdoxWs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.446s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] <== connect_volume: return (1447ms) {'type': 'block', 'scsi_wwn': '23465636634323537', 'path': '/dev/sdh'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23465636634323537', 'path': '/dev/sdh'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:37:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-760304032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-760304032',id=16,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJAA7nV1bCNkU952F/cZ76kN28PQKANdkmvJPcn5ae13AzCEKy4tPqxG+We4+ntx5/wii47tLrGtk//N9hghMdTQ8qL5bl7Q+UzjCEdRqHOtTxevUzaqM4O1XrZLEej0g==',key_name='tempest-keypair-1726319149',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11bd37c7c8524d2b961e5b1aa1e92e9e',ramdisk_id='',reservation_id='r-vbcco03p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1447223842',owner_user_name='tempest-TaggedBootDevicesTest_v242-1447223842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:37:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85b304003a524464a7d013228d650d3b',uuid=894f5e40-e585-41c0-9dd8-e94d8a9400ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "984d64db-ae0d-45be-a0cd-3bcc5b00008b", "address": "fa:16:3e:4f:92:db", "network": {"id": "322b52d5-b11a-4c3c-a30b-adfbfee8d1b2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1087548543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap984d64db-ae", "ovs_interfaceid": "984d64db-ae0d-45be-a0cd-3bcc5b00008b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converting VIF {"id": "984d64db-ae0d-45be-a0cd-3bcc5b00008b", "address": "fa:16:3e:4f:92:db", "network": {"id": "322b52d5-b11a-4c3c-a30b-adfbfee8d1b2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1087548543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap984d64db-ae", "ovs_interfaceid": "984d64db-ae0d-45be-a0cd-3bcc5b00008b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:92:db,bridge_name='br-int',has_traffic_filtering=True,id=984d64db-ae0d-45be-a0cd-3bcc5b00008b,network=Network(322b52d5-b11a-4c3c-a30b-adfbfee8d1b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap984d64db-ae') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:37:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-760304032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-760304032',id=16,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJAA7nV1bCNkU952F/cZ76kN28PQKANdkmvJPcn5ae13AzCEKy4tPqxG+We4+ntx5/wii47tLrGtk//N9hghMdTQ8qL5bl7Q+UzjCEdRqHOtTxevUzaqM4O1XrZLEej0g==',key_name='tempest-keypair-1726319149',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11bd37c7c8524d2b961e5b1aa1e92e9e',ramdisk_id='',reservation_id='r-vbcco03p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1447223842',owner_user_name='tempest-TaggedBootDevicesTest_v242-1447223842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:37:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85b304003a524464a7d013228d650d3b',uuid=894f5e40-e585-41c0-9dd8-e94d8a9400ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dcd40805-07c1-45d2-a795-f3085231f735", "address": "fa:16:3e:b4:73:7b", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcd40805-07", "ovs_interfaceid": "dcd40805-07c1-45d2-a795-f3085231f735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converting VIF {"id": "dcd40805-07c1-45d2-a795-f3085231f735", "address": "fa:16:3e:b4:73:7b", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcd40805-07", "ovs_interfaceid": "dcd40805-07c1-45d2-a795-f3085231f735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:73:7b,bridge_name='br-int',has_traffic_filtering=True,id=dcd40805-07c1-45d2-a795-f3085231f735,network=Network(022a1d0e-dd19-41f2-9079-ce71ed9530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdcd40805-07') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:37:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-760304032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-760304032',id=16,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJAA7nV1bCNkU952F/cZ76kN28PQKANdkmvJPcn5ae13AzCEKy4tPqxG+We4+ntx5/wii47tLrGtk//N9hghMdTQ8qL5bl7Q+UzjCEdRqHOtTxevUzaqM4O1XrZLEej0g==',key_name='tempest-keypair-1726319149',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11bd37c7c8524d2b961e5b1aa1e92e9e',ramdisk_id='',reservation_id='r-vbcco03p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1447223842',owner_user_name='tempest-TaggedBootDevicesTest_v242-1447223842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:37:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85b304003a524464a7d013228d650d3b',uuid=894f5e40-e585-41c0-9dd8-e94d8a9400ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a95b92c-9a5b-4fd4-bbfd-36063a073c11", "address": "fa:16:3e:ff:85:55", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a95b92c-9a", "ovs_interfaceid": "4a95b92c-9a5b-4fd4-bbfd-36063a073c11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converting VIF {"id": "4a95b92c-9a5b-4fd4-bbfd-36063a073c11", "address": "fa:16:3e:ff:85:55", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a95b92c-9a", "ovs_interfaceid": "4a95b92c-9a5b-4fd4-bbfd-36063a073c11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:85:55,bridge_name='br-int',has_traffic_filtering=True,id=4a95b92c-9a5b-4fd4-bbfd-36063a073c11,network=Network(022a1d0e-dd19-41f2-9079-ce71ed9530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4a95b92c-9a') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:37:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-760304032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-760304032',id=16,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJAA7nV1bCNkU952F/cZ76kN28PQKANdkmvJPcn5ae13AzCEKy4tPqxG+We4+ntx5/wii47tLrGtk//N9hghMdTQ8qL5bl7Q+UzjCEdRqHOtTxevUzaqM4O1XrZLEej0g==',key_name='tempest-keypair-1726319149',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11bd37c7c8524d2b961e5b1aa1e92e9e',ramdisk_id='',reservation_id='r-vbcco03p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1447223842',owner_user_name='tempest-TaggedBootDevicesTest_v242-1447223842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:37:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85b304003a524464a7d013228d650d3b',uuid=894f5e40-e585-41c0-9dd8-e94d8a9400ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2789bcf9-55ed-4893-85f4-7595c6df0400", "address": "fa:16:3e:ae:53:f8", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2789bcf9-55", "ovs_interfaceid": "2789bcf9-55ed-4893-85f4-7595c6df0400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converting VIF {"id": "2789bcf9-55ed-4893-85f4-7595c6df0400", "address": "fa:16:3e:ae:53:f8", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2789bcf9-55", "ovs_interfaceid": "2789bcf9-55ed-4893-85f4-7595c6df0400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:53:f8,bridge_name='br-int',has_traffic_filtering=True,id=2789bcf9-55ed-4893-85f4-7595c6df0400,network=Network(022a1d0e-dd19-41f2-9079-ce71ed9530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2789bcf9-55') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:37:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-760304032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-760304032',id=16,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJAA7nV1bCNkU952F/cZ76kN28PQKANdkmvJPcn5ae13AzCEKy4tPqxG+We4+ntx5/wii47tLrGtk//N9hghMdTQ8qL5bl7Q+UzjCEdRqHOtTxevUzaqM4O1XrZLEej0g==',key_name='tempest-keypair-1726319149',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11bd37c7c8524d2b961e5b1aa1e92e9e',ramdisk_id='',reservation_id='r-vbcco03p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1447223842',owner_user_name='tempest-TaggedBootDevicesTest_v242-1447223842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:37:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85b304003a524464a7d013228d650d3b',uuid=894f5e40-e585-41c0-9dd8-e94d8a9400ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0ade4f6-225a-4c66-a2f5-d5793cfa7a96", "address": "fa:16:3e:43:c1:d4", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ade4f6-22", "ovs_interfaceid": "f0ade4f6-225a-4c66-a2f5-d5793cfa7a96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converting VIF {"id": "f0ade4f6-225a-4c66-a2f5-d5793cfa7a96", "address": "fa:16:3e:43:c1:d4", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ade4f6-22", "ovs_interfaceid": "f0ade4f6-225a-4c66-a2f5-d5793cfa7a96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:c1:d4,bridge_name='br-int',has_traffic_filtering=True,id=f0ade4f6-225a-4c66-a2f5-d5793cfa7a96,network=Network(022a1d0e-dd19-41f2-9079-ce71ed9530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0ade4f6-22') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:37:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-760304032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-760304032',id=16,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJAA7nV1bCNkU952F/cZ76kN28PQKANdkmvJPcn5ae13AzCEKy4tPqxG+We4+ntx5/wii47tLrGtk//N9hghMdTQ8qL5bl7Q+UzjCEdRqHOtTxevUzaqM4O1XrZLEej0g==',key_name='tempest-keypair-1726319149',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11bd37c7c8524d2b961e5b1aa1e92e9e',ramdisk_id='',reservation_id='r-vbcco03p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1447223842',owner_user_name='tempest-TaggedBootDevicesTest_v242-1447223842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:37:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85b304003a524464a7d013228d650d3b',uuid=894f5e40-e585-41c0-9dd8-e94d8a9400ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a795944f-ca69-4b3d-90b6-bf61d16fa1a8", "address": "fa:16:3e:47:62:b3", "network": {"id": "d45dd21d-a9cd-4c70-9b98-aae5f9179d8c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1287922789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa795944f-ca", "ovs_interfaceid": "a795944f-ca69-4b3d-90b6-bf61d16fa1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converting VIF {"id": "a795944f-ca69-4b3d-90b6-bf61d16fa1a8", "address": "fa:16:3e:47:62:b3", "network": {"id": "d45dd21d-a9cd-4c70-9b98-aae5f9179d8c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1287922789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa795944f-ca", "ovs_interfaceid": "a795944f-ca69-4b3d-90b6-bf61d16fa1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:62:b3,bridge_name='br-int',has_traffic_filtering=True,id=a795944f-ca69-4b3d-90b6-bf61d16fa1a8,network=Network(d45dd21d-a9cd-4c70-9b98-aae5f9179d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa795944f-ca') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:37:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-760304032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-760304032',id=16,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJAA7nV1bCNkU952F/cZ76kN28PQKANdkmvJPcn5ae13AzCEKy4tPqxG+We4+ntx5/wii47tLrGtk//N9hghMdTQ8qL5bl7Q+UzjCEdRqHOtTxevUzaqM4O1XrZLEej0g==',key_name='tempest-keypair-1726319149',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11bd37c7c8524d2b961e5b1aa1e92e9e',ramdisk_id='',reservation_id='r-vbcco03p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1447223842',owner_user_name='tempest-TaggedBootDevicesTest_v242-1447223842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:37:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85b304003a524464a7d013228d650d3b',uuid=894f5e40-e585-41c0-9dd8-e94d8a9400ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4a0b15f-494b-4934-8b4f-fb8df577a60d", "address": "fa:16:3e:a3:46:6e", "network": {"id": "d45dd21d-a9cd-4c70-9b98-aae5f9179d8c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1287922789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a0b15f-49", "ovs_interfaceid": "a4a0b15f-494b-4934-8b4f-fb8df577a60d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converting VIF {"id": "a4a0b15f-494b-4934-8b4f-fb8df577a60d", "address": "fa:16:3e:a3:46:6e", "network": {"id": "d45dd21d-a9cd-4c70-9b98-aae5f9179d8c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1287922789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a0b15f-49", "ovs_interfaceid": "a4a0b15f-494b-4934-8b4f-fb8df577a60d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:46:6e,bridge_name='br-int',has_traffic_filtering=True,id=a4a0b15f-494b-4934-8b4f-fb8df577a60d,network=Network(d45dd21d-a9cd-4c70-9b98-aae5f9179d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4a0b15f-49') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.objects.instance [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Lazy-loading 'pci_devices' on Instance uuid 894f5e40-e585-41c0-9dd8-e94d8a9400ef {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:38:28 user nova-compute[231753]:   <uuid>894f5e40-e585-41c0-9dd8-e94d8a9400ef</uuid>
Jul 29 13:38:28 user nova-compute[231753]:   <name>instance-00000010</name>
Jul 29 13:38:28 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:38:28 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:38:28 user nova-compute[231753]:   <metadata>
Jul 29 13:38:28 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:38:28 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:38:28 user nova-compute[231753]:       <nova:name>tempest-device-tagging-server-760304032</nova:name>
Jul 29 13:38:28 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:38:23</nova:creationTime>
Jul 29 13:38:28 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:38:28 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:38:28 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:38:28 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:38:28 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:38:28 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:38:28 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:38:28 user nova-compute[231753]:       <nova:owner>
Jul 29 13:38:28 user nova-compute[231753]:         <nova:user uuid="85b304003a524464a7d013228d650d3b">tempest-TaggedBootDevicesTest_v242-1447223842-project-member</nova:user>
Jul 29 13:38:28 user nova-compute[231753]:         <nova:project uuid="11bd37c7c8524d2b961e5b1aa1e92e9e">tempest-TaggedBootDevicesTest_v242-1447223842</nova:project>
Jul 29 13:38:28 user nova-compute[231753]:       </nova:owner>
Jul 29 13:38:28 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:38:28 user nova-compute[231753]:       <nova:ports>
Jul 29 13:38:28 user nova-compute[231753]:         <nova:port uuid="984d64db-ae0d-45be-a0cd-3bcc5b00008b">
Jul 29 13:38:28 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 29 13:38:28 user nova-compute[231753]:         </nova:port>
Jul 29 13:38:28 user nova-compute[231753]:         <nova:port uuid="dcd40805-07c1-45d2-a795-f3085231f735">
Jul 29 13:38:28 user nova-compute[231753]:           <nova:ip type="fixed" address="10.1.1.182" ipVersion="4"/>
Jul 29 13:38:28 user nova-compute[231753]:         </nova:port>
Jul 29 13:38:28 user nova-compute[231753]:         <nova:port uuid="4a95b92c-9a5b-4fd4-bbfd-36063a073c11">
Jul 29 13:38:28 user nova-compute[231753]:           <nova:ip type="fixed" address="10.1.1.224" ipVersion="4"/>
Jul 29 13:38:28 user nova-compute[231753]:         </nova:port>
Jul 29 13:38:28 user nova-compute[231753]:         <nova:port uuid="2789bcf9-55ed-4893-85f4-7595c6df0400">
Jul 29 13:38:28 user nova-compute[231753]:           <nova:ip type="fixed" address="10.1.1.128" ipVersion="4"/>
Jul 29 13:38:28 user nova-compute[231753]:         </nova:port>
Jul 29 13:38:28 user nova-compute[231753]:         <nova:port uuid="f0ade4f6-225a-4c66-a2f5-d5793cfa7a96">
Jul 29 13:38:28 user nova-compute[231753]:           <nova:ip type="fixed" address="10.1.1.35" ipVersion="4"/>
Jul 29 13:38:28 user nova-compute[231753]:         </nova:port>
Jul 29 13:38:28 user nova-compute[231753]:         <nova:port uuid="a795944f-ca69-4b3d-90b6-bf61d16fa1a8">
Jul 29 13:38:28 user nova-compute[231753]:           <nova:ip type="fixed" address="10.2.2.100" ipVersion="4"/>
Jul 29 13:38:28 user nova-compute[231753]:         </nova:port>
Jul 29 13:38:28 user nova-compute[231753]:         <nova:port uuid="a4a0b15f-494b-4934-8b4f-fb8df577a60d">
Jul 29 13:38:28 user nova-compute[231753]:           <nova:ip type="fixed" address="10.2.2.200" ipVersion="4"/>
Jul 29 13:38:28 user nova-compute[231753]:         </nova:port>
Jul 29 13:38:28 user nova-compute[231753]:       </nova:ports>
Jul 29 13:38:28 user nova-compute[231753]:     </nova:instance>
Jul 29 13:38:28 user nova-compute[231753]:   </metadata>
Jul 29 13:38:28 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:38:28 user nova-compute[231753]:     <system>
Jul 29 13:38:28 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:38:28 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:38:28 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:38:28 user nova-compute[231753]:       <entry name="serial">894f5e40-e585-41c0-9dd8-e94d8a9400ef</entry>
Jul 29 13:38:28 user nova-compute[231753]:       <entry name="uuid">894f5e40-e585-41c0-9dd8-e94d8a9400ef</entry>
Jul 29 13:38:28 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:38:28 user nova-compute[231753]:     </system>
Jul 29 13:38:28 user nova-compute[231753]:   </sysinfo>
Jul 29 13:38:28 user nova-compute[231753]:   <os>
Jul 29 13:38:28 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:38:28 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:38:28 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:38:28 user nova-compute[231753]:   </os>
Jul 29 13:38:28 user nova-compute[231753]:   <features>
Jul 29 13:38:28 user nova-compute[231753]:     <acpi/>
Jul 29 13:38:28 user nova-compute[231753]:     <apic/>
Jul 29 13:38:28 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:38:28 user nova-compute[231753]:   </features>
Jul 29 13:38:28 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:38:28 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:38:28 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:38:28 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:38:28 user nova-compute[231753]:   </clock>
Jul 29 13:38:28 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:38:28 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:38:28 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:38:28 user nova-compute[231753]:   </cpu>
Jul 29 13:38:28 user nova-compute[231753]:   <devices>
Jul 29 13:38:28 user nova-compute[231753]:     <disk type="file" device="cdrom">
Jul 29 13:38:28 user nova-compute[231753]:       <driver name="qemu" type="raw" cache="none"/>
Jul 29 13:38:28 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/894f5e40-e585-41c0-9dd8-e94d8a9400ef/disk.config"/>
Jul 29 13:38:28 user nova-compute[231753]:       <target dev="hda" bus="ide"/>
Jul 29 13:38:28 user nova-compute[231753]:     </disk>
Jul 29 13:38:28 user nova-compute[231753]:     <disk type="block" device="disk">
Jul 29 13:38:28 user nova-compute[231753]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:38:28 user nova-compute[231753]:       <source dev="/dev/sdf"/>
Jul 29 13:38:28 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:38:28 user nova-compute[231753]:       <serial>b82c6905-a234-45d8-945c-ab8abef447d0</serial>
Jul 29 13:38:28 user nova-compute[231753]:     </disk>
Jul 29 13:38:28 user nova-compute[231753]:     <disk type="block" device="disk">
Jul 29 13:38:28 user nova-compute[231753]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:38:28 user nova-compute[231753]:       <source dev="/dev/sdg"/>
Jul 29 13:38:28 user nova-compute[231753]:       <target dev="vdb" bus="virtio"/>
Jul 29 13:38:28 user nova-compute[231753]:       <serial>84ca643c-1d19-4f8d-b0a5-25eb9179b1be</serial>
Jul 29 13:38:28 user nova-compute[231753]:     </disk>
Jul 29 13:38:28 user nova-compute[231753]:     <disk type="block" device="disk">
Jul 29 13:38:28 user nova-compute[231753]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:38:28 user nova-compute[231753]:       <source dev="/dev/sdh"/>
Jul 29 13:38:28 user nova-compute[231753]:       <target dev="vdc" bus="virtio"/>
Jul 29 13:38:28 user nova-compute[231753]:       <serial>845a966e-2db8-49d3-b406-6a630cd840b3</serial>
Jul 29 13:38:28 user nova-compute[231753]:     </disk>
Jul 29 13:38:28 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:38:28 user nova-compute[231753]:       <mac address="fa:16:3e:4f:92:db"/>
Jul 29 13:38:28 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:38:28 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:38:28 user nova-compute[231753]:       <target dev="tap984d64db-ae"/>
Jul 29 13:38:28 user nova-compute[231753]:     </interface>
Jul 29 13:38:28 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:38:28 user nova-compute[231753]:       <mac address="fa:16:3e:b4:73:7b"/>
Jul 29 13:38:28 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:38:28 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:38:28 user nova-compute[231753]:       <target dev="tapdcd40805-07"/>
Jul 29 13:38:28 user nova-compute[231753]:     </interface>
Jul 29 13:38:28 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:38:28 user nova-compute[231753]:       <mac address="fa:16:3e:ff:85:55"/>
Jul 29 13:38:28 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:38:28 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:38:28 user nova-compute[231753]:       <target dev="tap4a95b92c-9a"/>
Jul 29 13:38:28 user nova-compute[231753]:     </interface>
Jul 29 13:38:28 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:38:28 user nova-compute[231753]:       <mac address="fa:16:3e:ae:53:f8"/>
Jul 29 13:38:28 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:38:28 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:38:28 user nova-compute[231753]:       <target dev="tap2789bcf9-55"/>
Jul 29 13:38:28 user nova-compute[231753]:     </interface>
Jul 29 13:38:28 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:38:28 user nova-compute[231753]:       <mac address="fa:16:3e:43:c1:d4"/>
Jul 29 13:38:28 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:38:28 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:38:28 user nova-compute[231753]:       <target dev="tapf0ade4f6-22"/>
Jul 29 13:38:28 user nova-compute[231753]:     </interface>
Jul 29 13:38:28 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:38:28 user nova-compute[231753]:       <mac address="fa:16:3e:47:62:b3"/>
Jul 29 13:38:28 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:38:28 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:38:28 user nova-compute[231753]:       <target dev="tapa795944f-ca"/>
Jul 29 13:38:28 user nova-compute[231753]:     </interface>
Jul 29 13:38:28 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:38:28 user nova-compute[231753]:       <mac address="fa:16:3e:a3:46:6e"/>
Jul 29 13:38:28 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:38:28 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:38:28 user nova-compute[231753]:       <target dev="tapa4a0b15f-49"/>
Jul 29 13:38:28 user nova-compute[231753]:     </interface>
Jul 29 13:38:28 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:38:28 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/894f5e40-e585-41c0-9dd8-e94d8a9400ef/console.log" append="off"/>
Jul 29 13:38:28 user nova-compute[231753]:     </serial>
Jul 29 13:38:28 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:38:28 user nova-compute[231753]:     <video>
Jul 29 13:38:28 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:38:28 user nova-compute[231753]:     </video>
Jul 29 13:38:28 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:38:28 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:38:28 user nova-compute[231753]:     </rng>
Jul 29 13:38:28 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:38:28 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:38:28 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:38:28 user nova-compute[231753]:     </memballoon>
Jul 29 13:38:28 user nova-compute[231753]:   </devices>
Jul 29 13:38:28 user nova-compute[231753]: </domain>
Jul 29 13:38:28 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:37:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-760304032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-760304032',id=16,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJAA7nV1bCNkU952F/cZ76kN28PQKANdkmvJPcn5ae13AzCEKy4tPqxG+We4+ntx5/wii47tLrGtk//N9hghMdTQ8qL5bl7Q+UzjCEdRqHOtTxevUzaqM4O1XrZLEej0g==',key_name='tempest-keypair-1726319149',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11bd37c7c8524d2b961e5b1aa1e92e9e',ramdisk_id='',reservation_id='r-vbcco03p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1447223842',owner_user_name='tempest-TaggedBootDevicesTest_v242-1447223842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:37:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85b304003a524464a7d013228d650d3b',uuid=894f5e40-e585-41c0-9dd8-e94d8a9400ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "984d64db-ae0d-45be-a0cd-3bcc5b00008b", "address": "fa:16:3e:4f:92:db", "network": {"id": "322b52d5-b11a-4c3c-a30b-adfbfee8d1b2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1087548543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap984d64db-ae", "ovs_interfaceid": "984d64db-ae0d-45be-a0cd-3bcc5b00008b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converting VIF {"id": "984d64db-ae0d-45be-a0cd-3bcc5b00008b", "address": "fa:16:3e:4f:92:db", "network": {"id": "322b52d5-b11a-4c3c-a30b-adfbfee8d1b2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1087548543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap984d64db-ae", "ovs_interfaceid": "984d64db-ae0d-45be-a0cd-3bcc5b00008b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:92:db,bridge_name='br-int',has_traffic_filtering=True,id=984d64db-ae0d-45be-a0cd-3bcc5b00008b,network=Network(322b52d5-b11a-4c3c-a30b-adfbfee8d1b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap984d64db-ae') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG os_vif [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:92:db,bridge_name='br-int',has_traffic_filtering=True,id=984d64db-ae0d-45be-a0cd-3bcc5b00008b,network=Network(322b52d5-b11a-4c3c-a30b-adfbfee8d1b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap984d64db-ae') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap984d64db-ae, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap984d64db-ae, col_values=(('external_ids', {'iface-id': '984d64db-ae0d-45be-a0cd-3bcc5b00008b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:92:db', 'vm-uuid': '894f5e40-e585-41c0-9dd8-e94d8a9400ef'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:28 user nova-compute[231753]: INFO os_vif [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:92:db,bridge_name='br-int',has_traffic_filtering=True,id=984d64db-ae0d-45be-a0cd-3bcc5b00008b,network=Network(322b52d5-b11a-4c3c-a30b-adfbfee8d1b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap984d64db-ae')
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:37:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-760304032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-760304032',id=16,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJAA7nV1bCNkU952F/cZ76kN28PQKANdkmvJPcn5ae13AzCEKy4tPqxG+We4+ntx5/wii47tLrGtk//N9hghMdTQ8qL5bl7Q+UzjCEdRqHOtTxevUzaqM4O1XrZLEej0g==',key_name='tempest-keypair-1726319149',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11bd37c7c8524d2b961e5b1aa1e92e9e',ramdisk_id='',reservation_id='r-vbcco03p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1447223842',owner_user_name='tempest-TaggedBootDevicesTest_v242-1447223842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:37:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85b304003a524464a7d013228d650d3b',uuid=894f5e40-e585-41c0-9dd8-e94d8a9400ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dcd40805-07c1-45d2-a795-f3085231f735", "address": "fa:16:3e:b4:73:7b", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcd40805-07", "ovs_interfaceid": "dcd40805-07c1-45d2-a795-f3085231f735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converting VIF {"id": "dcd40805-07c1-45d2-a795-f3085231f735", "address": "fa:16:3e:b4:73:7b", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcd40805-07", "ovs_interfaceid": "dcd40805-07c1-45d2-a795-f3085231f735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:73:7b,bridge_name='br-int',has_traffic_filtering=True,id=dcd40805-07c1-45d2-a795-f3085231f735,network=Network(022a1d0e-dd19-41f2-9079-ce71ed9530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdcd40805-07') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG os_vif [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:73:7b,bridge_name='br-int',has_traffic_filtering=True,id=dcd40805-07c1-45d2-a795-f3085231f735,network=Network(022a1d0e-dd19-41f2-9079-ce71ed9530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdcd40805-07') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdcd40805-07, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdcd40805-07, col_values=(('external_ids', {'iface-id': 'dcd40805-07c1-45d2-a795-f3085231f735', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b4:73:7b', 'vm-uuid': '894f5e40-e585-41c0-9dd8-e94d8a9400ef'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:28 user nova-compute[231753]: INFO os_vif [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:73:7b,bridge_name='br-int',has_traffic_filtering=True,id=dcd40805-07c1-45d2-a795-f3085231f735,network=Network(022a1d0e-dd19-41f2-9079-ce71ed9530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdcd40805-07')
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:37:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-760304032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-760304032',id=16,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJAA7nV1bCNkU952F/cZ76kN28PQKANdkmvJPcn5ae13AzCEKy4tPqxG+We4+ntx5/wii47tLrGtk//N9hghMdTQ8qL5bl7Q+UzjCEdRqHOtTxevUzaqM4O1XrZLEej0g==',key_name='tempest-keypair-1726319149',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11bd37c7c8524d2b961e5b1aa1e92e9e',ramdisk_id='',reservation_id='r-vbcco03p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1447223842',owner_user_name='tempest-TaggedBootDevicesTest_v242-1447223842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:37:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85b304003a524464a7d013228d650d3b',uuid=894f5e40-e585-41c0-9dd8-e94d8a9400ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4a95b92c-9a5b-4fd4-bbfd-36063a073c11", "address": "fa:16:3e:ff:85:55", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a95b92c-9a", "ovs_interfaceid": "4a95b92c-9a5b-4fd4-bbfd-36063a073c11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converting VIF {"id": "4a95b92c-9a5b-4fd4-bbfd-36063a073c11", "address": "fa:16:3e:ff:85:55", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a95b92c-9a", "ovs_interfaceid": "4a95b92c-9a5b-4fd4-bbfd-36063a073c11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:85:55,bridge_name='br-int',has_traffic_filtering=True,id=4a95b92c-9a5b-4fd4-bbfd-36063a073c11,network=Network(022a1d0e-dd19-41f2-9079-ce71ed9530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4a95b92c-9a') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG os_vif [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:85:55,bridge_name='br-int',has_traffic_filtering=True,id=4a95b92c-9a5b-4fd4-bbfd-36063a073c11,network=Network(022a1d0e-dd19-41f2-9079-ce71ed9530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4a95b92c-9a') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4a95b92c-9a, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4a95b92c-9a, col_values=(('external_ids', {'iface-id': '4a95b92c-9a5b-4fd4-bbfd-36063a073c11', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ff:85:55', 'vm-uuid': '894f5e40-e585-41c0-9dd8-e94d8a9400ef'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:28 user nova-compute[231753]: INFO os_vif [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:85:55,bridge_name='br-int',has_traffic_filtering=True,id=4a95b92c-9a5b-4fd4-bbfd-36063a073c11,network=Network(022a1d0e-dd19-41f2-9079-ce71ed9530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4a95b92c-9a')
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:37:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-760304032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-760304032',id=16,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJAA7nV1bCNkU952F/cZ76kN28PQKANdkmvJPcn5ae13AzCEKy4tPqxG+We4+ntx5/wii47tLrGtk//N9hghMdTQ8qL5bl7Q+UzjCEdRqHOtTxevUzaqM4O1XrZLEej0g==',key_name='tempest-keypair-1726319149',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11bd37c7c8524d2b961e5b1aa1e92e9e',ramdisk_id='',reservation_id='r-vbcco03p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1447223842',owner_user_name='tempest-TaggedBootDevicesTest_v242-1447223842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:37:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85b304003a524464a7d013228d650d3b',uuid=894f5e40-e585-41c0-9dd8-e94d8a9400ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2789bcf9-55ed-4893-85f4-7595c6df0400", "address": "fa:16:3e:ae:53:f8", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2789bcf9-55", "ovs_interfaceid": "2789bcf9-55ed-4893-85f4-7595c6df0400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converting VIF {"id": "2789bcf9-55ed-4893-85f4-7595c6df0400", "address": "fa:16:3e:ae:53:f8", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2789bcf9-55", "ovs_interfaceid": "2789bcf9-55ed-4893-85f4-7595c6df0400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:53:f8,bridge_name='br-int',has_traffic_filtering=True,id=2789bcf9-55ed-4893-85f4-7595c6df0400,network=Network(022a1d0e-dd19-41f2-9079-ce71ed9530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2789bcf9-55') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG os_vif [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:53:f8,bridge_name='br-int',has_traffic_filtering=True,id=2789bcf9-55ed-4893-85f4-7595c6df0400,network=Network(022a1d0e-dd19-41f2-9079-ce71ed9530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2789bcf9-55') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2789bcf9-55, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap2789bcf9-55, col_values=(('external_ids', {'iface-id': '2789bcf9-55ed-4893-85f4-7595c6df0400', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:53:f8', 'vm-uuid': '894f5e40-e585-41c0-9dd8-e94d8a9400ef'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:28 user nova-compute[231753]: INFO os_vif [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:53:f8,bridge_name='br-int',has_traffic_filtering=True,id=2789bcf9-55ed-4893-85f4-7595c6df0400,network=Network(022a1d0e-dd19-41f2-9079-ce71ed9530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2789bcf9-55')
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:37:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-760304032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-760304032',id=16,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJAA7nV1bCNkU952F/cZ76kN28PQKANdkmvJPcn5ae13AzCEKy4tPqxG+We4+ntx5/wii47tLrGtk//N9hghMdTQ8qL5bl7Q+UzjCEdRqHOtTxevUzaqM4O1XrZLEej0g==',key_name='tempest-keypair-1726319149',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11bd37c7c8524d2b961e5b1aa1e92e9e',ramdisk_id='',reservation_id='r-vbcco03p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1447223842',owner_user_name='tempest-TaggedBootDevicesTest_v242-1447223842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:37:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85b304003a524464a7d013228d650d3b',uuid=894f5e40-e585-41c0-9dd8-e94d8a9400ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f0ade4f6-225a-4c66-a2f5-d5793cfa7a96", "address": "fa:16:3e:43:c1:d4", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ade4f6-22", "ovs_interfaceid": "f0ade4f6-225a-4c66-a2f5-d5793cfa7a96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converting VIF {"id": "f0ade4f6-225a-4c66-a2f5-d5793cfa7a96", "address": "fa:16:3e:43:c1:d4", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ade4f6-22", "ovs_interfaceid": "f0ade4f6-225a-4c66-a2f5-d5793cfa7a96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:c1:d4,bridge_name='br-int',has_traffic_filtering=True,id=f0ade4f6-225a-4c66-a2f5-d5793cfa7a96,network=Network(022a1d0e-dd19-41f2-9079-ce71ed9530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0ade4f6-22') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG os_vif [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:c1:d4,bridge_name='br-int',has_traffic_filtering=True,id=f0ade4f6-225a-4c66-a2f5-d5793cfa7a96,network=Network(022a1d0e-dd19-41f2-9079-ce71ed9530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0ade4f6-22') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf0ade4f6-22, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapf0ade4f6-22, col_values=(('external_ids', {'iface-id': 'f0ade4f6-225a-4c66-a2f5-d5793cfa7a96', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:c1:d4', 'vm-uuid': '894f5e40-e585-41c0-9dd8-e94d8a9400ef'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:28 user nova-compute[231753]: INFO os_vif [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:c1:d4,bridge_name='br-int',has_traffic_filtering=True,id=f0ade4f6-225a-4c66-a2f5-d5793cfa7a96,network=Network(022a1d0e-dd19-41f2-9079-ce71ed9530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0ade4f6-22')
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:37:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-760304032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-760304032',id=16,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJAA7nV1bCNkU952F/cZ76kN28PQKANdkmvJPcn5ae13AzCEKy4tPqxG+We4+ntx5/wii47tLrGtk//N9hghMdTQ8qL5bl7Q+UzjCEdRqHOtTxevUzaqM4O1XrZLEej0g==',key_name='tempest-keypair-1726319149',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11bd37c7c8524d2b961e5b1aa1e92e9e',ramdisk_id='',reservation_id='r-vbcco03p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1447223842',owner_user_name='tempest-TaggedBootDevicesTest_v242-1447223842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:37:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85b304003a524464a7d013228d650d3b',uuid=894f5e40-e585-41c0-9dd8-e94d8a9400ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a795944f-ca69-4b3d-90b6-bf61d16fa1a8", "address": "fa:16:3e:47:62:b3", "network": {"id": "d45dd21d-a9cd-4c70-9b98-aae5f9179d8c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1287922789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa795944f-ca", "ovs_interfaceid": "a795944f-ca69-4b3d-90b6-bf61d16fa1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converting VIF {"id": "a795944f-ca69-4b3d-90b6-bf61d16fa1a8", "address": "fa:16:3e:47:62:b3", "network": {"id": "d45dd21d-a9cd-4c70-9b98-aae5f9179d8c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1287922789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa795944f-ca", "ovs_interfaceid": "a795944f-ca69-4b3d-90b6-bf61d16fa1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:62:b3,bridge_name='br-int',has_traffic_filtering=True,id=a795944f-ca69-4b3d-90b6-bf61d16fa1a8,network=Network(d45dd21d-a9cd-4c70-9b98-aae5f9179d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa795944f-ca') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG os_vif [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:62:b3,bridge_name='br-int',has_traffic_filtering=True,id=a795944f-ca69-4b3d-90b6-bf61d16fa1a8,network=Network(d45dd21d-a9cd-4c70-9b98-aae5f9179d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa795944f-ca') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa795944f-ca, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa795944f-ca, col_values=(('external_ids', {'iface-id': 'a795944f-ca69-4b3d-90b6-bf61d16fa1a8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:47:62:b3', 'vm-uuid': '894f5e40-e585-41c0-9dd8-e94d8a9400ef'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:38:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:29 user nova-compute[231753]: INFO os_vif [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:62:b3,bridge_name='br-int',has_traffic_filtering=True,id=a795944f-ca69-4b3d-90b6-bf61d16fa1a8,network=Network(d45dd21d-a9cd-4c70-9b98-aae5f9179d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa795944f-ca')
Jul 29 13:38:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:37:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-760304032',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-760304032',id=16,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJAA7nV1bCNkU952F/cZ76kN28PQKANdkmvJPcn5ae13AzCEKy4tPqxG+We4+ntx5/wii47tLrGtk//N9hghMdTQ8qL5bl7Q+UzjCEdRqHOtTxevUzaqM4O1XrZLEej0g==',key_name='tempest-keypair-1726319149',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='11bd37c7c8524d2b961e5b1aa1e92e9e',ramdisk_id='',reservation_id='r-vbcco03p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-1447223842',owner_user_name='tempest-TaggedBootDevicesTest_v242-1447223842-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:37:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85b304003a524464a7d013228d650d3b',uuid=894f5e40-e585-41c0-9dd8-e94d8a9400ef,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a4a0b15f-494b-4934-8b4f-fb8df577a60d", "address": "fa:16:3e:a3:46:6e", "network": {"id": "d45dd21d-a9cd-4c70-9b98-aae5f9179d8c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1287922789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a0b15f-49", "ovs_interfaceid": "a4a0b15f-494b-4934-8b4f-fb8df577a60d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:38:29 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converting VIF {"id": "a4a0b15f-494b-4934-8b4f-fb8df577a60d", "address": "fa:16:3e:a3:46:6e", "network": {"id": "d45dd21d-a9cd-4c70-9b98-aae5f9179d8c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1287922789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a0b15f-49", "ovs_interfaceid": "a4a0b15f-494b-4934-8b4f-fb8df577a60d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:38:29 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:46:6e,bridge_name='br-int',has_traffic_filtering=True,id=a4a0b15f-494b-4934-8b4f-fb8df577a60d,network=Network(d45dd21d-a9cd-4c70-9b98-aae5f9179d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4a0b15f-49') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:38:29 user nova-compute[231753]: DEBUG os_vif [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:46:6e,bridge_name='br-int',has_traffic_filtering=True,id=a4a0b15f-494b-4934-8b4f-fb8df577a60d,network=Network(d45dd21d-a9cd-4c70-9b98-aae5f9179d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4a0b15f-49') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:38:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:38:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:38:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa4a0b15f-49, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:38:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa4a0b15f-49, col_values=(('external_ids', {'iface-id': 'a4a0b15f-494b-4934-8b4f-fb8df577a60d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a3:46:6e', 'vm-uuid': '894f5e40-e585-41c0-9dd8-e94d8a9400ef'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:38:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:38:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:29 user nova-compute[231753]: INFO os_vif [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:46:6e,bridge_name='br-int',has_traffic_filtering=True,id=a4a0b15f-494b-4934-8b4f-fb8df577a60d,network=Network(d45dd21d-a9cd-4c70-9b98-aae5f9179d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4a0b15f-49')
Jul 29 13:38:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] No BDM found with device name hda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:38:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] No BDM found with device name vdc, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:38:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] No VIF found with MAC fa:16:3e:4f:92:db, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:38:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] No VIF found with MAC fa:16:3e:43:c1:d4, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:38:29 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Using config drive
Jul 29 13:38:29 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Creating config drive at /opt/stack/data/nova/instances/894f5e40-e585-41c0-9dd8-e94d8a9400ef/disk.config
Jul 29 13:38:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/894f5e40-e585-41c0-9dd8-e94d8a9400ef/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpopjaehks {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/894f5e40-e585-41c0-9dd8-e94d8a9400ef/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 0.0.0 -quiet -J -r -V config-2 /tmp/tmpopjaehks" returned: 0 in 0.087s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:31 user nova-compute[231753]: DEBUG nova.compute.manager [req-0f90283e-61e1-4864-a00e-be578aa566a4 req-a787c866-1869-472e-a537-7789766bff37 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-plugged-984d64db-ae0d-45be-a0cd-3bcc5b00008b {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0f90283e-61e1-4864-a00e-be578aa566a4 req-a787c866-1869-472e-a537-7789766bff37 service nova] Acquiring lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0f90283e-61e1-4864-a00e-be578aa566a4 req-a787c866-1869-472e-a537-7789766bff37 service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0f90283e-61e1-4864-a00e-be578aa566a4 req-a787c866-1869-472e-a537-7789766bff37 service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:31 user nova-compute[231753]: DEBUG nova.compute.manager [req-0f90283e-61e1-4864-a00e-be578aa566a4 req-a787c866-1869-472e-a537-7789766bff37 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] No waiting events found dispatching network-vif-plugged-984d64db-ae0d-45be-a0cd-3bcc5b00008b {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:38:31 user nova-compute[231753]: WARNING nova.compute.manager [req-0f90283e-61e1-4864-a00e-be578aa566a4 req-a787c866-1869-472e-a537-7789766bff37 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received unexpected event network-vif-plugged-984d64db-ae0d-45be-a0cd-3bcc5b00008b for instance with vm_state building and task_state spawning.
Jul 29 13:38:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:31 user nova-compute[231753]: INFO nova.compute.manager [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Rescuing
Jul 29 13:38:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "refresh_cache-8ea52d41-7ec3-44d7-8421-133000ee887b" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:38:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquired lock "refresh_cache-8ea52d41-7ec3-44d7-8421-133000ee887b" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:38:31 user nova-compute[231753]: DEBUG nova.network.neutron [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:38:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:31 user nova-compute[231753]: DEBUG nova.compute.manager [req-1321189e-416e-41a1-af0c-c2df5539c519 req-a8c021ec-1dea-4aca-9149-017af48ed97c service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-plugged-dcd40805-07c1-45d2-a795-f3085231f735 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-1321189e-416e-41a1-af0c-c2df5539c519 req-a8c021ec-1dea-4aca-9149-017af48ed97c service nova] Acquiring lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-1321189e-416e-41a1-af0c-c2df5539c519 req-a8c021ec-1dea-4aca-9149-017af48ed97c service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-1321189e-416e-41a1-af0c-c2df5539c519 req-a8c021ec-1dea-4aca-9149-017af48ed97c service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:31 user nova-compute[231753]: DEBUG nova.compute.manager [req-1321189e-416e-41a1-af0c-c2df5539c519 req-a8c021ec-1dea-4aca-9149-017af48ed97c service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] No waiting events found dispatching network-vif-plugged-dcd40805-07c1-45d2-a795-f3085231f735 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:38:31 user nova-compute[231753]: WARNING nova.compute.manager [req-1321189e-416e-41a1-af0c-c2df5539c519 req-a8c021ec-1dea-4aca-9149-017af48ed97c service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received unexpected event network-vif-plugged-dcd40805-07c1-45d2-a795-f3085231f735 for instance with vm_state building and task_state spawning.
Jul 29 13:38:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c1fc96ed-7f70-4ce5-88f7-89b808d1801e tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Acquiring lock "b5e7da3f-33d9-4f58-8c98-72869b679850" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c1fc96ed-7f70-4ce5-88f7-89b808d1801e tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "b5e7da3f-33d9-4f58-8c98-72869b679850" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c1fc96ed-7f70-4ce5-88f7-89b808d1801e tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Acquiring lock "b5e7da3f-33d9-4f58-8c98-72869b679850-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c1fc96ed-7f70-4ce5-88f7-89b808d1801e tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "b5e7da3f-33d9-4f58-8c98-72869b679850-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c1fc96ed-7f70-4ce5-88f7-89b808d1801e tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "b5e7da3f-33d9-4f58-8c98-72869b679850-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:32 user nova-compute[231753]: INFO nova.compute.manager [None req-c1fc96ed-7f70-4ce5-88f7-89b808d1801e tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Terminating instance
Jul 29 13:38:32 user nova-compute[231753]: DEBUG nova.compute.manager [None req-c1fc96ed-7f70-4ce5-88f7-89b808d1801e tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:38:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:32 user nova-compute[231753]: DEBUG nova.network.neutron [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Updating instance_info_cache with network_info: [{"id": "4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b", "address": "fa:16:3e:33:76:ce", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed7b5c5-f0", "ovs_interfaceid": "4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:38:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Releasing lock "refresh_cache-8ea52d41-7ec3-44d7-8421-133000ee887b" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:38:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG nova.compute.manager [req-3d944cd1-17d5-42e7-b385-f06091ba09ec req-5830a3d0-9128-4521-8662-1c0fb1c45c9b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-plugged-4a95b92c-9a5b-4fd4-bbfd-36063a073c11 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3d944cd1-17d5-42e7-b385-f06091ba09ec req-5830a3d0-9128-4521-8662-1c0fb1c45c9b service nova] Acquiring lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3d944cd1-17d5-42e7-b385-f06091ba09ec req-5830a3d0-9128-4521-8662-1c0fb1c45c9b service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3d944cd1-17d5-42e7-b385-f06091ba09ec req-5830a3d0-9128-4521-8662-1c0fb1c45c9b service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG nova.compute.manager [req-3d944cd1-17d5-42e7-b385-f06091ba09ec req-5830a3d0-9128-4521-8662-1c0fb1c45c9b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] No waiting events found dispatching network-vif-plugged-4a95b92c-9a5b-4fd4-bbfd-36063a073c11 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:38:33 user nova-compute[231753]: WARNING nova.compute.manager [req-3d944cd1-17d5-42e7-b385-f06091ba09ec req-5830a3d0-9128-4521-8662-1c0fb1c45c9b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received unexpected event network-vif-plugged-4a95b92c-9a5b-4fd4-bbfd-36063a073c11 for instance with vm_state building and task_state spawning.
Jul 29 13:38:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG nova.compute.manager [req-66d08512-164f-459b-afae-fc62dca81e9f req-8be46a92-9be3-4170-97f8-5d85ee7cbc1b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-plugged-984d64db-ae0d-45be-a0cd-3bcc5b00008b {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-66d08512-164f-459b-afae-fc62dca81e9f req-8be46a92-9be3-4170-97f8-5d85ee7cbc1b service nova] Acquiring lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-66d08512-164f-459b-afae-fc62dca81e9f req-8be46a92-9be3-4170-97f8-5d85ee7cbc1b service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-66d08512-164f-459b-afae-fc62dca81e9f req-8be46a92-9be3-4170-97f8-5d85ee7cbc1b service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG nova.compute.manager [req-66d08512-164f-459b-afae-fc62dca81e9f req-8be46a92-9be3-4170-97f8-5d85ee7cbc1b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] No waiting events found dispatching network-vif-plugged-984d64db-ae0d-45be-a0cd-3bcc5b00008b {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:38:33 user nova-compute[231753]: WARNING nova.compute.manager [req-66d08512-164f-459b-afae-fc62dca81e9f req-8be46a92-9be3-4170-97f8-5d85ee7cbc1b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received unexpected event network-vif-plugged-984d64db-ae0d-45be-a0cd-3bcc5b00008b for instance with vm_state building and task_state spawning.
Jul 29 13:38:33 user nova-compute[231753]: DEBUG nova.compute.manager [req-66d08512-164f-459b-afae-fc62dca81e9f req-8be46a92-9be3-4170-97f8-5d85ee7cbc1b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-plugged-2789bcf9-55ed-4893-85f4-7595c6df0400 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-66d08512-164f-459b-afae-fc62dca81e9f req-8be46a92-9be3-4170-97f8-5d85ee7cbc1b service nova] Acquiring lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-66d08512-164f-459b-afae-fc62dca81e9f req-8be46a92-9be3-4170-97f8-5d85ee7cbc1b service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-66d08512-164f-459b-afae-fc62dca81e9f req-8be46a92-9be3-4170-97f8-5d85ee7cbc1b service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG nova.compute.manager [req-66d08512-164f-459b-afae-fc62dca81e9f req-8be46a92-9be3-4170-97f8-5d85ee7cbc1b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] No waiting events found dispatching network-vif-plugged-2789bcf9-55ed-4893-85f4-7595c6df0400 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:38:33 user nova-compute[231753]: WARNING nova.compute.manager [req-66d08512-164f-459b-afae-fc62dca81e9f req-8be46a92-9be3-4170-97f8-5d85ee7cbc1b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received unexpected event network-vif-plugged-2789bcf9-55ed-4893-85f4-7595c6df0400 for instance with vm_state building and task_state spawning.
Jul 29 13:38:33 user nova-compute[231753]: DEBUG nova.compute.manager [req-66d08512-164f-459b-afae-fc62dca81e9f req-8be46a92-9be3-4170-97f8-5d85ee7cbc1b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-plugged-2789bcf9-55ed-4893-85f4-7595c6df0400 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-66d08512-164f-459b-afae-fc62dca81e9f req-8be46a92-9be3-4170-97f8-5d85ee7cbc1b service nova] Acquiring lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-66d08512-164f-459b-afae-fc62dca81e9f req-8be46a92-9be3-4170-97f8-5d85ee7cbc1b service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-66d08512-164f-459b-afae-fc62dca81e9f req-8be46a92-9be3-4170-97f8-5d85ee7cbc1b service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG nova.compute.manager [req-66d08512-164f-459b-afae-fc62dca81e9f req-8be46a92-9be3-4170-97f8-5d85ee7cbc1b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] No waiting events found dispatching network-vif-plugged-2789bcf9-55ed-4893-85f4-7595c6df0400 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:38:33 user nova-compute[231753]: WARNING nova.compute.manager [req-66d08512-164f-459b-afae-fc62dca81e9f req-8be46a92-9be3-4170-97f8-5d85ee7cbc1b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received unexpected event network-vif-plugged-2789bcf9-55ed-4893-85f4-7595c6df0400 for instance with vm_state building and task_state spawning.
Jul 29 13:38:33 user nova-compute[231753]: DEBUG nova.compute.manager [req-66d08512-164f-459b-afae-fc62dca81e9f req-8be46a92-9be3-4170-97f8-5d85ee7cbc1b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-plugged-f0ade4f6-225a-4c66-a2f5-d5793cfa7a96 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-66d08512-164f-459b-afae-fc62dca81e9f req-8be46a92-9be3-4170-97f8-5d85ee7cbc1b service nova] Acquiring lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-66d08512-164f-459b-afae-fc62dca81e9f req-8be46a92-9be3-4170-97f8-5d85ee7cbc1b service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-66d08512-164f-459b-afae-fc62dca81e9f req-8be46a92-9be3-4170-97f8-5d85ee7cbc1b service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG nova.compute.manager [req-66d08512-164f-459b-afae-fc62dca81e9f req-8be46a92-9be3-4170-97f8-5d85ee7cbc1b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] No waiting events found dispatching network-vif-plugged-f0ade4f6-225a-4c66-a2f5-d5793cfa7a96 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:38:33 user nova-compute[231753]: WARNING nova.compute.manager [req-66d08512-164f-459b-afae-fc62dca81e9f req-8be46a92-9be3-4170-97f8-5d85ee7cbc1b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received unexpected event network-vif-plugged-f0ade4f6-225a-4c66-a2f5-d5793cfa7a96 for instance with vm_state building and task_state spawning.
Jul 29 13:38:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:33 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Instance destroyed successfully.
Jul 29 13:38:33 user nova-compute[231753]: DEBUG nova.objects.instance [None req-c1fc96ed-7f70-4ce5-88f7-89b808d1801e tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lazy-loading 'resources' on Instance uuid b5e7da3f-33d9-4f58-8c98-72869b679850 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-c1fc96ed-7f70-4ce5-88f7-89b808d1801e tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:36:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-401714488',display_name='tempest-VolumesAdminNegativeTest-server-401714488',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-401714488',id=13,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:36:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44867a8743214d32a94bca3506295e92',ramdisk_id='',reservation_id='r-zlkd57hd',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-193285786',owner_user_name='tempest-VolumesAdminNegativeTest-193285786-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:36:37Z,user_data=None,user_id='82c6eeb939f94fa5953a349127247021',uuid=b5e7da3f-33d9-4f58-8c98-72869b679850,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7be1f6de-22a8-4dde-9fad-8c62c975ab2b", "address": "fa:16:3e:e8:21:9c", "network": {"id": "2e7ef980-929c-4ea5-86b7-d69bcfa4a209", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1403711156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44867a8743214d32a94bca3506295e92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be1f6de-22", "ovs_interfaceid": "7be1f6de-22a8-4dde-9fad-8c62c975ab2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-c1fc96ed-7f70-4ce5-88f7-89b808d1801e tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Converting VIF {"id": "7be1f6de-22a8-4dde-9fad-8c62c975ab2b", "address": "fa:16:3e:e8:21:9c", "network": {"id": "2e7ef980-929c-4ea5-86b7-d69bcfa4a209", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1403711156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44867a8743214d32a94bca3506295e92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7be1f6de-22", "ovs_interfaceid": "7be1f6de-22a8-4dde-9fad-8c62c975ab2b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-c1fc96ed-7f70-4ce5-88f7-89b808d1801e tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e8:21:9c,bridge_name='br-int',has_traffic_filtering=True,id=7be1f6de-22a8-4dde-9fad-8c62c975ab2b,network=Network(2e7ef980-929c-4ea5-86b7-d69bcfa4a209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be1f6de-22') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG os_vif [None req-c1fc96ed-7f70-4ce5-88f7-89b808d1801e tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:21:9c,bridge_name='br-int',has_traffic_filtering=True,id=7be1f6de-22a8-4dde-9fad-8c62c975ab2b,network=Network(2e7ef980-929c-4ea5-86b7-d69bcfa4a209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be1f6de-22') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7be1f6de-22, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:38:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:33 user nova-compute[231753]: INFO os_vif [None req-c1fc96ed-7f70-4ce5-88f7-89b808d1801e tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e8:21:9c,bridge_name='br-int',has_traffic_filtering=True,id=7be1f6de-22a8-4dde-9fad-8c62c975ab2b,network=Network(2e7ef980-929c-4ea5-86b7-d69bcfa4a209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7be1f6de-22')
Jul 29 13:38:33 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-c1fc96ed-7f70-4ce5-88f7-89b808d1801e tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Deleting instance files /opt/stack/data/nova/instances/b5e7da3f-33d9-4f58-8c98-72869b679850_del
Jul 29 13:38:33 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-c1fc96ed-7f70-4ce5-88f7-89b808d1801e tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Deletion of /opt/stack/data/nova/instances/b5e7da3f-33d9-4f58-8c98-72869b679850_del complete
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.compute.manager [req-2c313594-f97a-4879-83b0-5b07aa00e1aa req-2a12291c-ed0e-4705-acb2-6c67ac2de023 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-plugged-dcd40805-07c1-45d2-a795-f3085231f735 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-2c313594-f97a-4879-83b0-5b07aa00e1aa req-2a12291c-ed0e-4705-acb2-6c67ac2de023 service nova] Acquiring lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-2c313594-f97a-4879-83b0-5b07aa00e1aa req-2a12291c-ed0e-4705-acb2-6c67ac2de023 service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-2c313594-f97a-4879-83b0-5b07aa00e1aa req-2a12291c-ed0e-4705-acb2-6c67ac2de023 service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.compute.manager [req-2c313594-f97a-4879-83b0-5b07aa00e1aa req-2a12291c-ed0e-4705-acb2-6c67ac2de023 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] No waiting events found dispatching network-vif-plugged-dcd40805-07c1-45d2-a795-f3085231f735 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:38:34 user nova-compute[231753]: WARNING nova.compute.manager [req-2c313594-f97a-4879-83b0-5b07aa00e1aa req-2a12291c-ed0e-4705-acb2-6c67ac2de023 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received unexpected event network-vif-plugged-dcd40805-07c1-45d2-a795-f3085231f735 for instance with vm_state building and task_state spawning.
Jul 29 13:38:34 user nova-compute[231753]: INFO nova.compute.manager [None req-c1fc96ed-7f70-4ce5-88f7-89b808d1801e tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Took 1.55 seconds to destroy the instance on the hypervisor.
Jul 29 13:38:34 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-c1fc96ed-7f70-4ce5-88f7-89b808d1801e tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:34 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Instance destroyed successfully.
Jul 29 13:38:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:34 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Attempting rescue
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=231753) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Instance directory exists: not creating {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 29 13:38:34 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Creating image(s)
Jul 29 13:38:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "/opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "/opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.003s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "/opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.011s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.objects.instance [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8ea52d41-7ec3-44d7-8421-133000ee887b {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.172s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue" returned: 0 in 0.109s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.286s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.objects.instance [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lazy-loading 'migration_context' on Instance uuid 8ea52d41-7ec3-44d7-8421-133000ee887b {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Start _get_guest_xml network_info=[{"id": "4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b", "address": "fa:16:3e:33:76:ce", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "vif_mac": "fa:16:3e:33:76:ce"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed7b5c5-f0", "ovs_interfaceid": "4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.objects.instance [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lazy-loading 'resources' on Instance uuid 8ea52d41-7ec3-44d7-8421-133000ee887b {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.objects.instance [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lazy-loading 'numa_topology' on Instance uuid 8ea52d41-7ec3-44d7-8421-133000ee887b {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:38:34 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:38:34 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.objects.instance [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8ea52d41-7ec3-44d7-8421-133000ee887b {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:36:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1662901966',display_name='tempest-ServerRescueNegativeTestJSON-server-1662901966',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1662901966',id=15,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:36:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7aa6e9e70b4a49cb994440e868203c99',ramdisk_id='',reservation_id='r-bdwxrtct',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-700305152',owner_user_name='tempest-ServerRescueNegativeTestJSON-700305152-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:36:52Z,user_data=None,user_id='01b32889cd7442399a8bceaff3d05662',uuid=8ea52d41-7ec3-44d7-8421-133000ee887b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b", "address": "fa:16:3e:33:76:ce", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "vif_mac": "fa:16:3e:33:76:ce"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed7b5c5-f0", "ovs_interfaceid": "4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Converting VIF {"id": "4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b", "address": "fa:16:3e:33:76:ce", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "vif_mac": "fa:16:3e:33:76:ce"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed7b5c5-f0", "ovs_interfaceid": "4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:76:ce,bridge_name='br-int',has_traffic_filtering=True,id=4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b,network=Network(e1a83272-2e22-47dc-95ae-2ab9861c5925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed7b5c5-f0') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.objects.instance [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lazy-loading 'pci_devices' on Instance uuid 8ea52d41-7ec3-44d7-8421-133000ee887b {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:38:34 user nova-compute[231753]:   <uuid>8ea52d41-7ec3-44d7-8421-133000ee887b</uuid>
Jul 29 13:38:34 user nova-compute[231753]:   <name>instance-0000000f</name>
Jul 29 13:38:34 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:38:34 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:38:34 user nova-compute[231753]:   <metadata>
Jul 29 13:38:34 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:38:34 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:38:34 user nova-compute[231753]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1662901966</nova:name>
Jul 29 13:38:34 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:38:34</nova:creationTime>
Jul 29 13:38:34 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:38:34 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:38:34 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:38:34 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:38:34 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:38:34 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:38:34 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:38:34 user nova-compute[231753]:       <nova:owner>
Jul 29 13:38:34 user nova-compute[231753]:         <nova:user uuid="01b32889cd7442399a8bceaff3d05662">tempest-ServerRescueNegativeTestJSON-700305152-project-member</nova:user>
Jul 29 13:38:34 user nova-compute[231753]:         <nova:project uuid="7aa6e9e70b4a49cb994440e868203c99">tempest-ServerRescueNegativeTestJSON-700305152</nova:project>
Jul 29 13:38:34 user nova-compute[231753]:       </nova:owner>
Jul 29 13:38:34 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:38:34 user nova-compute[231753]:       <nova:ports>
Jul 29 13:38:34 user nova-compute[231753]:         <nova:port uuid="4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b">
Jul 29 13:38:34 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 29 13:38:34 user nova-compute[231753]:         </nova:port>
Jul 29 13:38:34 user nova-compute[231753]:       </nova:ports>
Jul 29 13:38:34 user nova-compute[231753]:     </nova:instance>
Jul 29 13:38:34 user nova-compute[231753]:   </metadata>
Jul 29 13:38:34 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:38:34 user nova-compute[231753]:     <system>
Jul 29 13:38:34 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:38:34 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:38:34 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:38:34 user nova-compute[231753]:       <entry name="serial">8ea52d41-7ec3-44d7-8421-133000ee887b</entry>
Jul 29 13:38:34 user nova-compute[231753]:       <entry name="uuid">8ea52d41-7ec3-44d7-8421-133000ee887b</entry>
Jul 29 13:38:34 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:38:34 user nova-compute[231753]:     </system>
Jul 29 13:38:34 user nova-compute[231753]:   </sysinfo>
Jul 29 13:38:34 user nova-compute[231753]:   <os>
Jul 29 13:38:34 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:38:34 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:38:34 user nova-compute[231753]:   </os>
Jul 29 13:38:34 user nova-compute[231753]:   <features>
Jul 29 13:38:34 user nova-compute[231753]:     <acpi/>
Jul 29 13:38:34 user nova-compute[231753]:     <apic/>
Jul 29 13:38:34 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:38:34 user nova-compute[231753]:   </features>
Jul 29 13:38:34 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:38:34 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:38:34 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:38:34 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:38:34 user nova-compute[231753]:   </clock>
Jul 29 13:38:34 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:38:34 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:38:34 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:38:34 user nova-compute[231753]:   </cpu>
Jul 29 13:38:34 user nova-compute[231753]:   <devices>
Jul 29 13:38:34 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:38:34 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:38:34 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue"/>
Jul 29 13:38:34 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:38:34 user nova-compute[231753]:     </disk>
Jul 29 13:38:34 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:38:34 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:38:34 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk"/>
Jul 29 13:38:34 user nova-compute[231753]:       <target dev="vdb" bus="virtio"/>
Jul 29 13:38:34 user nova-compute[231753]:     </disk>
Jul 29 13:38:34 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:38:34 user nova-compute[231753]:       <mac address="fa:16:3e:33:76:ce"/>
Jul 29 13:38:34 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:38:34 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:38:34 user nova-compute[231753]:       <target dev="tap4ed7b5c5-f0"/>
Jul 29 13:38:34 user nova-compute[231753]:     </interface>
Jul 29 13:38:34 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:38:34 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/console.log" append="off"/>
Jul 29 13:38:34 user nova-compute[231753]:     </serial>
Jul 29 13:38:34 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:38:34 user nova-compute[231753]:     <video>
Jul 29 13:38:34 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:38:34 user nova-compute[231753]:     </video>
Jul 29 13:38:34 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:38:34 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:38:34 user nova-compute[231753]:     </rng>
Jul 29 13:38:34 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:38:34 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:38:34 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:38:34 user nova-compute[231753]:     </memballoon>
Jul 29 13:38:34 user nova-compute[231753]:   </devices>
Jul 29 13:38:34 user nova-compute[231753]: </domain>
Jul 29 13:38:34 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:38:34 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Instance destroyed successfully.
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] No BDM found with device name vdb, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] No VIF found with MAC fa:16:3e:33:76:ce, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:35 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:35 user nova-compute[231753]: DEBUG nova.compute.manager [req-e61743eb-cf58-4570-9564-5e4f3415841a req-0aaaf118-512d-4ae6-b6ea-0b170dd9a6ac service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-plugged-4a95b92c-9a5b-4fd4-bbfd-36063a073c11 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e61743eb-cf58-4570-9564-5e4f3415841a req-0aaaf118-512d-4ae6-b6ea-0b170dd9a6ac service nova] Acquiring lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e61743eb-cf58-4570-9564-5e4f3415841a req-0aaaf118-512d-4ae6-b6ea-0b170dd9a6ac service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e61743eb-cf58-4570-9564-5e4f3415841a req-0aaaf118-512d-4ae6-b6ea-0b170dd9a6ac service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:35 user nova-compute[231753]: DEBUG nova.compute.manager [req-e61743eb-cf58-4570-9564-5e4f3415841a req-0aaaf118-512d-4ae6-b6ea-0b170dd9a6ac service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] No waiting events found dispatching network-vif-plugged-4a95b92c-9a5b-4fd4-bbfd-36063a073c11 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:38:35 user nova-compute[231753]: WARNING nova.compute.manager [req-e61743eb-cf58-4570-9564-5e4f3415841a req-0aaaf118-512d-4ae6-b6ea-0b170dd9a6ac service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received unexpected event network-vif-plugged-4a95b92c-9a5b-4fd4-bbfd-36063a073c11 for instance with vm_state building and task_state spawning.
Jul 29 13:38:35 user nova-compute[231753]: DEBUG nova.compute.manager [req-e61743eb-cf58-4570-9564-5e4f3415841a req-0aaaf118-512d-4ae6-b6ea-0b170dd9a6ac service nova] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Received event network-vif-unplugged-7be1f6de-22a8-4dde-9fad-8c62c975ab2b {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e61743eb-cf58-4570-9564-5e4f3415841a req-0aaaf118-512d-4ae6-b6ea-0b170dd9a6ac service nova] Acquiring lock "b5e7da3f-33d9-4f58-8c98-72869b679850-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e61743eb-cf58-4570-9564-5e4f3415841a req-0aaaf118-512d-4ae6-b6ea-0b170dd9a6ac service nova] Lock "b5e7da3f-33d9-4f58-8c98-72869b679850-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e61743eb-cf58-4570-9564-5e4f3415841a req-0aaaf118-512d-4ae6-b6ea-0b170dd9a6ac service nova] Lock "b5e7da3f-33d9-4f58-8c98-72869b679850-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:35 user nova-compute[231753]: DEBUG nova.compute.manager [req-e61743eb-cf58-4570-9564-5e4f3415841a req-0aaaf118-512d-4ae6-b6ea-0b170dd9a6ac service nova] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] No waiting events found dispatching network-vif-unplugged-7be1f6de-22a8-4dde-9fad-8c62c975ab2b {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:38:35 user nova-compute[231753]: DEBUG nova.compute.manager [req-e61743eb-cf58-4570-9564-5e4f3415841a req-0aaaf118-512d-4ae6-b6ea-0b170dd9a6ac service nova] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Received event network-vif-unplugged-7be1f6de-22a8-4dde-9fad-8c62c975ab2b for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:38:35 user nova-compute[231753]: DEBUG nova.compute.manager [req-e61743eb-cf58-4570-9564-5e4f3415841a req-0aaaf118-512d-4ae6-b6ea-0b170dd9a6ac service nova] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Received event network-vif-plugged-7be1f6de-22a8-4dde-9fad-8c62c975ab2b {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e61743eb-cf58-4570-9564-5e4f3415841a req-0aaaf118-512d-4ae6-b6ea-0b170dd9a6ac service nova] Acquiring lock "b5e7da3f-33d9-4f58-8c98-72869b679850-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e61743eb-cf58-4570-9564-5e4f3415841a req-0aaaf118-512d-4ae6-b6ea-0b170dd9a6ac service nova] Lock "b5e7da3f-33d9-4f58-8c98-72869b679850-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e61743eb-cf58-4570-9564-5e4f3415841a req-0aaaf118-512d-4ae6-b6ea-0b170dd9a6ac service nova] Lock "b5e7da3f-33d9-4f58-8c98-72869b679850-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:35 user nova-compute[231753]: DEBUG nova.compute.manager [req-e61743eb-cf58-4570-9564-5e4f3415841a req-0aaaf118-512d-4ae6-b6ea-0b170dd9a6ac service nova] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] No waiting events found dispatching network-vif-plugged-7be1f6de-22a8-4dde-9fad-8c62c975ab2b {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:38:35 user nova-compute[231753]: WARNING nova.compute.manager [req-e61743eb-cf58-4570-9564-5e4f3415841a req-0aaaf118-512d-4ae6-b6ea-0b170dd9a6ac service nova] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Received unexpected event network-vif-plugged-7be1f6de-22a8-4dde-9fad-8c62c975ab2b for instance with vm_state active and task_state deleting.
Jul 29 13:38:35 user nova-compute[231753]: DEBUG nova.compute.manager [req-e61743eb-cf58-4570-9564-5e4f3415841a req-0aaaf118-512d-4ae6-b6ea-0b170dd9a6ac service nova] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Received event network-vif-unplugged-4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e61743eb-cf58-4570-9564-5e4f3415841a req-0aaaf118-512d-4ae6-b6ea-0b170dd9a6ac service nova] Acquiring lock "8ea52d41-7ec3-44d7-8421-133000ee887b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e61743eb-cf58-4570-9564-5e4f3415841a req-0aaaf118-512d-4ae6-b6ea-0b170dd9a6ac service nova] Lock "8ea52d41-7ec3-44d7-8421-133000ee887b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e61743eb-cf58-4570-9564-5e4f3415841a req-0aaaf118-512d-4ae6-b6ea-0b170dd9a6ac service nova] Lock "8ea52d41-7ec3-44d7-8421-133000ee887b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:35 user nova-compute[231753]: DEBUG nova.compute.manager [req-e61743eb-cf58-4570-9564-5e4f3415841a req-0aaaf118-512d-4ae6-b6ea-0b170dd9a6ac service nova] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] No waiting events found dispatching network-vif-unplugged-4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:38:35 user nova-compute[231753]: WARNING nova.compute.manager [req-e61743eb-cf58-4570-9564-5e4f3415841a req-0aaaf118-512d-4ae6-b6ea-0b170dd9a6ac service nova] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Received unexpected event network-vif-unplugged-4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b for instance with vm_state active and task_state rescuing.
Jul 29 13:38:35 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:38:35 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:35 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Took 1.67 seconds to deallocate network for instance.
Jul 29 13:38:35 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:35 user nova-compute[231753]: DEBUG nova.compute.manager [req-49f7c3c6-7c3d-4f00-8407-9dadd812dafa req-c6d81505-5536-44c0-9cc1-c6daecf38c1e service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-plugged-f0ade4f6-225a-4c66-a2f5-d5793cfa7a96 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-49f7c3c6-7c3d-4f00-8407-9dadd812dafa req-c6d81505-5536-44c0-9cc1-c6daecf38c1e service nova] Acquiring lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-49f7c3c6-7c3d-4f00-8407-9dadd812dafa req-c6d81505-5536-44c0-9cc1-c6daecf38c1e service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-49f7c3c6-7c3d-4f00-8407-9dadd812dafa req-c6d81505-5536-44c0-9cc1-c6daecf38c1e service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:35 user nova-compute[231753]: DEBUG nova.compute.manager [req-49f7c3c6-7c3d-4f00-8407-9dadd812dafa req-c6d81505-5536-44c0-9cc1-c6daecf38c1e service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] No waiting events found dispatching network-vif-plugged-f0ade4f6-225a-4c66-a2f5-d5793cfa7a96 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:38:35 user nova-compute[231753]: WARNING nova.compute.manager [req-49f7c3c6-7c3d-4f00-8407-9dadd812dafa req-c6d81505-5536-44c0-9cc1-c6daecf38c1e service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received unexpected event network-vif-plugged-f0ade4f6-225a-4c66-a2f5-d5793cfa7a96 for instance with vm_state building and task_state spawning.
Jul 29 13:38:35 user nova-compute[231753]: DEBUG nova.compute.manager [req-49f7c3c6-7c3d-4f00-8407-9dadd812dafa req-c6d81505-5536-44c0-9cc1-c6daecf38c1e service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-plugged-a4a0b15f-494b-4934-8b4f-fb8df577a60d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-49f7c3c6-7c3d-4f00-8407-9dadd812dafa req-c6d81505-5536-44c0-9cc1-c6daecf38c1e service nova] Acquiring lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-49f7c3c6-7c3d-4f00-8407-9dadd812dafa req-c6d81505-5536-44c0-9cc1-c6daecf38c1e service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-49f7c3c6-7c3d-4f00-8407-9dadd812dafa req-c6d81505-5536-44c0-9cc1-c6daecf38c1e service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:35 user nova-compute[231753]: DEBUG nova.compute.manager [req-49f7c3c6-7c3d-4f00-8407-9dadd812dafa req-c6d81505-5536-44c0-9cc1-c6daecf38c1e service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] No waiting events found dispatching network-vif-plugged-a4a0b15f-494b-4934-8b4f-fb8df577a60d {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:38:35 user nova-compute[231753]: WARNING nova.compute.manager [req-49f7c3c6-7c3d-4f00-8407-9dadd812dafa req-c6d81505-5536-44c0-9cc1-c6daecf38c1e service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received unexpected event network-vif-plugged-a4a0b15f-494b-4934-8b4f-fb8df577a60d for instance with vm_state building and task_state spawning.
Jul 29 13:38:35 user nova-compute[231753]: DEBUG nova.compute.manager [req-49f7c3c6-7c3d-4f00-8407-9dadd812dafa req-c6d81505-5536-44c0-9cc1-c6daecf38c1e service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-plugged-a4a0b15f-494b-4934-8b4f-fb8df577a60d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-49f7c3c6-7c3d-4f00-8407-9dadd812dafa req-c6d81505-5536-44c0-9cc1-c6daecf38c1e service nova] Acquiring lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-49f7c3c6-7c3d-4f00-8407-9dadd812dafa req-c6d81505-5536-44c0-9cc1-c6daecf38c1e service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-49f7c3c6-7c3d-4f00-8407-9dadd812dafa req-c6d81505-5536-44c0-9cc1-c6daecf38c1e service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:35 user nova-compute[231753]: DEBUG nova.compute.manager [req-49f7c3c6-7c3d-4f00-8407-9dadd812dafa req-c6d81505-5536-44c0-9cc1-c6daecf38c1e service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] No waiting events found dispatching network-vif-plugged-a4a0b15f-494b-4934-8b4f-fb8df577a60d {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:38:35 user nova-compute[231753]: WARNING nova.compute.manager [req-49f7c3c6-7c3d-4f00-8407-9dadd812dafa req-c6d81505-5536-44c0-9cc1-c6daecf38c1e service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received unexpected event network-vif-plugged-a4a0b15f-494b-4934-8b4f-fb8df577a60d for instance with vm_state building and task_state spawning.
Jul 29 13:38:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c1fc96ed-7f70-4ce5-88f7-89b808d1801e tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c1fc96ed-7f70-4ce5-88f7-89b808d1801e tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:36 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-c1fc96ed-7f70-4ce5-88f7-89b808d1801e tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:38:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:36 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-c1fc96ed-7f70-4ce5-88f7-89b808d1801e tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:38:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c1fc96ed-7f70-4ce5-88f7-89b808d1801e tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.724s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:36 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-c1fc96ed-7f70-4ce5-88f7-89b808d1801e tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Deleted allocations for instance b5e7da3f-33d9-4f58-8c98-72869b679850
Jul 29 13:38:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c1fc96ed-7f70-4ce5-88f7-89b808d1801e tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "b5e7da3f-33d9-4f58-8c98-72869b679850" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.274s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:36 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637916.9352472, 894f5e40-e585-41c0-9dd8-e94d8a9400ef => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:38:36 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] VM Resumed (Lifecycle Event)
Jul 29 13:38:36 user nova-compute[231753]: DEBUG nova.compute.manager [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:38:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:38:36 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Instance spawned successfully.
Jul 29 13:38:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:38:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:36 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:38:36 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:38:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:38:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:38:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:38:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:38:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:38:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:38:37 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:38:37 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637916.940591, 894f5e40-e585-41c0-9dd8-e94d8a9400ef => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:38:37 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] VM Started (Lifecycle Event)
Jul 29 13:38:37 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:38:37 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:38:37 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:38:37 user nova-compute[231753]: INFO nova.compute.manager [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Took 13.46 seconds to spawn the instance on the hypervisor.
Jul 29 13:38:37 user nova-compute[231753]: DEBUG nova.compute.manager [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:38:37 user nova-compute[231753]: DEBUG nova.compute.manager [req-81f8ed63-d3fe-408f-886e-d3a50197e60c req-ebbed7c1-a524-48aa-90f2-dd17a302ebfc service nova] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Received event network-vif-plugged-4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-81f8ed63-d3fe-408f-886e-d3a50197e60c req-ebbed7c1-a524-48aa-90f2-dd17a302ebfc service nova] Acquiring lock "8ea52d41-7ec3-44d7-8421-133000ee887b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-81f8ed63-d3fe-408f-886e-d3a50197e60c req-ebbed7c1-a524-48aa-90f2-dd17a302ebfc service nova] Lock "8ea52d41-7ec3-44d7-8421-133000ee887b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-81f8ed63-d3fe-408f-886e-d3a50197e60c req-ebbed7c1-a524-48aa-90f2-dd17a302ebfc service nova] Lock "8ea52d41-7ec3-44d7-8421-133000ee887b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:37 user nova-compute[231753]: DEBUG nova.compute.manager [req-81f8ed63-d3fe-408f-886e-d3a50197e60c req-ebbed7c1-a524-48aa-90f2-dd17a302ebfc service nova] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] No waiting events found dispatching network-vif-plugged-4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:38:37 user nova-compute[231753]: WARNING nova.compute.manager [req-81f8ed63-d3fe-408f-886e-d3a50197e60c req-ebbed7c1-a524-48aa-90f2-dd17a302ebfc service nova] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Received unexpected event network-vif-plugged-4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b for instance with vm_state active and task_state rescuing.
Jul 29 13:38:37 user nova-compute[231753]: DEBUG nova.compute.manager [req-81f8ed63-d3fe-408f-886e-d3a50197e60c req-ebbed7c1-a524-48aa-90f2-dd17a302ebfc service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-plugged-a795944f-ca69-4b3d-90b6-bf61d16fa1a8 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-81f8ed63-d3fe-408f-886e-d3a50197e60c req-ebbed7c1-a524-48aa-90f2-dd17a302ebfc service nova] Acquiring lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-81f8ed63-d3fe-408f-886e-d3a50197e60c req-ebbed7c1-a524-48aa-90f2-dd17a302ebfc service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-81f8ed63-d3fe-408f-886e-d3a50197e60c req-ebbed7c1-a524-48aa-90f2-dd17a302ebfc service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:37 user nova-compute[231753]: DEBUG nova.compute.manager [req-81f8ed63-d3fe-408f-886e-d3a50197e60c req-ebbed7c1-a524-48aa-90f2-dd17a302ebfc service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] No waiting events found dispatching network-vif-plugged-a795944f-ca69-4b3d-90b6-bf61d16fa1a8 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:38:37 user nova-compute[231753]: WARNING nova.compute.manager [req-81f8ed63-d3fe-408f-886e-d3a50197e60c req-ebbed7c1-a524-48aa-90f2-dd17a302ebfc service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received unexpected event network-vif-plugged-a795944f-ca69-4b3d-90b6-bf61d16fa1a8 for instance with vm_state building and task_state spawning.
Jul 29 13:38:37 user nova-compute[231753]: DEBUG nova.compute.manager [req-81f8ed63-d3fe-408f-886e-d3a50197e60c req-ebbed7c1-a524-48aa-90f2-dd17a302ebfc service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-plugged-a795944f-ca69-4b3d-90b6-bf61d16fa1a8 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-81f8ed63-d3fe-408f-886e-d3a50197e60c req-ebbed7c1-a524-48aa-90f2-dd17a302ebfc service nova] Acquiring lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-81f8ed63-d3fe-408f-886e-d3a50197e60c req-ebbed7c1-a524-48aa-90f2-dd17a302ebfc service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-81f8ed63-d3fe-408f-886e-d3a50197e60c req-ebbed7c1-a524-48aa-90f2-dd17a302ebfc service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:37 user nova-compute[231753]: DEBUG nova.compute.manager [req-81f8ed63-d3fe-408f-886e-d3a50197e60c req-ebbed7c1-a524-48aa-90f2-dd17a302ebfc service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] No waiting events found dispatching network-vif-plugged-a795944f-ca69-4b3d-90b6-bf61d16fa1a8 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:38:37 user nova-compute[231753]: WARNING nova.compute.manager [req-81f8ed63-d3fe-408f-886e-d3a50197e60c req-ebbed7c1-a524-48aa-90f2-dd17a302ebfc service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received unexpected event network-vif-plugged-a795944f-ca69-4b3d-90b6-bf61d16fa1a8 for instance with vm_state building and task_state spawning.
Jul 29 13:38:37 user nova-compute[231753]: DEBUG nova.compute.manager [req-81f8ed63-d3fe-408f-886e-d3a50197e60c req-ebbed7c1-a524-48aa-90f2-dd17a302ebfc service nova] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Received event network-vif-plugged-4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-81f8ed63-d3fe-408f-886e-d3a50197e60c req-ebbed7c1-a524-48aa-90f2-dd17a302ebfc service nova] Acquiring lock "8ea52d41-7ec3-44d7-8421-133000ee887b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-81f8ed63-d3fe-408f-886e-d3a50197e60c req-ebbed7c1-a524-48aa-90f2-dd17a302ebfc service nova] Lock "8ea52d41-7ec3-44d7-8421-133000ee887b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-81f8ed63-d3fe-408f-886e-d3a50197e60c req-ebbed7c1-a524-48aa-90f2-dd17a302ebfc service nova] Lock "8ea52d41-7ec3-44d7-8421-133000ee887b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:37 user nova-compute[231753]: DEBUG nova.compute.manager [req-81f8ed63-d3fe-408f-886e-d3a50197e60c req-ebbed7c1-a524-48aa-90f2-dd17a302ebfc service nova] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] No waiting events found dispatching network-vif-plugged-4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:38:37 user nova-compute[231753]: WARNING nova.compute.manager [req-81f8ed63-d3fe-408f-886e-d3a50197e60c req-ebbed7c1-a524-48aa-90f2-dd17a302ebfc service nova] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Received unexpected event network-vif-plugged-4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b for instance with vm_state active and task_state rescuing.
Jul 29 13:38:37 user nova-compute[231753]: INFO nova.compute.manager [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Took 41.52 seconds to build instance.
Jul 29 13:38:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b5efb112-f980-453b-9755-e60487195ac3 tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 41.650s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:37 user nova-compute[231753]: DEBUG nova.compute.manager [req-f7bf93bb-5b38-45b3-9c1a-c54f5e07df63 req-6ce5634b-ae59-400c-b06a-c7c4cd21a172 service nova] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Received event network-vif-deleted-7be1f6de-22a8-4dde-9fad-8c62c975ab2b {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:38 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Removed pending event for 8ea52d41-7ec3-44d7-8421-133000ee887b due to event {{(pid=231753) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 29 13:38:38 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637918.876347, 8ea52d41-7ec3-44d7-8421-133000ee887b => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:38:38 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] VM Resumed (Lifecycle Event)
Jul 29 13:38:38 user nova-compute[231753]: DEBUG nova.compute.manager [None req-9fef80c1-45a5-41a4-916f-0ab9308be93e tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:38:38 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:38:38 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:38:38 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 29 13:38:38 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637918.878336, 8ea52d41-7ec3-44d7-8421-133000ee887b => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:38:38 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] VM Started (Lifecycle Event)
Jul 29 13:38:38 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:38:38 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:38:39 user nova-compute[231753]: DEBUG nova.compute.manager [req-5aded15a-ac40-4650-a219-b05a25a571ef req-755b2793-8c08-4795-b90a-cd5235c22774 service nova] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Received event network-vif-plugged-4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5aded15a-ac40-4650-a219-b05a25a571ef req-755b2793-8c08-4795-b90a-cd5235c22774 service nova] Acquiring lock "8ea52d41-7ec3-44d7-8421-133000ee887b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5aded15a-ac40-4650-a219-b05a25a571ef req-755b2793-8c08-4795-b90a-cd5235c22774 service nova] Lock "8ea52d41-7ec3-44d7-8421-133000ee887b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5aded15a-ac40-4650-a219-b05a25a571ef req-755b2793-8c08-4795-b90a-cd5235c22774 service nova] Lock "8ea52d41-7ec3-44d7-8421-133000ee887b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:39 user nova-compute[231753]: DEBUG nova.compute.manager [req-5aded15a-ac40-4650-a219-b05a25a571ef req-755b2793-8c08-4795-b90a-cd5235c22774 service nova] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] No waiting events found dispatching network-vif-plugged-4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:38:39 user nova-compute[231753]: WARNING nova.compute.manager [req-5aded15a-ac40-4650-a219-b05a25a571ef req-755b2793-8c08-4795-b90a-cd5235c22774 service nova] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Received unexpected event network-vif-plugged-4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b for instance with vm_state rescued and task_state None.
Jul 29 13:38:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:47 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:48 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690637913.8092859, b5e7da3f-33d9-4f58-8c98-72869b679850 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:38:48 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] VM Stopped (Lifecycle Event)
Jul 29 13:38:48 user nova-compute[231753]: DEBUG nova.compute.manager [None req-fde64dce-c31a-4b93-87a5-c585df63f8ca None None] [instance: b5e7da3f-33d9-4f58-8c98-72869b679850] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:38:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:50 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "481435b2-4319-4caf-aa5b-5c986a747258" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "481435b2-4319-4caf-aa5b-5c986a747258" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:53 user nova-compute[231753]: DEBUG nova.compute.manager [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:38:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:53 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:38:53 user nova-compute[231753]: INFO nova.compute.claims [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Claim successful on node user
Jul 29 13:38:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:53 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:38:53 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:38:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.506s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:53 user nova-compute[231753]: DEBUG nova.compute.manager [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:38:53 user nova-compute[231753]: DEBUG nova.compute.manager [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:38:53 user nova-compute[231753]: DEBUG nova.network.neutron [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:38:53 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:38:53 user nova-compute[231753]: DEBUG nova.compute.manager [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:38:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:53 user nova-compute[231753]: DEBUG nova.policy [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a09de75c8ab742fe951604b612ea5839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3122196c4504a82a2a01774ab60406a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:38:53 user nova-compute[231753]: DEBUG nova.compute.manager [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:38:53 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:38:53 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Creating image(s)
Jul 29 13:38:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "/opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "/opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "/opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.155s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-037d8caf-ebff-4a2f-a7d0-32261250174f tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Acquiring lock "3fed0e1e-c8a7-43cc-bef6-14410111d3cb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-037d8caf-ebff-4a2f-a7d0-32261250174f tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "3fed0e1e-c8a7-43cc-bef6-14410111d3cb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:54 user nova-compute[231753]: INFO nova.compute.manager [None req-037d8caf-ebff-4a2f-a7d0-32261250174f tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Detaching volume 6bc82b7d-5f8e-4c78-9880-c589a410d3a0
Jul 29 13:38:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.167s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:54 user nova-compute[231753]: INFO nova.virt.block_device [None req-037d8caf-ebff-4a2f-a7d0-32261250174f tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Attempting to driver detach volume 6bc82b7d-5f8e-4c78-9880-c589a410d3a0 from mountpoint /dev/vdb
Jul 29 13:38:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Acquiring lock "3fed0e1e-c8a7-43cc-bef6-14410111d3cb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-037d8caf-ebff-4a2f-a7d0-32261250174f tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Attempting to detach device vdb from instance 3fed0e1e-c8a7-43cc-bef6-14410111d3cb from the persistent domain config. {{(pid=231753) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-037d8caf-ebff-4a2f-a7d0-32261250174f tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:38:54 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:38:54 user nova-compute[231753]:   <source dev="/dev/sde"/>
Jul 29 13:38:54 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:38:54 user nova-compute[231753]:   <serial>6bc82b7d-5f8e-4c78-9880-c589a410d3a0</serial>
Jul 29 13:38:54 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 13:38:54 user nova-compute[231753]: </disk>
Jul 29 13:38:54 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258/disk 1073741824" returned: 0 in 0.071s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.241s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:54 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-037d8caf-ebff-4a2f-a7d0-32261250174f tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Successfully detached device vdb from instance 3fed0e1e-c8a7-43cc-bef6-14410111d3cb from the persistent domain config.
Jul 29 13:38:54 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-037d8caf-ebff-4a2f-a7d0-32261250174f tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3fed0e1e-c8a7-43cc-bef6-14410111d3cb from the live domain config. {{(pid=231753) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-037d8caf-ebff-4a2f-a7d0-32261250174f tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:38:54 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:38:54 user nova-compute[231753]:   <source dev="/dev/sde"/>
Jul 29 13:38:54 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:38:54 user nova-compute[231753]:   <serial>6bc82b7d-5f8e-4c78-9880-c589a410d3a0</serial>
Jul 29 13:38:54 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 13:38:54 user nova-compute[231753]: </disk>
Jul 29 13:38:54 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.139s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Checking if we can resize image /opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Cannot resize image /opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG nova.objects.instance [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lazy-loading 'migration_context' on Instance uuid 481435b2-4319-4caf-aa5b-5c986a747258 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Ensure instance console log exists: /opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Received event <DeviceRemovedEvent: 1690637934.869894, 3fed0e1e-c8a7-43cc-bef6-14410111d3cb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=231753) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-037d8caf-ebff-4a2f-a7d0-32261250174f tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3fed0e1e-c8a7-43cc-bef6-14410111d3cb {{(pid=231753) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 13:38:54 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-037d8caf-ebff-4a2f-a7d0-32261250174f tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Successfully detached device vdb from instance 3fed0e1e-c8a7-43cc-bef6-14410111d3cb from the live domain config.
Jul 29 13:38:54 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-037d8caf-ebff-4a2f-a7d0-32261250174f tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-037d8caf-ebff-4a2f-a7d0-32261250174f tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hJVTmcIG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:38:54 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-037d8caf-ebff-4a2f-a7d0-32261250174f tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:38:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-037d8caf-ebff-4a2f-a7d0-32261250174f tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-037d8caf-ebff-4a2f-a7d0-32261250174f tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG nova.network.neutron [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Successfully created port: a73b2376-652b-4f89-a463-3f854a2995ee {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[391ca637-0d06-4ea8-91e6-b574d497107f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-037d8caf-ebff-4a2f-a7d0-32261250174f tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:38:54 user nova-compute[231753]: No targets found.
Jul 29 13:38:54 user nova-compute[231753]: iSNS:
Jul 29 13:38:54 user nova-compute[231753]: No targets found.
Jul 29 13:38:54 user nova-compute[231753]: STATIC:
Jul 29 13:38:54 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0
Jul 29 13:38:54 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:38:54 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:38:54 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0
Jul 29 13:38:54 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:38:54 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:38:54 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4
Jul 29 13:38:54 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:38:54 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:38:54 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3
Jul 29 13:38:54 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:38:54 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:38:54 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3
Jul 29 13:38:54 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:38:54 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:38:54 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7
Jul 29 13:38:54 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:38:54 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:38:54 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be
Jul 29 13:38:54 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:38:54 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:38:54 user nova-compute[231753]: FIRMWARE:
Jul 29 13:38:54 user nova-compute[231753]: No targets found.
Jul 29 13:38:54 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-037d8caf-ebff-4a2f-a7d0-32261250174f tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:38:54 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:38:54 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-037d8caf-ebff-4a2f-a7d0-32261250174f tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5899b09-d385-416d-bd94-81d7dcdb87c1]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[63726639-2fb6-4320-99cb-b319deb7f813]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)\ntcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-037d8caf-ebff-4a2f-a7d0-32261250174f tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)
Jul 29 13:38:54 user nova-compute[231753]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:38:54 user nova-compute[231753]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:38:54 user nova-compute[231753]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 (non-flash)
Jul 29 13:38:54 user nova-compute[231753]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 (non-flash)
Jul 29 13:38:54 user nova-compute[231753]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be (non-flash)
Jul 29 13:38:54 user nova-compute[231753]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 (non-flash)
Jul 29 13:38:54 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-037d8caf-ebff-4a2f-a7d0-32261250174f tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)
Jul 29 13:38:54 user nova-compute[231753]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:38:54 user nova-compute[231753]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:38:54 user nova-compute[231753]: tcp: [18] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 (non-flash)
Jul 29 13:38:54 user nova-compute[231753]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 (non-flash)
Jul 29 13:38:54 user nova-compute[231753]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be (non-flash)
Jul 29 13:38:54 user nova-compute[231753]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 (non-flash)
Jul 29 13:38:54 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-037d8caf-ebff-4a2f-a7d0-32261250174f tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c980fbf40>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0'): ({'sde'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-037d8caf-ebff-4a2f-a7d0-32261250174f tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Removing single pathed devices sde {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:38:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[773c9b1f-5f51-45b0-bf60-238607c34f30]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abdaaae-8c07-4ecb-9357-f982c0f68695]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-037d8caf-ebff-4a2f-a7d0-32261250174f tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Flushing IO for device /dev/sde {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.013s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[869dfd88-0da3-4cd9-9496-3617ae348f1e]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-037d8caf-ebff-4a2f-a7d0-32261250174f tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.044s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b39135a8-a883-4ec7-b5a4-e6a423782e72]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-037d8caf-ebff-4a2f-a7d0-32261250174f tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-037d8caf-ebff-4a2f-a7d0-32261250174f tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] SCSI volumes sde have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-037d8caf-ebff-4a2f-a7d0-32261250174f tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa5e38e6-6d4d-4af4-9eb9-404a37a7277e]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-037d8caf-ebff-4a2f-a7d0-32261250174f tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[23d7e012-536e-43cb-9281-9b4bc14eb3b0]: (4, ('Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0, portal: 172.16.0.220,3260]\nLogout of [sid: 18, target: iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-037d8caf-ebff-4a2f-a7d0-32261250174f tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0, portal: 172.16.0.220,3260]
Jul 29 13:38:55 user nova-compute[231753]: Logout of [sid: 18, target: iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0, portal: 172.16.0.220,3260] successful.
Jul 29 13:38:55 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.037s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e77a563-e523-47d8-a2fa-90c12ce604e8]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-037d8caf-ebff-4a2f-a7d0-32261250174f tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-037d8caf-ebff-4a2f-a7d0-32261250174f tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.342s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-037d8caf-ebff-4a2f-a7d0-32261250174f tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] <== disconnect_volume: return (343ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-037d8caf-ebff-4a2f-a7d0-32261250174f tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-44d90e10-3255-4bf3-b075-761928bc1885 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "4475f276-acc4-44f1-a5fa-6a7fb2165493" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-44d90e10-3255-4bf3-b075-761928bc1885 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "4475f276-acc4-44f1-a5fa-6a7fb2165493" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:55 user nova-compute[231753]: INFO nova.compute.manager [None req-44d90e10-3255-4bf3-b075-761928bc1885 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Detaching volume 0b2a5916-6c71-4b54-9944-8b2c623fcbb3
Jul 29 13:38:55 user nova-compute[231753]: DEBUG nova.network.neutron [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Successfully updated port: a73b2376-652b-4f89-a463-3f854a2995ee {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "refresh_cache-481435b2-4319-4caf-aa5b-5c986a747258" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquired lock "refresh_cache-481435b2-4319-4caf-aa5b-5c986a747258" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG nova.network.neutron [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:38:55 user nova-compute[231753]: INFO nova.virt.block_device [None req-44d90e10-3255-4bf3-b075-761928bc1885 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Attempting to driver detach volume 0b2a5916-6c71-4b54-9944-8b2c623fcbb3 from mountpoint /dev/vdc
Jul 29 13:38:55 user nova-compute[231753]: DEBUG nova.compute.manager [req-d70c03b6-df88-4f8e-83b2-48e22a1753c6 req-fad2a433-fb76-4115-9a74-b14ce3f33052 service nova] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Received event network-changed-a73b2376-652b-4f89-a463-3f854a2995ee {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG nova.compute.manager [req-d70c03b6-df88-4f8e-83b2-48e22a1753c6 req-fad2a433-fb76-4115-9a74-b14ce3f33052 service nova] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Refreshing instance network info cache due to event network-changed-a73b2376-652b-4f89-a463-3f854a2995ee. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d70c03b6-df88-4f8e-83b2-48e22a1753c6 req-fad2a433-fb76-4115-9a74-b14ce3f33052 service nova] Acquiring lock "refresh_cache-481435b2-4319-4caf-aa5b-5c986a747258" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-44d90e10-3255-4bf3-b075-761928bc1885 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Attempting to detach device vdc from instance 4475f276-acc4-44f1-a5fa-6a7fb2165493 from the persistent domain config. {{(pid=231753) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-44d90e10-3255-4bf3-b075-761928bc1885 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:38:55 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:38:55 user nova-compute[231753]:   <source dev="/dev/sdb"/>
Jul 29 13:38:55 user nova-compute[231753]:   <target dev="vdc" bus="virtio"/>
Jul 29 13:38:55 user nova-compute[231753]:   <serial>0b2a5916-6c71-4b54-9944-8b2c623fcbb3</serial>
Jul 29 13:38:55 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 29 13:38:55 user nova-compute[231753]: </disk>
Jul 29 13:38:55 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG nova.network.neutron [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:38:55 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-44d90e10-3255-4bf3-b075-761928bc1885 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Successfully detached device vdc from instance 4475f276-acc4-44f1-a5fa-6a7fb2165493 from the persistent domain config.
Jul 29 13:38:55 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-44d90e10-3255-4bf3-b075-761928bc1885 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 4475f276-acc4-44f1-a5fa-6a7fb2165493 from the live domain config. {{(pid=231753) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 13:38:55 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-44d90e10-3255-4bf3-b075-761928bc1885 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:38:55 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:38:55 user nova-compute[231753]:   <source dev="/dev/sdb"/>
Jul 29 13:38:55 user nova-compute[231753]:   <target dev="vdc" bus="virtio"/>
Jul 29 13:38:55 user nova-compute[231753]:   <serial>0b2a5916-6c71-4b54-9944-8b2c623fcbb3</serial>
Jul 29 13:38:55 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 29 13:38:55 user nova-compute[231753]: </disk>
Jul 29 13:38:55 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.network.neutron [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Updating instance_info_cache with network_info: [{"id": "a73b2376-652b-4f89-a463-3f854a2995ee", "address": "fa:16:3e:77:e8:2e", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73b2376-65", "ovs_interfaceid": "a73b2376-652b-4f89-a463-3f854a2995ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Releasing lock "refresh_cache-481435b2-4319-4caf-aa5b-5c986a747258" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.compute.manager [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Instance network_info: |[{"id": "a73b2376-652b-4f89-a463-3f854a2995ee", "address": "fa:16:3e:77:e8:2e", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73b2376-65", "ovs_interfaceid": "a73b2376-652b-4f89-a463-3f854a2995ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d70c03b6-df88-4f8e-83b2-48e22a1753c6 req-fad2a433-fb76-4115-9a74-b14ce3f33052 service nova] Acquired lock "refresh_cache-481435b2-4319-4caf-aa5b-5c986a747258" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.network.neutron [req-d70c03b6-df88-4f8e-83b2-48e22a1753c6 req-fad2a433-fb76-4115-9a74-b14ce3f33052 service nova] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Refreshing network info cache for port a73b2376-652b-4f89-a463-3f854a2995ee {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Start _get_guest_xml network_info=[{"id": "a73b2376-652b-4f89-a463-3f854a2995ee", "address": "fa:16:3e:77:e8:2e", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73b2376-65", "ovs_interfaceid": "a73b2376-652b-4f89-a463-3f854a2995ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:38:56 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:38:56 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:38:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1046079103',display_name='tempest-AttachVolumeNegativeTest-server-1046079103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1046079103',id=19,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyAEcUFDiNBsPFPPa+JR0QYMpbX4Y39F0skkPuwRnwBReQGnE3vcfy0e1rLLudNwbWD8rIZ9YeyCBDoyr62sJkm43PWHVUuioFvdFQz2pf1i4HNLoMm8tw4X3VTI+a7Hw==',key_name='tempest-keypair-2143632731',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3122196c4504a82a2a01774ab60406a',ramdisk_id='',reservation_id='r-g2m77k0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1031975907',owner_user_name='tempest-AttachVolumeNegativeTest-1031975907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:38:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a09de75c8ab742fe951604b612ea5839',uuid=481435b2-4319-4caf-aa5b-5c986a747258,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a73b2376-652b-4f89-a463-3f854a2995ee", "address": "fa:16:3e:77:e8:2e", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73b2376-65", "ovs_interfaceid": "a73b2376-652b-4f89-a463-3f854a2995ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Converting VIF {"id": "a73b2376-652b-4f89-a463-3f854a2995ee", "address": "fa:16:3e:77:e8:2e", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73b2376-65", "ovs_interfaceid": "a73b2376-652b-4f89-a463-3f854a2995ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:e8:2e,bridge_name='br-int',has_traffic_filtering=True,id=a73b2376-652b-4f89-a463-3f854a2995ee,network=Network(1ff03660-77ea-4ec6-8eeb-55df7e78096b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73b2376-65') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.objects.instance [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lazy-loading 'pci_devices' on Instance uuid 481435b2-4319-4caf-aa5b-5c986a747258 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:38:56 user nova-compute[231753]:   <uuid>481435b2-4319-4caf-aa5b-5c986a747258</uuid>
Jul 29 13:38:56 user nova-compute[231753]:   <name>instance-00000013</name>
Jul 29 13:38:56 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:38:56 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:38:56 user nova-compute[231753]:   <metadata>
Jul 29 13:38:56 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:38:56 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:38:56 user nova-compute[231753]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1046079103</nova:name>
Jul 29 13:38:56 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:38:56</nova:creationTime>
Jul 29 13:38:56 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:38:56 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:38:56 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:38:56 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:38:56 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:38:56 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:38:56 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:38:56 user nova-compute[231753]:       <nova:owner>
Jul 29 13:38:56 user nova-compute[231753]:         <nova:user uuid="a09de75c8ab742fe951604b612ea5839">tempest-AttachVolumeNegativeTest-1031975907-project-member</nova:user>
Jul 29 13:38:56 user nova-compute[231753]:         <nova:project uuid="f3122196c4504a82a2a01774ab60406a">tempest-AttachVolumeNegativeTest-1031975907</nova:project>
Jul 29 13:38:56 user nova-compute[231753]:       </nova:owner>
Jul 29 13:38:56 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:38:56 user nova-compute[231753]:       <nova:ports>
Jul 29 13:38:56 user nova-compute[231753]:         <nova:port uuid="a73b2376-652b-4f89-a463-3f854a2995ee">
Jul 29 13:38:56 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 29 13:38:56 user nova-compute[231753]:         </nova:port>
Jul 29 13:38:56 user nova-compute[231753]:       </nova:ports>
Jul 29 13:38:56 user nova-compute[231753]:     </nova:instance>
Jul 29 13:38:56 user nova-compute[231753]:   </metadata>
Jul 29 13:38:56 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:38:56 user nova-compute[231753]:     <system>
Jul 29 13:38:56 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:38:56 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:38:56 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:38:56 user nova-compute[231753]:       <entry name="serial">481435b2-4319-4caf-aa5b-5c986a747258</entry>
Jul 29 13:38:56 user nova-compute[231753]:       <entry name="uuid">481435b2-4319-4caf-aa5b-5c986a747258</entry>
Jul 29 13:38:56 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:38:56 user nova-compute[231753]:     </system>
Jul 29 13:38:56 user nova-compute[231753]:   </sysinfo>
Jul 29 13:38:56 user nova-compute[231753]:   <os>
Jul 29 13:38:56 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:38:56 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:38:56 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:38:56 user nova-compute[231753]:   </os>
Jul 29 13:38:56 user nova-compute[231753]:   <features>
Jul 29 13:38:56 user nova-compute[231753]:     <acpi/>
Jul 29 13:38:56 user nova-compute[231753]:     <apic/>
Jul 29 13:38:56 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:38:56 user nova-compute[231753]:   </features>
Jul 29 13:38:56 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:38:56 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:38:56 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:38:56 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:38:56 user nova-compute[231753]:   </clock>
Jul 29 13:38:56 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:38:56 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:38:56 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:38:56 user nova-compute[231753]:   </cpu>
Jul 29 13:38:56 user nova-compute[231753]:   <devices>
Jul 29 13:38:56 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:38:56 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:38:56 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258/disk"/>
Jul 29 13:38:56 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:38:56 user nova-compute[231753]:     </disk>
Jul 29 13:38:56 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:38:56 user nova-compute[231753]:       <mac address="fa:16:3e:77:e8:2e"/>
Jul 29 13:38:56 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:38:56 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:38:56 user nova-compute[231753]:       <target dev="tapa73b2376-65"/>
Jul 29 13:38:56 user nova-compute[231753]:     </interface>
Jul 29 13:38:56 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:38:56 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258/console.log" append="off"/>
Jul 29 13:38:56 user nova-compute[231753]:     </serial>
Jul 29 13:38:56 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:38:56 user nova-compute[231753]:     <video>
Jul 29 13:38:56 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:38:56 user nova-compute[231753]:     </video>
Jul 29 13:38:56 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:38:56 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:38:56 user nova-compute[231753]:     </rng>
Jul 29 13:38:56 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:38:56 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:38:56 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:38:56 user nova-compute[231753]:     </memballoon>
Jul 29 13:38:56 user nova-compute[231753]:   </devices>
Jul 29 13:38:56 user nova-compute[231753]: </domain>
Jul 29 13:38:56 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:38:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1046079103',display_name='tempest-AttachVolumeNegativeTest-server-1046079103',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1046079103',id=19,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyAEcUFDiNBsPFPPa+JR0QYMpbX4Y39F0skkPuwRnwBReQGnE3vcfy0e1rLLudNwbWD8rIZ9YeyCBDoyr62sJkm43PWHVUuioFvdFQz2pf1i4HNLoMm8tw4X3VTI+a7Hw==',key_name='tempest-keypair-2143632731',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3122196c4504a82a2a01774ab60406a',ramdisk_id='',reservation_id='r-g2m77k0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1031975907',owner_user_name='tempest-AttachVolumeNegativeTest-1031975907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:38:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a09de75c8ab742fe951604b612ea5839',uuid=481435b2-4319-4caf-aa5b-5c986a747258,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a73b2376-652b-4f89-a463-3f854a2995ee", "address": "fa:16:3e:77:e8:2e", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73b2376-65", "ovs_interfaceid": "a73b2376-652b-4f89-a463-3f854a2995ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Converting VIF {"id": "a73b2376-652b-4f89-a463-3f854a2995ee", "address": "fa:16:3e:77:e8:2e", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73b2376-65", "ovs_interfaceid": "a73b2376-652b-4f89-a463-3f854a2995ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:77:e8:2e,bridge_name='br-int',has_traffic_filtering=True,id=a73b2376-652b-4f89-a463-3f854a2995ee,network=Network(1ff03660-77ea-4ec6-8eeb-55df7e78096b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73b2376-65') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG os_vif [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:e8:2e,bridge_name='br-int',has_traffic_filtering=True,id=a73b2376-652b-4f89-a463-3f854a2995ee,network=Network(1ff03660-77ea-4ec6-8eeb-55df7e78096b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73b2376-65') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa73b2376-65, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa73b2376-65, col_values=(('external_ids', {'iface-id': 'a73b2376-652b-4f89-a463-3f854a2995ee', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:77:e8:2e', 'vm-uuid': '481435b2-4319-4caf-aa5b-5c986a747258'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:56 user nova-compute[231753]: INFO os_vif [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:77:e8:2e,bridge_name='br-int',has_traffic_filtering=True,id=a73b2376-652b-4f89-a463-3f854a2995ee,network=Network(1ff03660-77ea-4ec6-8eeb-55df7e78096b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73b2376-65')
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Received event <DeviceRemovedEvent: 1690637936.381672, 4475f276-acc4-44f1-a5fa-6a7fb2165493 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=231753) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-44d90e10-3255-4bf3-b075-761928bc1885 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 4475f276-acc4-44f1-a5fa-6a7fb2165493 {{(pid=231753) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 13:38:56 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-44d90e10-3255-4bf3-b075-761928bc1885 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Successfully detached device vdc from instance 4475f276-acc4-44f1-a5fa-6a7fb2165493 from the live domain config.
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44d90e10-3255-4bf3-b075-761928bc1885 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d90e10-3255-4bf3-b075-761928bc1885 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'MxXsLgzw', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:38:56 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-44d90e10-3255-4bf3-b075-761928bc1885 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:38:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-44d90e10-3255-4bf3-b075-761928bc1885 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-44d90e10-3255-4bf3-b075-761928bc1885 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f59c3e19-465e-42cd-80df-c6e85adf0551]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d90e10-3255-4bf3-b075-761928bc1885 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:38:56 user nova-compute[231753]: No targets found.
Jul 29 13:38:56 user nova-compute[231753]: iSNS:
Jul 29 13:38:56 user nova-compute[231753]: No targets found.
Jul 29 13:38:56 user nova-compute[231753]: STATIC:
Jul 29 13:38:56 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0
Jul 29 13:38:56 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:38:56 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:38:56 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4
Jul 29 13:38:56 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:38:56 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:38:56 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3
Jul 29 13:38:56 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:38:56 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:38:56 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3
Jul 29 13:38:56 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:38:56 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:38:56 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7
Jul 29 13:38:56 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:38:56 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:38:56 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be
Jul 29 13:38:56 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:38:56 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:38:56 user nova-compute[231753]: FIRMWARE:
Jul 29 13:38:56 user nova-compute[231753]: No targets found.
Jul 29 13:38:56 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d90e10-3255-4bf3-b075-761928bc1885 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:38:56 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:38:56 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d90e10-3255-4bf3-b075-761928bc1885 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] No VIF found with MAC fa:16:3e:77:e8:2e, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c824f36-227d-49c4-aec0-d564f8235a0d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.039s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd96f22-6a6b-4bda-9d3e-2b78556b5ac4]: (4, ('tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)\ntcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d90e10-3255-4bf3-b075-761928bc1885 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)
Jul 29 13:38:56 user nova-compute[231753]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:38:56 user nova-compute[231753]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:38:56 user nova-compute[231753]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 (non-flash)
Jul 29 13:38:56 user nova-compute[231753]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be (non-flash)
Jul 29 13:38:56 user nova-compute[231753]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 (non-flash)
Jul 29 13:38:56 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d90e10-3255-4bf3-b075-761928bc1885 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] iscsi session list stdout=tcp: [15] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 (non-flash)
Jul 29 13:38:56 user nova-compute[231753]: tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:38:56 user nova-compute[231753]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:38:56 user nova-compute[231753]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 (non-flash)
Jul 29 13:38:56 user nova-compute[231753]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be (non-flash)
Jul 29 13:38:56 user nova-compute[231753]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 (non-flash)
Jul 29 13:38:56 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d90e10-3255-4bf3-b075-761928bc1885 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c9828c550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3'): ({'sdb'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-44d90e10-3255-4bf3-b075-761928bc1885 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Removing single pathed devices sdb {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.objects.instance [None req-037d8caf-ebff-4a2f-a7d0-32261250174f tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lazy-loading 'flavor' on Instance uuid 3fed0e1e-c8a7-43cc-bef6-14410111d3cb {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7c4abf-a679-4676-bccb-7342f82addf9]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-037d8caf-ebff-4a2f-a7d0-32261250174f tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "3fed0e1e-c8a7-43cc-bef6-14410111d3cb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.381s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "3fed0e1e-c8a7-43cc-bef6-14410111d3cb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 2.248s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Acquiring lock "3fed0e1e-c8a7-43cc-bef6-14410111d3cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "3fed0e1e-c8a7-43cc-bef6-14410111d3cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "3fed0e1e-c8a7-43cc-bef6-14410111d3cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:56 user nova-compute[231753]: INFO nova.compute.manager [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Terminating instance
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.compute.manager [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.032s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd50e968-a0b0-4b84-a137-13d52381353b]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-44d90e10-3255-4bf3-b075-761928bc1885 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Flushing IO for device /dev/sdb {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[67f54e0d-45bc-4325-993f-a3638a9708de]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-44d90e10-3255-4bf3-b075-761928bc1885 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.050s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bc62f2-0526-4f25-922b-1f2262e2c1cd]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-44d90e10-3255-4bf3-b075-761928bc1885 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-44d90e10-3255-4bf3-b075-761928bc1885 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] SCSI volumes sdb have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d90e10-3255-4bf3-b075-761928bc1885 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[973716db-7dd4-4595-a778-dc933f516164]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d90e10-3255-4bf3-b075-761928bc1885 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.069s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9d84fe9-aa27-4c9c-8bba-50a97735a0ac]: (4, ('Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3, portal: 172.16.0.220,3260]\nLogout of [sid: 15, target: iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d90e10-3255-4bf3-b075-761928bc1885 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3, portal: 172.16.0.220,3260]
Jul 29 13:38:56 user nova-compute[231753]: Logout of [sid: 15, target: iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3, portal: 172.16.0.220,3260] successful.
Jul 29 13:38:56 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0b2a5916-6c71-4b54-9944-8b2c623fcbb3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.049s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b27a91a8-b301-46df-8ef7-7cdac4e948dd]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d90e10-3255-4bf3-b075-761928bc1885 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-44d90e10-3255-4bf3-b075-761928bc1885 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.421s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-44d90e10-3255-4bf3-b075-761928bc1885 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] <== disconnect_volume: return (422ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44d90e10-3255-4bf3-b075-761928bc1885 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.network.neutron [req-d70c03b6-df88-4f8e-83b2-48e22a1753c6 req-fad2a433-fb76-4115-9a74-b14ce3f33052 service nova] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Updated VIF entry in instance network info cache for port a73b2376-652b-4f89-a463-3f854a2995ee. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.network.neutron [req-d70c03b6-df88-4f8e-83b2-48e22a1753c6 req-fad2a433-fb76-4115-9a74-b14ce3f33052 service nova] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Updating instance_info_cache with network_info: [{"id": "a73b2376-652b-4f89-a463-3f854a2995ee", "address": "fa:16:3e:77:e8:2e", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73b2376-65", "ovs_interfaceid": "a73b2376-652b-4f89-a463-3f854a2995ee", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d70c03b6-df88-4f8e-83b2-48e22a1753c6 req-fad2a433-fb76-4115-9a74-b14ce3f33052 service nova] Releasing lock "refresh_cache-481435b2-4319-4caf-aa5b-5c986a747258" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.compute.manager [req-666516b1-fe43-40af-a8b7-f3e462539f50 req-3134b5e9-d450-46a9-b4c1-fa5d512a7342 service nova] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Received event network-vif-unplugged-47c9a3cb-360f-4fd1-8233-37b32039d047 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-666516b1-fe43-40af-a8b7-f3e462539f50 req-3134b5e9-d450-46a9-b4c1-fa5d512a7342 service nova] Acquiring lock "3fed0e1e-c8a7-43cc-bef6-14410111d3cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-666516b1-fe43-40af-a8b7-f3e462539f50 req-3134b5e9-d450-46a9-b4c1-fa5d512a7342 service nova] Lock "3fed0e1e-c8a7-43cc-bef6-14410111d3cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-666516b1-fe43-40af-a8b7-f3e462539f50 req-3134b5e9-d450-46a9-b4c1-fa5d512a7342 service nova] Lock "3fed0e1e-c8a7-43cc-bef6-14410111d3cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.compute.manager [req-666516b1-fe43-40af-a8b7-f3e462539f50 req-3134b5e9-d450-46a9-b4c1-fa5d512a7342 service nova] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] No waiting events found dispatching network-vif-unplugged-47c9a3cb-360f-4fd1-8233-37b32039d047 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:38:56 user nova-compute[231753]: DEBUG nova.compute.manager [req-666516b1-fe43-40af-a8b7-f3e462539f50 req-3134b5e9-d450-46a9-b4c1-fa5d512a7342 service nova] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Received event network-vif-unplugged-47c9a3cb-360f-4fd1-8233-37b32039d047 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:38:57 user nova-compute[231753]: DEBUG nova.objects.instance [None req-44d90e10-3255-4bf3-b075-761928bc1885 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lazy-loading 'flavor' on Instance uuid 4475f276-acc4-44f1-a5fa-6a7fb2165493 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:38:57 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Instance destroyed successfully.
Jul 29 13:38:57 user nova-compute[231753]: DEBUG nova.objects.instance [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lazy-loading 'resources' on Instance uuid 3fed0e1e-c8a7-43cc-bef6-14410111d3cb {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:38:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:36:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-419127703',display_name='tempest-VolumesSnapshotTestJSON-instance-419127703',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-419127703',id=12,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLp6Tu8K5Li96rC4eNYyNiNAtpqSGs51gz7XazH8kj/NOjG3aF9D7QBdi49hAu60ul/kKxnft+Ede0aTga4NmR6aY/XLPtopmQiM5VHpn4A3rb+HLAy9/DnuD7bjGStuCw==',key_name='tempest-keypair-365750693',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:36:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cdd0f16e49ef48ff99752b6aec718358',ramdisk_id='',reservation_id='r-qei4cl08',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-563591119',owner_user_name='tempest-VolumesSnapshotTestJSON-563591119-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:36:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2c57d05306648e786200a93a121966e',uuid=3fed0e1e-c8a7-43cc-bef6-14410111d3cb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "47c9a3cb-360f-4fd1-8233-37b32039d047", "address": "fa:16:3e:3a:d8:c5", "network": {"id": "7f0a516e-a6d1-4198-b7f7-d1eef96625cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-408682612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd0f16e49ef48ff99752b6aec718358", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9a3cb-36", "ovs_interfaceid": "47c9a3cb-360f-4fd1-8233-37b32039d047", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:38:57 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Converting VIF {"id": "47c9a3cb-360f-4fd1-8233-37b32039d047", "address": "fa:16:3e:3a:d8:c5", "network": {"id": "7f0a516e-a6d1-4198-b7f7-d1eef96625cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-408682612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.98", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd0f16e49ef48ff99752b6aec718358", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap47c9a3cb-36", "ovs_interfaceid": "47c9a3cb-360f-4fd1-8233-37b32039d047", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:38:57 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:d8:c5,bridge_name='br-int',has_traffic_filtering=True,id=47c9a3cb-360f-4fd1-8233-37b32039d047,network=Network(7f0a516e-a6d1-4198-b7f7-d1eef96625cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c9a3cb-36') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:38:57 user nova-compute[231753]: DEBUG os_vif [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:d8:c5,bridge_name='br-int',has_traffic_filtering=True,id=47c9a3cb-360f-4fd1-8233-37b32039d047,network=Network(7f0a516e-a6d1-4198-b7f7-d1eef96625cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c9a3cb-36') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:38:57 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:57 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap47c9a3cb-36, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:38:57 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:38:57 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:57 user nova-compute[231753]: INFO os_vif [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:d8:c5,bridge_name='br-int',has_traffic_filtering=True,id=47c9a3cb-360f-4fd1-8233-37b32039d047,network=Network(7f0a516e-a6d1-4198-b7f7-d1eef96625cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap47c9a3cb-36')
Jul 29 13:38:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-44d90e10-3255-4bf3-b075-761928bc1885 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "4475f276-acc4-44f1-a5fa-6a7fb2165493" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.951s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:38:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'hJVTmcIG', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:38:57 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:38:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:38:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:38:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:57 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[112fb9b8-173d-4c16-b04d-b23f80cea305]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:38:57 user nova-compute[231753]: No targets found.
Jul 29 13:38:57 user nova-compute[231753]: iSNS:
Jul 29 13:38:57 user nova-compute[231753]: No targets found.
Jul 29 13:38:57 user nova-compute[231753]: STATIC:
Jul 29 13:38:57 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0
Jul 29 13:38:57 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:38:57 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:38:57 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4
Jul 29 13:38:57 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:38:57 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:38:57 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3
Jul 29 13:38:57 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:38:57 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:38:57 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7
Jul 29 13:38:57 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:38:57 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:38:57 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be
Jul 29 13:38:57 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:38:57 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:38:57 user nova-compute[231753]: FIRMWARE:
Jul 29 13:38:57 user nova-compute[231753]: No targets found.
Jul 29 13:38:57 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:38:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:38:57 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:38:57 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:38:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:6bc82b7d-5f8e-4c78-9880-c589a410d3a0', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:38:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:57 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8602923f-99ba-4d00-9de6-5eb32a4498b4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:38:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:38:57 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f85fad-5358-4526-a1bb-5eeeab98277b]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:38:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:38:57 user nova-compute[231753]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:38:57 user nova-compute[231753]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 (non-flash)
Jul 29 13:38:57 user nova-compute[231753]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be (non-flash)
Jul 29 13:38:57 user nova-compute[231753]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 (non-flash)
Jul 29 13:38:57 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:38:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:38:57 user nova-compute[231753]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:38:57 user nova-compute[231753]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 (non-flash)
Jul 29 13:38:57 user nova-compute[231753]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be (non-flash)
Jul 29 13:38:57 user nova-compute[231753]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 (non-flash)
Jul 29 13:38:57 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:38:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ca10eb7f0>, {}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:38:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Disconnecting from: [] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:38:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.080s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:38:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] <== disconnect_volume: return (81ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:38:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:38:57 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Deleting instance files /opt/stack/data/nova/instances/3fed0e1e-c8a7-43cc-bef6-14410111d3cb_del
Jul 29 13:38:57 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Deletion of /opt/stack/data/nova/instances/3fed0e1e-c8a7-43cc-bef6-14410111d3cb_del complete
Jul 29 13:38:57 user nova-compute[231753]: INFO nova.compute.manager [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Took 1.38 seconds to destroy the instance on the hypervisor.
Jul 29 13:38:57 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:38:57 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:38:57 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:38:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:58 user nova-compute[231753]: DEBUG nova.compute.manager [req-e9cc3bde-03e4-48a6-8c70-b9c75b659920 req-26f3934b-f53f-4967-8200-fbe82bfb3fd4 service nova] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Received event network-vif-plugged-a73b2376-652b-4f89-a463-3f854a2995ee {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e9cc3bde-03e4-48a6-8c70-b9c75b659920 req-26f3934b-f53f-4967-8200-fbe82bfb3fd4 service nova] Acquiring lock "481435b2-4319-4caf-aa5b-5c986a747258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e9cc3bde-03e4-48a6-8c70-b9c75b659920 req-26f3934b-f53f-4967-8200-fbe82bfb3fd4 service nova] Lock "481435b2-4319-4caf-aa5b-5c986a747258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e9cc3bde-03e4-48a6-8c70-b9c75b659920 req-26f3934b-f53f-4967-8200-fbe82bfb3fd4 service nova] Lock "481435b2-4319-4caf-aa5b-5c986a747258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:58 user nova-compute[231753]: DEBUG nova.compute.manager [req-e9cc3bde-03e4-48a6-8c70-b9c75b659920 req-26f3934b-f53f-4967-8200-fbe82bfb3fd4 service nova] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] No waiting events found dispatching network-vif-plugged-a73b2376-652b-4f89-a463-3f854a2995ee {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:38:58 user nova-compute[231753]: WARNING nova.compute.manager [req-e9cc3bde-03e4-48a6-8c70-b9c75b659920 req-26f3934b-f53f-4967-8200-fbe82bfb3fd4 service nova] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Received unexpected event network-vif-plugged-a73b2376-652b-4f89-a463-3f854a2995ee for instance with vm_state building and task_state spawning.
Jul 29 13:38:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:38:58 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:38:58 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Took 0.98 seconds to deallocate network for instance.
Jul 29 13:38:58 user nova-compute[231753]: DEBUG nova.compute.manager [req-edc696c1-4675-490b-b068-0fae9eb7172d req-6e425a30-e1c8-4b52-9bf6-725f05e348dd service nova] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Received event network-vif-deleted-47c9a3cb-360f-4fd1-8233-37b32039d047 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:58 user nova-compute[231753]: DEBUG nova.compute.manager [req-c879cb3c-596f-493f-91d1-f2af3b7d7a99 req-4b4f84f7-9b26-4fdb-8eff-3f46aa39d2f0 service nova] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Received event network-vif-plugged-47c9a3cb-360f-4fd1-8233-37b32039d047 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:38:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c879cb3c-596f-493f-91d1-f2af3b7d7a99 req-4b4f84f7-9b26-4fdb-8eff-3f46aa39d2f0 service nova] Acquiring lock "3fed0e1e-c8a7-43cc-bef6-14410111d3cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c879cb3c-596f-493f-91d1-f2af3b7d7a99 req-4b4f84f7-9b26-4fdb-8eff-3f46aa39d2f0 service nova] Lock "3fed0e1e-c8a7-43cc-bef6-14410111d3cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c879cb3c-596f-493f-91d1-f2af3b7d7a99 req-4b4f84f7-9b26-4fdb-8eff-3f46aa39d2f0 service nova] Lock "3fed0e1e-c8a7-43cc-bef6-14410111d3cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:58 user nova-compute[231753]: DEBUG nova.compute.manager [req-c879cb3c-596f-493f-91d1-f2af3b7d7a99 req-4b4f84f7-9b26-4fdb-8eff-3f46aa39d2f0 service nova] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] No waiting events found dispatching network-vif-plugged-47c9a3cb-360f-4fd1-8233-37b32039d047 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:38:58 user nova-compute[231753]: WARNING nova.compute.manager [req-c879cb3c-596f-493f-91d1-f2af3b7d7a99 req-4b4f84f7-9b26-4fdb-8eff-3f46aa39d2f0 service nova] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Received unexpected event network-vif-plugged-47c9a3cb-360f-4fd1-8233-37b32039d047 for instance with vm_state active and task_state deleting.
Jul 29 13:38:58 user nova-compute[231753]: WARNING nova.volume.cinder [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Attachment b57f066c-0b82-4b82-809d-52bd81397ae7 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = b57f066c-0b82-4b82-809d-52bd81397ae7. (HTTP 404) (Request-ID: req-850384ce-f244-4e5a-b34c-8ad2a835b76c)
Jul 29 13:38:58 user nova-compute[231753]: INFO nova.compute.manager [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Took 0.04 seconds to detach 1 volumes for instance.
Jul 29 13:38:59 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:38:59 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:38:59 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:38:59 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:38:59 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.373s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:38:59 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Deleted allocations for instance 3fed0e1e-c8a7-43cc-bef6-14410111d3cb
Jul 29 13:38:59 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e4d305ab-b0c6-424a-9f08-35d93e820bdc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "3fed0e1e-c8a7-43cc-bef6-14410111d3cb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.962s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:00 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:39:00 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Cleaning up deleted instances {{(pid=231753) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 29 13:39:00 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] There are 0 instances to clean {{(pid=231753) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 29 13:39:00 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637940.4075453, 481435b2-4319-4caf-aa5b-5c986a747258 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:39:00 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] VM Resumed (Lifecycle Event)
Jul 29 13:39:00 user nova-compute[231753]: DEBUG nova.compute.manager [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:39:00 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:39:00 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Instance spawned successfully.
Jul 29 13:39:00 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:39:00 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:39:00 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:39:00 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:39:00 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:39:00 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:39:00 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:39:00 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:39:00 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:39:00 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:39:00 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637940.4091003, 481435b2-4319-4caf-aa5b-5c986a747258 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:39:00 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] VM Started (Lifecycle Event)
Jul 29 13:39:00 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:39:00 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:39:00 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:39:00 user nova-compute[231753]: DEBUG nova.compute.manager [req-1c3dd50e-c9cc-449d-8a93-d530ee492987 req-650793f8-7caa-4865-9645-95c6af475b89 service nova] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Received event network-vif-plugged-a73b2376-652b-4f89-a463-3f854a2995ee {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:39:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-1c3dd50e-c9cc-449d-8a93-d530ee492987 req-650793f8-7caa-4865-9645-95c6af475b89 service nova] Acquiring lock "481435b2-4319-4caf-aa5b-5c986a747258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-1c3dd50e-c9cc-449d-8a93-d530ee492987 req-650793f8-7caa-4865-9645-95c6af475b89 service nova] Lock "481435b2-4319-4caf-aa5b-5c986a747258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-1c3dd50e-c9cc-449d-8a93-d530ee492987 req-650793f8-7caa-4865-9645-95c6af475b89 service nova] Lock "481435b2-4319-4caf-aa5b-5c986a747258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:00 user nova-compute[231753]: DEBUG nova.compute.manager [req-1c3dd50e-c9cc-449d-8a93-d530ee492987 req-650793f8-7caa-4865-9645-95c6af475b89 service nova] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] No waiting events found dispatching network-vif-plugged-a73b2376-652b-4f89-a463-3f854a2995ee {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:39:00 user nova-compute[231753]: WARNING nova.compute.manager [req-1c3dd50e-c9cc-449d-8a93-d530ee492987 req-650793f8-7caa-4865-9645-95c6af475b89 service nova] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Received unexpected event network-vif-plugged-a73b2376-652b-4f89-a463-3f854a2995ee for instance with vm_state building and task_state spawning.
Jul 29 13:39:00 user nova-compute[231753]: INFO nova.compute.manager [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Took 6.62 seconds to spawn the instance on the hypervisor.
Jul 29 13:39:00 user nova-compute[231753]: DEBUG nova.compute.manager [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:39:00 user nova-compute[231753]: INFO nova.compute.manager [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Took 7.46 seconds to build instance.
Jul 29 13:39:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d5cd90c4-edd1-40df-bec2-bf9ddaf00562 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "481435b2-4319-4caf-aa5b-5c986a747258" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.572s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:02 user nova-compute[231753]: DEBUG nova.network.neutron [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Port fadc1466-5336-4230-b0f1-4fe4053f216a binding to destination host user is already ACTIVE {{(pid=231753) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 29 13:39:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Acquiring lock "refresh_cache-63fad324-aac2-4d60-b4ce-a32a5736657d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:39:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Acquired lock "refresh_cache-63fad324-aac2-4d60-b4ce-a32a5736657d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:39:02 user nova-compute[231753]: DEBUG nova.network.neutron [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:39:02 user nova-compute[231753]: DEBUG nova.network.neutron [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Updating instance_info_cache with network_info: [{"id": "fadc1466-5336-4230-b0f1-4fe4053f216a", "address": "fa:16:3e:df:12:9c", "network": {"id": "8897db8c-6e92-4b9e-b7ee-a69230eb07f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1596242231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a8a3e0bcef4bbc979ef187e4ed48cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc1466-53", "ovs_interfaceid": "fadc1466-5336-4230-b0f1-4fe4053f216a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:39:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Releasing lock "refresh_cache-63fad324-aac2-4d60-b4ce-a32a5736657d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:39:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Creating tmpfile /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/tmpd8_awvh7 to verify with other compute node that the instance is on the same shared storage. {{(pid=231753) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:9622}}
Jul 29 13:39:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:02 user nova-compute[231753]: DEBUG nova.compute.manager [req-0c6251ac-817e-4865-ba52-6909a284f356 req-1df1a83f-9f73-4b00-8249-4c9845fea344 service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Received event network-vif-unplugged-fadc1466-5336-4230-b0f1-4fe4053f216a {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:39:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0c6251ac-817e-4865-ba52-6909a284f356 req-1df1a83f-9f73-4b00-8249-4c9845fea344 service nova] Acquiring lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0c6251ac-817e-4865-ba52-6909a284f356 req-1df1a83f-9f73-4b00-8249-4c9845fea344 service nova] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0c6251ac-817e-4865-ba52-6909a284f356 req-1df1a83f-9f73-4b00-8249-4c9845fea344 service nova] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:02 user nova-compute[231753]: DEBUG nova.compute.manager [req-0c6251ac-817e-4865-ba52-6909a284f356 req-1df1a83f-9f73-4b00-8249-4c9845fea344 service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] No waiting events found dispatching network-vif-unplugged-fadc1466-5336-4230-b0f1-4fe4053f216a {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:39:02 user nova-compute[231753]: WARNING nova.compute.manager [req-0c6251ac-817e-4865-ba52-6909a284f356 req-1df1a83f-9f73-4b00-8249-4c9845fea344 service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Received unexpected event network-vif-unplugged-fadc1466-5336-4230-b0f1-4fe4053f216a for instance with vm_state resized and task_state resize_reverting.
Jul 29 13:39:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:03 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Instance destroyed successfully.
Jul 29 13:39:03 user nova-compute[231753]: DEBUG nova.objects.instance [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lazy-loading 'resources' on Instance uuid 63fad324-aac2-4d60-b4ce-a32a5736657d {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:33:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-800445599',display_name='tempest-ServerActionsTestOtherB-server-800445599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-800445599',id=1,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK3mwTAZBOJzlYUFtbhzSHDzTYFwqvVO3PSQcWrwJtS4OLSJuALDnCfY5kQP9dq+tAP99lu02YS+c2OW9ZUPQROMcosGuWuOlguzRCIeVSykNGGMYttb7ShY1vz/IoqmQ==',key_name='tempest-keypair-1690887276',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:37:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74a8a3e0bcef4bbc979ef187e4ed48cc',ramdisk_id='',reservation_id='r-zypim8f0',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1624737976',owner_user_name='tempest-ServerActionsTestOtherB-1624737976-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:37:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7361505253f84cf28c8688caf4a0cd16',uuid=63fad324-aac2-4d60-b4ce-a32a5736657d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "fadc1466-5336-4230-b0f1-4fe4053f216a", "address": "fa:16:3e:df:12:9c", "network": {"id": "8897db8c-6e92-4b9e-b7ee-a69230eb07f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1596242231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a8a3e0bcef4bbc979ef187e4ed48cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc1466-53", "ovs_interfaceid": "fadc1466-5336-4230-b0f1-4fe4053f216a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Converting VIF {"id": "fadc1466-5336-4230-b0f1-4fe4053f216a", "address": "fa:16:3e:df:12:9c", "network": {"id": "8897db8c-6e92-4b9e-b7ee-a69230eb07f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1596242231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a8a3e0bcef4bbc979ef187e4ed48cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc1466-53", "ovs_interfaceid": "fadc1466-5336-4230-b0f1-4fe4053f216a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:12:9c,bridge_name='br-int',has_traffic_filtering=True,id=fadc1466-5336-4230-b0f1-4fe4053f216a,network=Network(8897db8c-6e92-4b9e-b7ee-a69230eb07f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfadc1466-53') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG os_vif [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:12:9c,bridge_name='br-int',has_traffic_filtering=True,id=fadc1466-5336-4230-b0f1-4fe4053f216a,network=Network(8897db8c-6e92-4b9e-b7ee-a69230eb07f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfadc1466-53') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfadc1466-53, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:39:03 user nova-compute[231753]: INFO os_vif [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:12:9c,bridge_name='br-int',has_traffic_filtering=True,id=fadc1466-5336-4230-b0f1-4fe4053f216a,network=Network(8897db8c-6e92-4b9e-b7ee-a69230eb07f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfadc1466-53')
Jul 29 13:39:03 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HxbMradf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:39:03 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:39:03 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[78ec7518-581a-43ed-9656-ee2780ef9ebd]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:39:03 user nova-compute[231753]: No targets found.
Jul 29 13:39:03 user nova-compute[231753]: iSNS:
Jul 29 13:39:03 user nova-compute[231753]: No targets found.
Jul 29 13:39:03 user nova-compute[231753]: STATIC:
Jul 29 13:39:03 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0
Jul 29 13:39:03 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:39:03 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:39:03 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4
Jul 29 13:39:03 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:39:03 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:39:03 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3
Jul 29 13:39:03 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:39:03 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:39:03 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7
Jul 29 13:39:03 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:39:03 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:39:03 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be
Jul 29 13:39:03 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:39:03 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:39:03 user nova-compute[231753]: FIRMWARE:
Jul 29 13:39:03 user nova-compute[231753]: No targets found.
Jul 29 13:39:03 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:39:03 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:39:03 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bd8a44b-ebd9-49e3-b15d-b436f8b3b16e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e5ccb2d-84a9-45b9-9b3a-e6b3e8186d52]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)\ntcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:39:03 user nova-compute[231753]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:39:03 user nova-compute[231753]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 (non-flash)
Jul 29 13:39:03 user nova-compute[231753]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be (non-flash)
Jul 29 13:39:03 user nova-compute[231753]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 (non-flash)
Jul 29 13:39:03 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:39:03 user nova-compute[231753]: tcp: [17] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:39:03 user nova-compute[231753]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 (non-flash)
Jul 29 13:39:03 user nova-compute[231753]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be (non-flash)
Jul 29 13:39:03 user nova-compute[231753]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 (non-flash)
Jul 29 13:39:03 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ca10e9ea0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4'): ({'sdd'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Removing single pathed devices sdd {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e805d647-2333-497b-b268-3cbe1d5dcfa4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[94d061f8-e500-4f5b-8d08-92d3e5407570]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Flushing IO for device /dev/sdd {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[236b8b4e-dd2b-47e5-b97b-a5177a11b7a9]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.039s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[638e7c8c-4336-4f1f-8a21-e18e1ccc22ea]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] SCSI volumes sdd have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.037s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff62bc45-492e-45ad-b4eb-4125df7342fe]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.077s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee449bc5-45e3-4eb3-9dc1-a21ed6b7c863]: (4, ('Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4, portal: 172.16.0.220,3260]\nLogout of [sid: 17, target: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4, portal: 172.16.0.220,3260]
Jul 29 13:39:03 user nova-compute[231753]: Logout of [sid: 17, target: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4, portal: 172.16.0.220,3260] successful.
Jul 29 13:39:03 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9215cbac-c319-4155-815d-62ebaa33176b]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] <== disconnect_volume: return (366ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:39:03 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:39:04 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:39:04 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 13:39:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:04 user nova-compute[231753]: DEBUG nova.objects.instance [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lazy-loading 'migration_context' on Instance uuid 63fad324-aac2-4d60-b4ce-a32a5736657d {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:39:05 user nova-compute[231753]: DEBUG nova.compute.manager [req-b0601201-3627-455c-a1a0-5b065348763e req-565f7341-148c-4213-a050-b4208c6324bf service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Received event network-vif-plugged-fadc1466-5336-4230-b0f1-4fe4053f216a {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:39:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b0601201-3627-455c-a1a0-5b065348763e req-565f7341-148c-4213-a050-b4208c6324bf service nova] Acquiring lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b0601201-3627-455c-a1a0-5b065348763e req-565f7341-148c-4213-a050-b4208c6324bf service nova] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b0601201-3627-455c-a1a0-5b065348763e req-565f7341-148c-4213-a050-b4208c6324bf service nova] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:05 user nova-compute[231753]: DEBUG nova.compute.manager [req-b0601201-3627-455c-a1a0-5b065348763e req-565f7341-148c-4213-a050-b4208c6324bf service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] No waiting events found dispatching network-vif-plugged-fadc1466-5336-4230-b0f1-4fe4053f216a {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:39:05 user nova-compute[231753]: WARNING nova.compute.manager [req-b0601201-3627-455c-a1a0-5b065348763e req-565f7341-148c-4213-a050-b4208c6324bf service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Received unexpected event network-vif-plugged-fadc1466-5336-4230-b0f1-4fe4053f216a for instance with vm_state resized and task_state resize_reverting.
Jul 29 13:39:05 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:39:05 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:39:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 0.463s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:05 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:39:05 user nova-compute[231753]: INFO nova.compute.manager [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Swapping old allocation on dict_keys(['222db5c7-e17f-4307-968d-4284bf5c19f4']) held by migration 9511cb2a-137a-4059-93c7-22c78e5e7652 for instance
Jul 29 13:39:05 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Overwriting current allocation {'allocations': {'222db5c7-e17f-4307-968d-4284bf5c19f4': {'resources': {'VCPU': 1, 'MEMORY_MB': 2048, 'DISK_GB': 20}, 'generation': 24}}, 'project_id': '74a8a3e0bcef4bbc979ef187e4ed48cc', 'user_id': '7361505253f84cf28c8688caf4a0cd16', 'consumer_generation': 1} on consumer 63fad324-aac2-4d60-b4ce-a32a5736657d {{(pid=231753) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2018}}
Jul 29 13:39:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Acquiring lock "refresh_cache-63fad324-aac2-4d60-b4ce-a32a5736657d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:39:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Acquired lock "refresh_cache-63fad324-aac2-4d60-b4ce-a32a5736657d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:39:05 user nova-compute[231753]: DEBUG nova.network.neutron [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:39:06 user nova-compute[231753]: DEBUG nova.network.neutron [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Updating instance_info_cache with network_info: [{"id": "fadc1466-5336-4230-b0f1-4fe4053f216a", "address": "fa:16:3e:df:12:9c", "network": {"id": "8897db8c-6e92-4b9e-b7ee-a69230eb07f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1596242231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a8a3e0bcef4bbc979ef187e4ed48cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc1466-53", "ovs_interfaceid": "fadc1466-5336-4230-b0f1-4fe4053f216a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:39:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Releasing lock "refresh_cache-63fad324-aac2-4d60-b4ce-a32a5736657d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:39:06 user nova-compute[231753]: DEBUG os_brick.utils [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:39:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f51b8c-1860-4400-b883-951dc7830654]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.015s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c43813-6ab0-4810-90e7-62c343309e33]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[44078f1d-a194-4d58-b004-816e57d27209]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b9336b9-0b0e-46cf-9f9c-a91ab3c0e526]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:39:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:39:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:39:06 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:39:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f1666e-56a6-4d2d-9d8c-02a3e6dad461]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:39:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:39:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:39:06 user nova-compute[231753]: DEBUG os_brick.utils [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:39:06 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:39:06 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:39:07 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:39:07 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:39:07 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:39:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:07 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 13:39:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:07 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:39:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:08 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:39:08 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:39:08 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:39:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:08 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:08 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json" returned: 0 in 0.136s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:10 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:39:10 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:39:10 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=7041MB free_disk=25.441020965576172GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 13:39:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:11 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:39:11 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b67b98f8-a7b3-499e-ba32-9520bbced960 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:39:11 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 299b7f21-b198-437b-9d5c-1269d5e9b7c8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:39:11 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 7e2615c1-b03e-4076-bcd9-3585fb11b8ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:39:11 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8ea52d41-7ec3-44d7-8421-133000ee887b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:39:11 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 4475f276-acc4-44f1-a5fa-6a7fb2165493 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:39:11 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 63fad324-aac2-4d60-b4ce-a32a5736657d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:39:11 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 894f5e40-e585-41c0-9dd8-e94d8a9400ef actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:39:11 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance cf326e80-7293-4764-9411-ed05a5aeba23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:39:11 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 55bfcd1f-2b51-4e10-84a3-e132b96111e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:39:11 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 481435b2-4319-4caf-aa5b-5c986a747258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:39:11 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 13:39:11 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 13:39:11 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Refreshing inventories for resource provider 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 29 13:39:11 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Updating ProviderTree inventory for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 29 13:39:11 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Updating inventory in ProviderTree for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 29 13:39:11 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Refreshing aggregate associations for resource provider 222db5c7-e17f-4307-968d-4284bf5c19f4, aggregates: None {{(pid=231753) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 29 13:39:11 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Refreshing trait associations for resource provider 222db5c7-e17f-4307-968d-4284bf5c19f4, traits: HW_CPU_X86_SSSE3,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_VIRTIO {{(pid=231753) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 29 13:39:11 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:39:11 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:39:11 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 13:39:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.850s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:11 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:39:11 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Cleaning up deleted instances with incomplete migration  {{(pid=231753) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 29 13:39:12 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690637937.717426, 3fed0e1e-c8a7-43cc-bef6-14410111d3cb => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:39:12 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] VM Stopped (Lifecycle Event)
Jul 29 13:39:12 user nova-compute[231753]: DEBUG nova.compute.manager [None req-940695b0-ee8a-4d33-8d79-7d5c73d0d534 None None] [instance: 3fed0e1e-c8a7-43cc-bef6-14410111d3cb] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:39:12 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:39:12 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:39:12 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 13:39:12 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Didn't find any instances for network info cache update. {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 29 13:39:12 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:39:12 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:39:13 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:13 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:13 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Starting finish_revert_migration {{(pid=231753) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11819}}
Jul 29 13:39:13 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Start _get_guest_xml network_info=[{"id": "fadc1466-5336-4230-b0f1-4fe4053f216a", "address": "fa:16:3e:df:12:9c", "network": {"id": "8897db8c-6e92-4b9e-b7ee-a69230eb07f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1596242231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a8a3e0bcef4bbc979ef187e4ed48cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc1466-53", "ovs_interfaceid": "fadc1466-5336-4230-b0f1-4fe4053f216a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HxbMradf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': '63fad324-aac2-4d60-b4ce-a32a5736657d', 'attached_at': '2023-07-29T13:39:14.000000', 'detached_at': '', 'volume_id': 'a62778d4-32b0-41ef-b7df-716d38fbcba4', 'serial': 'a62778d4-32b0-41ef-b7df-716d38fbcba4'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '78e3994b-32a7-4ade-aaf9-5716bfbf6f74', 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:39:13 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:39:13 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:39:13 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:39:13 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:39:13 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:39:13 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:39:13 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:39:13 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:39:13 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:39:13 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:39:13 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:39:13 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:39:13 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:39:13 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:39:13 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:39:13 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:39:13 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:39:13 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:39:13 user nova-compute[231753]: DEBUG nova.objects.instance [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lazy-loading 'vcpu_model' on Instance uuid 63fad324-aac2-4d60-b4ce-a32a5736657d {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:39:13 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:39:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HxbMradf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:39:13 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:39:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:39:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:39:13 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:39:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:39:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:39:13 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:39:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d0e390f-1b2d-4a43-9c6d-e61dc48690e1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:39:14 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[55645fc0-73a1-4273-8c79-3a7262561a3d]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4] added
Jul 29 13:39:14 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f79c1a9-3c59-47c5-9c4e-ad96e076e2ba]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[45969cc0-a95c-4d41-b301-60dab230e81e]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HxbMradf {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v HxbMradf" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae61cbf-e646-452a-8468-3ef3df7af430]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'HxbMradf'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2b6e500-8af4-4101-bd3e-688d6e6fca90]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d125367-9858-4cdd-8e3b-49064ec0372c]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:39:14 user nova-compute[231753]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 (non-flash)
Jul 29 13:39:14 user nova-compute[231753]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be (non-flash)
Jul 29 13:39:14 user nova-compute[231753]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 (non-flash)
Jul 29 13:39:14 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:39:14 user nova-compute[231753]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 (non-flash)
Jul 29 13:39:14 user nova-compute[231753]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be (non-flash)
Jul 29 13:39:14 user nova-compute[231753]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 (non-flash)
Jul 29 13:39:14 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[729cf0c9-3adb-4610-83e3-94a967af07b1]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4, portal: 172.16.0.220,3260]
Jul 29 13:39:14 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4, portal: 172.16.0.220,3260] successful.
Jul 29 13:39:14 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd836f65-7ba0-4cf0-a9c8-626275d70864]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[01eb1c49-727b-426b-b497-3bc4d29fdcd2]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:39:14 user nova-compute[231753]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 (non-flash)
Jul 29 13:39:14 user nova-compute[231753]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be (non-flash)
Jul 29 13:39:14 user nova-compute[231753]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 (non-flash)
Jul 29 13:39:14 user nova-compute[231753]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:39:14 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:39:14 user nova-compute[231753]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 (non-flash)
Jul 29 13:39:14 user nova-compute[231753]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be (non-flash)
Jul 29 13:39:14 user nova-compute[231753]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 (non-flash)
Jul 29 13:39:14 user nova-compute[231753]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:39:14 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.291s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] HCTL ('33', '-', '-', 0) found on session 22 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8729057-da19-4af4-ab84-a555e9a480c1]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Searching for a device in session 22 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:39:14 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HxbMradf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:39:15 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.330s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:39:15 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] <== connect_volume: return (1331ms) {'type': 'block', 'scsi_wwn': '23430363036643831', 'path': '/dev/sdb'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:39:15 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23430363036643831', 'path': '/dev/sdb'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:39:15 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:33:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-800445599',display_name='tempest-ServerActionsTestOtherB-server-800445599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-800445599',id=1,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK3mwTAZBOJzlYUFtbhzSHDzTYFwqvVO3PSQcWrwJtS4OLSJuALDnCfY5kQP9dq+tAP99lu02YS+c2OW9ZUPQROMcosGuWuOlguzRCIeVSykNGGMYttb7ShY1vz/IoqmQ==',key_name='tempest-keypair-1690887276',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:37:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='74a8a3e0bcef4bbc979ef187e4ed48cc',ramdisk_id='',reservation_id='r-zypim8f0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1624737976',owner_user_name='tempest-ServerActionsTestOtherB-1624737976-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:39:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7361505253f84cf28c8688caf4a0cd16',uuid=63fad324-aac2-4d60-b4ce-a32a5736657d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "fadc1466-5336-4230-b0f1-4fe4053f216a", "address": "fa:16:3e:df:12:9c", "network": {"id": "8897db8c-6e92-4b9e-b7ee-a69230eb07f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1596242231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a8a3e0bcef4bbc979ef187e4ed48cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc1466-53", "ovs_interfaceid": "fadc1466-5336-4230-b0f1-4fe4053f216a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:39:15 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Converting VIF {"id": "fadc1466-5336-4230-b0f1-4fe4053f216a", "address": "fa:16:3e:df:12:9c", "network": {"id": "8897db8c-6e92-4b9e-b7ee-a69230eb07f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1596242231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a8a3e0bcef4bbc979ef187e4ed48cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc1466-53", "ovs_interfaceid": "fadc1466-5336-4230-b0f1-4fe4053f216a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:39:15 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:12:9c,bridge_name='br-int',has_traffic_filtering=True,id=fadc1466-5336-4230-b0f1-4fe4053f216a,network=Network(8897db8c-6e92-4b9e-b7ee-a69230eb07f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfadc1466-53') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:39:15 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:39:15 user nova-compute[231753]:   <uuid>63fad324-aac2-4d60-b4ce-a32a5736657d</uuid>
Jul 29 13:39:15 user nova-compute[231753]:   <name>instance-00000001</name>
Jul 29 13:39:15 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:39:15 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:39:15 user nova-compute[231753]:   <metadata>
Jul 29 13:39:15 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:39:15 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:39:15 user nova-compute[231753]:       <nova:name>tempest-ServerActionsTestOtherB-server-800445599</nova:name>
Jul 29 13:39:15 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:39:13</nova:creationTime>
Jul 29 13:39:15 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:39:15 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:39:15 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:39:15 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:39:15 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:39:15 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:39:15 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:39:15 user nova-compute[231753]:       <nova:owner>
Jul 29 13:39:15 user nova-compute[231753]:         <nova:user uuid="7361505253f84cf28c8688caf4a0cd16">tempest-ServerActionsTestOtherB-1624737976-project-member</nova:user>
Jul 29 13:39:15 user nova-compute[231753]:         <nova:project uuid="74a8a3e0bcef4bbc979ef187e4ed48cc">tempest-ServerActionsTestOtherB-1624737976</nova:project>
Jul 29 13:39:15 user nova-compute[231753]:       </nova:owner>
Jul 29 13:39:15 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:39:15 user nova-compute[231753]:       <nova:ports>
Jul 29 13:39:15 user nova-compute[231753]:         <nova:port uuid="fadc1466-5336-4230-b0f1-4fe4053f216a">
Jul 29 13:39:15 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 29 13:39:15 user nova-compute[231753]:         </nova:port>
Jul 29 13:39:15 user nova-compute[231753]:       </nova:ports>
Jul 29 13:39:15 user nova-compute[231753]:     </nova:instance>
Jul 29 13:39:15 user nova-compute[231753]:   </metadata>
Jul 29 13:39:15 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:39:15 user nova-compute[231753]:     <system>
Jul 29 13:39:15 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:39:15 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:39:15 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:39:15 user nova-compute[231753]:       <entry name="serial">63fad324-aac2-4d60-b4ce-a32a5736657d</entry>
Jul 29 13:39:15 user nova-compute[231753]:       <entry name="uuid">63fad324-aac2-4d60-b4ce-a32a5736657d</entry>
Jul 29 13:39:15 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:39:15 user nova-compute[231753]:     </system>
Jul 29 13:39:15 user nova-compute[231753]:   </sysinfo>
Jul 29 13:39:15 user nova-compute[231753]:   <os>
Jul 29 13:39:15 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:39:15 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:39:15 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:39:15 user nova-compute[231753]:   </os>
Jul 29 13:39:15 user nova-compute[231753]:   <features>
Jul 29 13:39:15 user nova-compute[231753]:     <acpi/>
Jul 29 13:39:15 user nova-compute[231753]:     <apic/>
Jul 29 13:39:15 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:39:15 user nova-compute[231753]:   </features>
Jul 29 13:39:15 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:39:15 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:39:15 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:39:15 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:39:15 user nova-compute[231753]:   </clock>
Jul 29 13:39:15 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:39:15 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:39:15 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:39:15 user nova-compute[231753]:   </cpu>
Jul 29 13:39:15 user nova-compute[231753]:   <devices>
Jul 29 13:39:15 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:39:15 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:39:15 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk"/>
Jul 29 13:39:15 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:39:15 user nova-compute[231753]:     </disk>
Jul 29 13:39:15 user nova-compute[231753]:     <disk type="block" device="disk">
Jul 29 13:39:15 user nova-compute[231753]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:39:15 user nova-compute[231753]:       <source dev="/dev/sdb"/>
Jul 29 13:39:15 user nova-compute[231753]:       <target dev="vdb" bus="virtio"/>
Jul 29 13:39:15 user nova-compute[231753]:       <serial>a62778d4-32b0-41ef-b7df-716d38fbcba4</serial>
Jul 29 13:39:15 user nova-compute[231753]:     </disk>
Jul 29 13:39:15 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:39:15 user nova-compute[231753]:       <mac address="fa:16:3e:df:12:9c"/>
Jul 29 13:39:15 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:39:15 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:39:15 user nova-compute[231753]:       <target dev="tapfadc1466-53"/>
Jul 29 13:39:15 user nova-compute[231753]:     </interface>
Jul 29 13:39:15 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:39:15 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/console.log" append="off"/>
Jul 29 13:39:15 user nova-compute[231753]:     </serial>
Jul 29 13:39:15 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:39:15 user nova-compute[231753]:     <video>
Jul 29 13:39:15 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:39:15 user nova-compute[231753]:     </video>
Jul 29 13:39:15 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:39:15 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:39:15 user nova-compute[231753]:     </rng>
Jul 29 13:39:15 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:39:15 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:39:15 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:39:15 user nova-compute[231753]:     </memballoon>
Jul 29 13:39:15 user nova-compute[231753]:   </devices>
Jul 29 13:39:15 user nova-compute[231753]: </domain>
Jul 29 13:39:15 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:39:15 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:33:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-800445599',display_name='tempest-ServerActionsTestOtherB-server-800445599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-800445599',id=1,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK3mwTAZBOJzlYUFtbhzSHDzTYFwqvVO3PSQcWrwJtS4OLSJuALDnCfY5kQP9dq+tAP99lu02YS+c2OW9ZUPQROMcosGuWuOlguzRCIeVSykNGGMYttb7ShY1vz/IoqmQ==',key_name='tempest-keypair-1690887276',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:37:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='74a8a3e0bcef4bbc979ef187e4ed48cc',ramdisk_id='',reservation_id='r-zypim8f0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-1624737976',owner_user_name='tempest-ServerActionsTestOtherB-1624737976-project-member'},tags=<?>,task_state='resize_reverting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:39:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7361505253f84cf28c8688caf4a0cd16',uuid=63fad324-aac2-4d60-b4ce-a32a5736657d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "fadc1466-5336-4230-b0f1-4fe4053f216a", "address": "fa:16:3e:df:12:9c", "network": {"id": "8897db8c-6e92-4b9e-b7ee-a69230eb07f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1596242231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a8a3e0bcef4bbc979ef187e4ed48cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc1466-53", "ovs_interfaceid": "fadc1466-5336-4230-b0f1-4fe4053f216a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:39:15 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Converting VIF {"id": "fadc1466-5336-4230-b0f1-4fe4053f216a", "address": "fa:16:3e:df:12:9c", "network": {"id": "8897db8c-6e92-4b9e-b7ee-a69230eb07f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1596242231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a8a3e0bcef4bbc979ef187e4ed48cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc1466-53", "ovs_interfaceid": "fadc1466-5336-4230-b0f1-4fe4053f216a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:39:15 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:df:12:9c,bridge_name='br-int',has_traffic_filtering=True,id=fadc1466-5336-4230-b0f1-4fe4053f216a,network=Network(8897db8c-6e92-4b9e-b7ee-a69230eb07f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfadc1466-53') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:39:15 user nova-compute[231753]: DEBUG os_vif [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:12:9c,bridge_name='br-int',has_traffic_filtering=True,id=fadc1466-5336-4230-b0f1-4fe4053f216a,network=Network(8897db8c-6e92-4b9e-b7ee-a69230eb07f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfadc1466-53') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:39:15 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:15 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:39:15 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:39:15 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:15 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfadc1466-53, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:39:15 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfadc1466-53, col_values=(('external_ids', {'iface-id': 'fadc1466-5336-4230-b0f1-4fe4053f216a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:df:12:9c', 'vm-uuid': '63fad324-aac2-4d60-b4ce-a32a5736657d'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:39:15 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:15 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:39:15 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:15 user nova-compute[231753]: INFO os_vif [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:df:12:9c,bridge_name='br-int',has_traffic_filtering=True,id=fadc1466-5336-4230-b0f1-4fe4053f216a,network=Network(8897db8c-6e92-4b9e-b7ee-a69230eb07f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfadc1466-53')
Jul 29 13:39:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:16 user nova-compute[231753]: DEBUG nova.compute.manager [req-bf77f066-c3c0-41d1-aedf-bae18ba648e1 req-47dcc11d-0f37-4c31-97fb-7296fd65dcb6 service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Received event network-vif-plugged-fadc1466-5336-4230-b0f1-4fe4053f216a {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:39:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bf77f066-c3c0-41d1-aedf-bae18ba648e1 req-47dcc11d-0f37-4c31-97fb-7296fd65dcb6 service nova] Acquiring lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bf77f066-c3c0-41d1-aedf-bae18ba648e1 req-47dcc11d-0f37-4c31-97fb-7296fd65dcb6 service nova] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bf77f066-c3c0-41d1-aedf-bae18ba648e1 req-47dcc11d-0f37-4c31-97fb-7296fd65dcb6 service nova] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:16 user nova-compute[231753]: DEBUG nova.compute.manager [req-bf77f066-c3c0-41d1-aedf-bae18ba648e1 req-47dcc11d-0f37-4c31-97fb-7296fd65dcb6 service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] No waiting events found dispatching network-vif-plugged-fadc1466-5336-4230-b0f1-4fe4053f216a {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:39:16 user nova-compute[231753]: WARNING nova.compute.manager [req-bf77f066-c3c0-41d1-aedf-bae18ba648e1 req-47dcc11d-0f37-4c31-97fb-7296fd65dcb6 service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Received unexpected event network-vif-plugged-fadc1466-5336-4230-b0f1-4fe4053f216a for instance with vm_state resized and task_state resize_reverting.
Jul 29 13:39:17 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:17 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:17 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:18 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690637943.3411129, 63fad324-aac2-4d60-b4ce-a32a5736657d => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:39:18 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] VM Stopped (Lifecycle Event)
Jul 29 13:39:18 user nova-compute[231753]: DEBUG nova.compute.manager [None req-c921ab1a-c970-4740-8de8-0bb299176118 None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:39:18 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637958.8378675, 63fad324-aac2-4d60-b4ce-a32a5736657d => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:39:18 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] VM Resumed (Lifecycle Event)
Jul 29 13:39:18 user nova-compute[231753]: DEBUG nova.compute.manager [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:39:18 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Instance running successfully.
Jul 29 13:39:18 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] finish_revert_migration finished successfully. {{(pid=231753) finish_revert_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11863}}
Jul 29 13:39:18 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:39:18 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:39:18 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 29 13:39:18 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690637958.8423223, 63fad324-aac2-4d60-b4ce-a32a5736657d => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:39:18 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] VM Started (Lifecycle Event)
Jul 29 13:39:18 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:39:18 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: resize_reverting, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:39:18 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] During sync_power_state the instance has a pending task (resize_reverting). Skip.
Jul 29 13:39:19 user nova-compute[231753]: INFO nova.compute.manager [None req-5f165ad2-5249-4e10-9ab8-ff6b40ff3247 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Updating instance to original state: 'active'
Jul 29 13:39:19 user nova-compute[231753]: DEBUG nova.compute.manager [req-0de2f215-364c-445e-a7da-bb1db9141378 req-0d8f33fc-2eb7-480e-ae6d-d2def202866e service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Received event network-vif-plugged-fadc1466-5336-4230-b0f1-4fe4053f216a {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:39:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0de2f215-364c-445e-a7da-bb1db9141378 req-0d8f33fc-2eb7-480e-ae6d-d2def202866e service nova] Acquiring lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0de2f215-364c-445e-a7da-bb1db9141378 req-0d8f33fc-2eb7-480e-ae6d-d2def202866e service nova] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0de2f215-364c-445e-a7da-bb1db9141378 req-0d8f33fc-2eb7-480e-ae6d-d2def202866e service nova] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:19 user nova-compute[231753]: DEBUG nova.compute.manager [req-0de2f215-364c-445e-a7da-bb1db9141378 req-0d8f33fc-2eb7-480e-ae6d-d2def202866e service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] No waiting events found dispatching network-vif-plugged-fadc1466-5336-4230-b0f1-4fe4053f216a {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:39:19 user nova-compute[231753]: WARNING nova.compute.manager [req-0de2f215-364c-445e-a7da-bb1db9141378 req-0d8f33fc-2eb7-480e-ae6d-d2def202866e service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Received unexpected event network-vif-plugged-fadc1466-5336-4230-b0f1-4fe4053f216a for instance with vm_state resized and task_state resize_reverting.
Jul 29 13:39:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._sync_power_states {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Triggering sync for uuid 63fad324-aac2-4d60-b4ce-a32a5736657d {{(pid=231753) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Triggering sync for uuid b67b98f8-a7b3-499e-ba32-9520bbced960 {{(pid=231753) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Triggering sync for uuid 299b7f21-b198-437b-9d5c-1269d5e9b7c8 {{(pid=231753) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Triggering sync for uuid 7e2615c1-b03e-4076-bcd9-3585fb11b8ac {{(pid=231753) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Triggering sync for uuid 8ea52d41-7ec3-44d7-8421-133000ee887b {{(pid=231753) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Triggering sync for uuid 894f5e40-e585-41c0-9dd8-e94d8a9400ef {{(pid=231753) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Triggering sync for uuid cf326e80-7293-4764-9411-ed05a5aeba23 {{(pid=231753) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Triggering sync for uuid 55bfcd1f-2b51-4e10-84a3-e132b96111e3 {{(pid=231753) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Triggering sync for uuid 481435b2-4319-4caf-aa5b-5c986a747258 {{(pid=231753) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Triggering sync for uuid 4475f276-acc4-44f1-a5fa-6a7fb2165493 {{(pid=231753) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Triggering sync for uuid 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb {{(pid=231753) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "63fad324-aac2-4d60-b4ce-a32a5736657d" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "b67b98f8-a7b3-499e-ba32-9520bbced960" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "b67b98f8-a7b3-499e-ba32-9520bbced960" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "299b7f21-b198-437b-9d5c-1269d5e9b7c8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "299b7f21-b198-437b-9d5c-1269d5e9b7c8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "8ea52d41-7ec3-44d7-8421-133000ee887b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "8ea52d41-7ec3-44d7-8421-133000ee887b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "cf326e80-7293-4764-9411-ed05a5aeba23" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "cf326e80-7293-4764-9411-ed05a5aeba23" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "481435b2-4319-4caf-aa5b-5c986a747258" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "481435b2-4319-4caf-aa5b-5c986a747258" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "4475f276-acc4-44f1-a5fa-6a7fb2165493" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "4475f276-acc4-44f1-a5fa-6a7fb2165493" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:24 user nova-compute[231753]: WARNING oslo_messaging._drivers.amqpdriver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Number of call queues is 11, greater than warning threshold: 10. There could be a leak. Increasing threshold to: 20
Jul 29 13:39:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "b67b98f8-a7b3-499e-ba32-9520bbced960" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.101s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "8ea52d41-7ec3-44d7-8421-133000ee887b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.111s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.127s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.134s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "299b7f21-b198-437b-9d5c-1269d5e9b7c8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.132s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.135s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "4475f276-acc4-44f1-a5fa-6a7fb2165493" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.133s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.139s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "cf326e80-7293-4764-9411-ed05a5aeba23" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.149s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "481435b2-4319-4caf-aa5b-5c986a747258" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.151s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.156s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-60c92832-afbe-4e90-a5d1-7ab047587310 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Acquiring lock "299b7f21-b198-437b-9d5c-1269d5e9b7c8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-60c92832-afbe-4e90-a5d1-7ab047587310 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "299b7f21-b198-437b-9d5c-1269d5e9b7c8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-60c92832-afbe-4e90-a5d1-7ab047587310 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Acquiring lock "299b7f21-b198-437b-9d5c-1269d5e9b7c8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-60c92832-afbe-4e90-a5d1-7ab047587310 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "299b7f21-b198-437b-9d5c-1269d5e9b7c8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-60c92832-afbe-4e90-a5d1-7ab047587310 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "299b7f21-b198-437b-9d5c-1269d5e9b7c8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:28 user nova-compute[231753]: INFO nova.compute.manager [None req-60c92832-afbe-4e90-a5d1-7ab047587310 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Terminating instance
Jul 29 13:39:28 user nova-compute[231753]: DEBUG nova.compute.manager [None req-60c92832-afbe-4e90-a5d1-7ab047587310 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:39:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:29 user nova-compute[231753]: DEBUG nova.compute.manager [req-beb7e143-978c-4b38-8718-a844cf1d5ac3 req-6b889b65-eae7-4e78-a073-22cad40c18ea service nova] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Received event network-vif-unplugged-b66269be-ef4d-460f-9782-df3fc08e5450 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:39:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-beb7e143-978c-4b38-8718-a844cf1d5ac3 req-6b889b65-eae7-4e78-a073-22cad40c18ea service nova] Acquiring lock "299b7f21-b198-437b-9d5c-1269d5e9b7c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-beb7e143-978c-4b38-8718-a844cf1d5ac3 req-6b889b65-eae7-4e78-a073-22cad40c18ea service nova] Lock "299b7f21-b198-437b-9d5c-1269d5e9b7c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-beb7e143-978c-4b38-8718-a844cf1d5ac3 req-6b889b65-eae7-4e78-a073-22cad40c18ea service nova] Lock "299b7f21-b198-437b-9d5c-1269d5e9b7c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:29 user nova-compute[231753]: DEBUG nova.compute.manager [req-beb7e143-978c-4b38-8718-a844cf1d5ac3 req-6b889b65-eae7-4e78-a073-22cad40c18ea service nova] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] No waiting events found dispatching network-vif-unplugged-b66269be-ef4d-460f-9782-df3fc08e5450 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:39:29 user nova-compute[231753]: DEBUG nova.compute.manager [req-beb7e143-978c-4b38-8718-a844cf1d5ac3 req-6b889b65-eae7-4e78-a073-22cad40c18ea service nova] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Received event network-vif-unplugged-b66269be-ef4d-460f-9782-df3fc08e5450 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:39:29 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Instance destroyed successfully.
Jul 29 13:39:29 user nova-compute[231753]: DEBUG nova.objects.instance [None req-60c92832-afbe-4e90-a5d1-7ab047587310 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lazy-loading 'resources' on Instance uuid 299b7f21-b198-437b-9d5c-1269d5e9b7c8 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:39:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-60c92832-afbe-4e90-a5d1-7ab047587310 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:33:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-2102921189',display_name='tempest-VolumesAdminNegativeTest-server-2102921189',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesadminnegativetest-server-2102921189',id=6,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBH2ROmBb681QKMjCKDdNYqVMwfdet8CVBJR4XP62RNY3AHbUmI/X3FEyWNcStt+ESjLuIiWh2ONQ7LTXzqvDt6fGK7d9i5UUC2FOc/pd5EMU7UHEwPPGKPy9909RHPO26Q==',key_name='tempest-keypair-880643537',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:33:45Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='44867a8743214d32a94bca3506295e92',ramdisk_id='',reservation_id='r-280fs2c9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-193285786',owner_user_name='tempest-VolumesAdminNegativeTest-193285786-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:33:45Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='82c6eeb939f94fa5953a349127247021',uuid=299b7f21-b198-437b-9d5c-1269d5e9b7c8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b66269be-ef4d-460f-9782-df3fc08e5450", "address": "fa:16:3e:1f:36:42", "network": {"id": "2e7ef980-929c-4ea5-86b7-d69bcfa4a209", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1403711156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44867a8743214d32a94bca3506295e92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb66269be-ef", "ovs_interfaceid": "b66269be-ef4d-460f-9782-df3fc08e5450", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:39:29 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-60c92832-afbe-4e90-a5d1-7ab047587310 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Converting VIF {"id": "b66269be-ef4d-460f-9782-df3fc08e5450", "address": "fa:16:3e:1f:36:42", "network": {"id": "2e7ef980-929c-4ea5-86b7-d69bcfa4a209", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-1403711156-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.205", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "44867a8743214d32a94bca3506295e92", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb66269be-ef", "ovs_interfaceid": "b66269be-ef4d-460f-9782-df3fc08e5450", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:39:29 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-60c92832-afbe-4e90-a5d1-7ab047587310 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1f:36:42,bridge_name='br-int',has_traffic_filtering=True,id=b66269be-ef4d-460f-9782-df3fc08e5450,network=Network(2e7ef980-929c-4ea5-86b7-d69bcfa4a209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb66269be-ef') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:39:29 user nova-compute[231753]: DEBUG os_vif [None req-60c92832-afbe-4e90-a5d1-7ab047587310 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:36:42,bridge_name='br-int',has_traffic_filtering=True,id=b66269be-ef4d-460f-9782-df3fc08e5450,network=Network(2e7ef980-929c-4ea5-86b7-d69bcfa4a209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb66269be-ef') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:39:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb66269be-ef, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:39:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:39:29 user nova-compute[231753]: INFO os_vif [None req-60c92832-afbe-4e90-a5d1-7ab047587310 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:1f:36:42,bridge_name='br-int',has_traffic_filtering=True,id=b66269be-ef4d-460f-9782-df3fc08e5450,network=Network(2e7ef980-929c-4ea5-86b7-d69bcfa4a209),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb66269be-ef')
Jul 29 13:39:29 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-60c92832-afbe-4e90-a5d1-7ab047587310 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Deleting instance files /opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8_del
Jul 29 13:39:29 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-60c92832-afbe-4e90-a5d1-7ab047587310 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Deletion of /opt/stack/data/nova/instances/299b7f21-b198-437b-9d5c-1269d5e9b7c8_del complete
Jul 29 13:39:29 user nova-compute[231753]: INFO nova.compute.manager [None req-60c92832-afbe-4e90-a5d1-7ab047587310 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Took 0.86 seconds to destroy the instance on the hypervisor.
Jul 29 13:39:29 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-60c92832-afbe-4e90-a5d1-7ab047587310 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:39:29 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:39:29 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:39:30 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:39:30 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Took 1.03 seconds to deallocate network for instance.
Jul 29 13:39:30 user nova-compute[231753]: DEBUG nova.compute.manager [req-e52ecfe2-fb10-4f3d-928d-9f2f1c89a206 req-4e61afd5-4c53-4248-8c5a-77f1a0b0bd29 service nova] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Received event network-vif-deleted-b66269be-ef4d-460f-9782-df3fc08e5450 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:39:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-60c92832-afbe-4e90-a5d1-7ab047587310 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-60c92832-afbe-4e90-a5d1-7ab047587310 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:31 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-60c92832-afbe-4e90-a5d1-7ab047587310 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:39:31 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-60c92832-afbe-4e90-a5d1-7ab047587310 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:39:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-60c92832-afbe-4e90-a5d1-7ab047587310 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.386s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:31 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-60c92832-afbe-4e90-a5d1-7ab047587310 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Deleted allocations for instance 299b7f21-b198-437b-9d5c-1269d5e9b7c8
Jul 29 13:39:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-60c92832-afbe-4e90-a5d1-7ab047587310 tempest-VolumesAdminNegativeTest-193285786 tempest-VolumesAdminNegativeTest-193285786-project-member] Lock "299b7f21-b198-437b-9d5c-1269d5e9b7c8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.493s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:31 user nova-compute[231753]: DEBUG nova.compute.manager [req-88f29021-c00e-4c4d-91d8-df9a0086e3ef req-aa9bd025-7d3f-43c3-8041-1fdfcc818b55 service nova] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Received event network-vif-plugged-b66269be-ef4d-460f-9782-df3fc08e5450 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:39:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-88f29021-c00e-4c4d-91d8-df9a0086e3ef req-aa9bd025-7d3f-43c3-8041-1fdfcc818b55 service nova] Acquiring lock "299b7f21-b198-437b-9d5c-1269d5e9b7c8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-88f29021-c00e-4c4d-91d8-df9a0086e3ef req-aa9bd025-7d3f-43c3-8041-1fdfcc818b55 service nova] Lock "299b7f21-b198-437b-9d5c-1269d5e9b7c8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-88f29021-c00e-4c4d-91d8-df9a0086e3ef req-aa9bd025-7d3f-43c3-8041-1fdfcc818b55 service nova] Lock "299b7f21-b198-437b-9d5c-1269d5e9b7c8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:31 user nova-compute[231753]: DEBUG nova.compute.manager [req-88f29021-c00e-4c4d-91d8-df9a0086e3ef req-aa9bd025-7d3f-43c3-8041-1fdfcc818b55 service nova] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] No waiting events found dispatching network-vif-plugged-b66269be-ef4d-460f-9782-df3fc08e5450 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:39:31 user nova-compute[231753]: WARNING nova.compute.manager [req-88f29021-c00e-4c4d-91d8-df9a0086e3ef req-aa9bd025-7d3f-43c3-8041-1fdfcc818b55 service nova] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Received unexpected event network-vif-plugged-b66269be-ef4d-460f-9782-df3fc08e5450 for instance with vm_state deleted and task_state None.
Jul 29 13:39:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:44 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690637969.6318538, 299b7f21-b198-437b-9d5c-1269d5e9b7c8 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:39:44 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] VM Stopped (Lifecycle Event)
Jul 29 13:39:44 user nova-compute[231753]: DEBUG nova.compute.manager [None req-aaf09158-36b8-46bb-ae36-85de75635dff None None] [instance: 299b7f21-b198-437b-9d5c-1269d5e9b7c8] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:39:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7839aa14-08a4-4a85-8425-7b070fce152b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "4475f276-acc4-44f1-a5fa-6a7fb2165493" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7839aa14-08a4-4a85-8425-7b070fce152b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "4475f276-acc4-44f1-a5fa-6a7fb2165493" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7839aa14-08a4-4a85-8425-7b070fce152b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "4475f276-acc4-44f1-a5fa-6a7fb2165493-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7839aa14-08a4-4a85-8425-7b070fce152b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "4475f276-acc4-44f1-a5fa-6a7fb2165493-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7839aa14-08a4-4a85-8425-7b070fce152b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "4475f276-acc4-44f1-a5fa-6a7fb2165493-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:46 user nova-compute[231753]: INFO nova.compute.manager [None req-7839aa14-08a4-4a85-8425-7b070fce152b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Terminating instance
Jul 29 13:39:46 user nova-compute[231753]: DEBUG nova.compute.manager [None req-7839aa14-08a4-4a85-8425-7b070fce152b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:39:46 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:46 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:46 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:46 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:46 user nova-compute[231753]: DEBUG nova.compute.manager [req-bc0cf242-6443-4f61-8880-2b00d4ee0f04 req-ccc2f0ec-1ec8-4e89-b077-594f7940f8ae service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Received event network-vif-unplugged-d219916c-23c3-4319-ad8e-9d04e9399ab7 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:39:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bc0cf242-6443-4f61-8880-2b00d4ee0f04 req-ccc2f0ec-1ec8-4e89-b077-594f7940f8ae service nova] Acquiring lock "4475f276-acc4-44f1-a5fa-6a7fb2165493-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bc0cf242-6443-4f61-8880-2b00d4ee0f04 req-ccc2f0ec-1ec8-4e89-b077-594f7940f8ae service nova] Lock "4475f276-acc4-44f1-a5fa-6a7fb2165493-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bc0cf242-6443-4f61-8880-2b00d4ee0f04 req-ccc2f0ec-1ec8-4e89-b077-594f7940f8ae service nova] Lock "4475f276-acc4-44f1-a5fa-6a7fb2165493-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:46 user nova-compute[231753]: DEBUG nova.compute.manager [req-bc0cf242-6443-4f61-8880-2b00d4ee0f04 req-ccc2f0ec-1ec8-4e89-b077-594f7940f8ae service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] No waiting events found dispatching network-vif-unplugged-d219916c-23c3-4319-ad8e-9d04e9399ab7 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:39:46 user nova-compute[231753]: DEBUG nova.compute.manager [req-bc0cf242-6443-4f61-8880-2b00d4ee0f04 req-ccc2f0ec-1ec8-4e89-b077-594f7940f8ae service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Received event network-vif-unplugged-d219916c-23c3-4319-ad8e-9d04e9399ab7 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:39:47 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Instance destroyed successfully.
Jul 29 13:39:47 user nova-compute[231753]: DEBUG nova.objects.instance [None req-7839aa14-08a4-4a85-8425-7b070fce152b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lazy-loading 'resources' on Instance uuid 4475f276-acc4-44f1-a5fa-6a7fb2165493 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:39:47 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-7839aa14-08a4-4a85-8425-7b070fce152b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-29T13:33:11Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1694184066',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1694184066',id=2,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIYoEtzU6J31e2RMDk9uaA5VJrLaFlHisUcIiXf7P/keUQzM7WNyYfVc11sJPt9QSdUbn5KUqdeviscTZdrxZy5sAgJHvKAfcyE/2Hc8mSccY6dRh0JEfLln2dwNfX/9jw==',key_name='tempest-keypair-991697156',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:37:28Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d53ebbb5f2e440dfa0cf3950232b4853',ramdisk_id='',reservation_id='r-k5ymi4kt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-460717858',owner_user_name='tempest-AttachVolumeShelveTestJSON-460717858-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:37:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='932b5bd757f94be29d52035fd9f70293',uuid=4475f276-acc4-44f1-a5fa-6a7fb2165493,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "address": "fa:16:3e:52:5c:6f", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd219916c-23", "ovs_interfaceid": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:39:47 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-7839aa14-08a4-4a85-8425-7b070fce152b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Converting VIF {"id": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "address": "fa:16:3e:52:5c:6f", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd219916c-23", "ovs_interfaceid": "d219916c-23c3-4319-ad8e-9d04e9399ab7", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:39:47 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-7839aa14-08a4-4a85-8425-7b070fce152b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:5c:6f,bridge_name='br-int',has_traffic_filtering=True,id=d219916c-23c3-4319-ad8e-9d04e9399ab7,network=Network(9be19067-cc29-4c67-95a0-cf37f95f9fc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd219916c-23') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:39:47 user nova-compute[231753]: DEBUG os_vif [None req-7839aa14-08a4-4a85-8425-7b070fce152b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:5c:6f,bridge_name='br-int',has_traffic_filtering=True,id=d219916c-23c3-4319-ad8e-9d04e9399ab7,network=Network(9be19067-cc29-4c67-95a0-cf37f95f9fc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd219916c-23') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:39:47 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:47 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd219916c-23, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:39:47 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:47 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:47 user nova-compute[231753]: INFO os_vif [None req-7839aa14-08a4-4a85-8425-7b070fce152b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:5c:6f,bridge_name='br-int',has_traffic_filtering=True,id=d219916c-23c3-4319-ad8e-9d04e9399ab7,network=Network(9be19067-cc29-4c67-95a0-cf37f95f9fc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd219916c-23')
Jul 29 13:39:47 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-7839aa14-08a4-4a85-8425-7b070fce152b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Deleting instance files /opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493_del
Jul 29 13:39:47 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-7839aa14-08a4-4a85-8425-7b070fce152b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Deletion of /opt/stack/data/nova/instances/4475f276-acc4-44f1-a5fa-6a7fb2165493_del complete
Jul 29 13:39:47 user nova-compute[231753]: INFO nova.compute.manager [None req-7839aa14-08a4-4a85-8425-7b070fce152b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Took 1.09 seconds to destroy the instance on the hypervisor.
Jul 29 13:39:47 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-7839aa14-08a4-4a85-8425-7b070fce152b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:39:47 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:39:47 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:39:47 user nova-compute[231753]: DEBUG nova.compute.manager [req-d5da26b3-dd29-42b2-bf57-4f5cb0c7280e req-11d29bd4-8d01-45f5-baf4-146bcba5ee75 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-changed-984d64db-ae0d-45be-a0cd-3bcc5b00008b {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:39:47 user nova-compute[231753]: DEBUG nova.compute.manager [req-d5da26b3-dd29-42b2-bf57-4f5cb0c7280e req-11d29bd4-8d01-45f5-baf4-146bcba5ee75 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Refreshing instance network info cache due to event network-changed-984d64db-ae0d-45be-a0cd-3bcc5b00008b. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:39:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d5da26b3-dd29-42b2-bf57-4f5cb0c7280e req-11d29bd4-8d01-45f5-baf4-146bcba5ee75 service nova] Acquiring lock "refresh_cache-894f5e40-e585-41c0-9dd8-e94d8a9400ef" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:39:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d5da26b3-dd29-42b2-bf57-4f5cb0c7280e req-11d29bd4-8d01-45f5-baf4-146bcba5ee75 service nova] Acquired lock "refresh_cache-894f5e40-e585-41c0-9dd8-e94d8a9400ef" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:39:47 user nova-compute[231753]: DEBUG nova.network.neutron [req-d5da26b3-dd29-42b2-bf57-4f5cb0c7280e req-11d29bd4-8d01-45f5-baf4-146bcba5ee75 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Refreshing network info cache for port 984d64db-ae0d-45be-a0cd-3bcc5b00008b {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:39:48 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:39:48 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Took 0.92 seconds to deallocate network for instance.
Jul 29 13:39:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7839aa14-08a4-4a85-8425-7b070fce152b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7839aa14-08a4-4a85-8425-7b070fce152b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:48 user nova-compute[231753]: DEBUG nova.network.neutron [req-d5da26b3-dd29-42b2-bf57-4f5cb0c7280e req-11d29bd4-8d01-45f5-baf4-146bcba5ee75 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Updated VIF entry in instance network info cache for port 984d64db-ae0d-45be-a0cd-3bcc5b00008b. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:39:48 user nova-compute[231753]: DEBUG nova.network.neutron [req-d5da26b3-dd29-42b2-bf57-4f5cb0c7280e req-11d29bd4-8d01-45f5-baf4-146bcba5ee75 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Updating instance_info_cache with network_info: [{"id": "984d64db-ae0d-45be-a0cd-3bcc5b00008b", "address": "fa:16:3e:4f:92:db", "network": {"id": "322b52d5-b11a-4c3c-a30b-adfbfee8d1b2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1087548543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap984d64db-ae", "ovs_interfaceid": "984d64db-ae0d-45be-a0cd-3bcc5b00008b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dcd40805-07c1-45d2-a795-f3085231f735", "address": "fa:16:3e:b4:73:7b", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcd40805-07", "ovs_interfaceid": "dcd40805-07c1-45d2-a795-f3085231f735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a95b92c-9a5b-4fd4-bbfd-36063a073c11", "address": "fa:16:3e:ff:85:55", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a95b92c-9a", "ovs_interfaceid": "4a95b92c-9a5b-4fd4-bbfd-36063a073c11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2789bcf9-55ed-4893-85f4-7595c6df0400", "address": "fa:16:3e:ae:53:f8", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2789bcf9-55", "ovs_interfaceid": "2789bcf9-55ed-4893-85f4-7595c6df0400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0ade4f6-225a-4c66-a2f5-d5793cfa7a96", "address": "fa:16:3e:43:c1:d4", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ade4f6-22", "ovs_interfaceid": "f0ade4f6-225a-4c66-a2f5-d5793cfa7a96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a795944f-ca69-4b3d-90b6-bf61d16fa1a8", "address": "fa:16:3e:47:62:b3", "network": {"id": "d45dd21d-a9cd-4c70-9b98-aae5f9179d8c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1287922789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa795944f-ca", "ovs_interfaceid": "a795944f-ca69-4b3d-90b6-bf61d16fa1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a4a0b15f-494b-4934-8b4f-fb8df577a60d", "address": "fa:16:3e:a3:46:6e", "network": {"id": "d45dd21d-a9cd-4c70-9b98-aae5f9179d8c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1287922789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a0b15f-49", "ovs_interfaceid": "a4a0b15f-494b-4934-8b4f-fb8df577a60d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:39:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d5da26b3-dd29-42b2-bf57-4f5cb0c7280e req-11d29bd4-8d01-45f5-baf4-146bcba5ee75 service nova] Releasing lock "refresh_cache-894f5e40-e585-41c0-9dd8-e94d8a9400ef" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:39:48 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-7839aa14-08a4-4a85-8425-7b070fce152b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:39:48 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-7839aa14-08a4-4a85-8425-7b070fce152b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:39:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7839aa14-08a4-4a85-8425-7b070fce152b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.349s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:48 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-7839aa14-08a4-4a85-8425-7b070fce152b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Deleted allocations for instance 4475f276-acc4-44f1-a5fa-6a7fb2165493
Jul 29 13:39:48 user nova-compute[231753]: DEBUG nova.compute.manager [req-3c75b9ea-1809-4923-932e-507074cd77ed req-0a1432fc-052d-4db4-b462-f9a75971e3ee service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Received event network-vif-plugged-d219916c-23c3-4319-ad8e-9d04e9399ab7 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:39:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3c75b9ea-1809-4923-932e-507074cd77ed req-0a1432fc-052d-4db4-b462-f9a75971e3ee service nova] Acquiring lock "4475f276-acc4-44f1-a5fa-6a7fb2165493-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3c75b9ea-1809-4923-932e-507074cd77ed req-0a1432fc-052d-4db4-b462-f9a75971e3ee service nova] Lock "4475f276-acc4-44f1-a5fa-6a7fb2165493-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3c75b9ea-1809-4923-932e-507074cd77ed req-0a1432fc-052d-4db4-b462-f9a75971e3ee service nova] Lock "4475f276-acc4-44f1-a5fa-6a7fb2165493-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:48 user nova-compute[231753]: DEBUG nova.compute.manager [req-3c75b9ea-1809-4923-932e-507074cd77ed req-0a1432fc-052d-4db4-b462-f9a75971e3ee service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] No waiting events found dispatching network-vif-plugged-d219916c-23c3-4319-ad8e-9d04e9399ab7 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:39:48 user nova-compute[231753]: WARNING nova.compute.manager [req-3c75b9ea-1809-4923-932e-507074cd77ed req-0a1432fc-052d-4db4-b462-f9a75971e3ee service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Received unexpected event network-vif-plugged-d219916c-23c3-4319-ad8e-9d04e9399ab7 for instance with vm_state deleted and task_state None.
Jul 29 13:39:48 user nova-compute[231753]: DEBUG nova.compute.manager [req-3c75b9ea-1809-4923-932e-507074cd77ed req-0a1432fc-052d-4db4-b462-f9a75971e3ee service nova] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Received event network-vif-deleted-d219916c-23c3-4319-ad8e-9d04e9399ab7 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:39:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7839aa14-08a4-4a85-8425-7b070fce152b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "4475f276-acc4-44f1-a5fa-6a7fb2165493" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.579s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Acquiring lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Acquiring lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:50 user nova-compute[231753]: INFO nova.compute.manager [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Terminating instance
Jul 29 13:39:50 user nova-compute[231753]: DEBUG nova.compute.manager [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG nova.compute.manager [req-bcf0f52c-7e6a-4b07-bde7-c12676cf7498 req-0cd638f6-d367-4fb3-98ff-f477ab96cb6f service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-unplugged-dcd40805-07c1-45d2-a795-f3085231f735 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bcf0f52c-7e6a-4b07-bde7-c12676cf7498 req-0cd638f6-d367-4fb3-98ff-f477ab96cb6f service nova] Acquiring lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bcf0f52c-7e6a-4b07-bde7-c12676cf7498 req-0cd638f6-d367-4fb3-98ff-f477ab96cb6f service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bcf0f52c-7e6a-4b07-bde7-c12676cf7498 req-0cd638f6-d367-4fb3-98ff-f477ab96cb6f service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG nova.compute.manager [req-bcf0f52c-7e6a-4b07-bde7-c12676cf7498 req-0cd638f6-d367-4fb3-98ff-f477ab96cb6f service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] No waiting events found dispatching network-vif-unplugged-dcd40805-07c1-45d2-a795-f3085231f735 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG nova.compute.manager [req-bcf0f52c-7e6a-4b07-bde7-c12676cf7498 req-0cd638f6-d367-4fb3-98ff-f477ab96cb6f service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-unplugged-dcd40805-07c1-45d2-a795-f3085231f735 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG nova.compute.manager [req-88df0b1e-6d5c-4e9d-badc-1a18d8aaf4e6 req-ee89aa46-276d-48c5-93a4-ea5d43804bda service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-unplugged-4a95b92c-9a5b-4fd4-bbfd-36063a073c11 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-88df0b1e-6d5c-4e9d-badc-1a18d8aaf4e6 req-ee89aa46-276d-48c5-93a4-ea5d43804bda service nova] Acquiring lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-88df0b1e-6d5c-4e9d-badc-1a18d8aaf4e6 req-ee89aa46-276d-48c5-93a4-ea5d43804bda service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-88df0b1e-6d5c-4e9d-badc-1a18d8aaf4e6 req-ee89aa46-276d-48c5-93a4-ea5d43804bda service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG nova.compute.manager [req-88df0b1e-6d5c-4e9d-badc-1a18d8aaf4e6 req-ee89aa46-276d-48c5-93a4-ea5d43804bda service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] No waiting events found dispatching network-vif-unplugged-4a95b92c-9a5b-4fd4-bbfd-36063a073c11 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG nova.compute.manager [req-88df0b1e-6d5c-4e9d-badc-1a18d8aaf4e6 req-ee89aa46-276d-48c5-93a4-ea5d43804bda service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-unplugged-4a95b92c-9a5b-4fd4-bbfd-36063a073c11 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG nova.compute.manager [req-7f0212c7-002e-4eb8-a3bd-935555a965b6 req-293b762b-ee05-4583-bc7f-17babff165a7 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-unplugged-984d64db-ae0d-45be-a0cd-3bcc5b00008b {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7f0212c7-002e-4eb8-a3bd-935555a965b6 req-293b762b-ee05-4583-bc7f-17babff165a7 service nova] Acquiring lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7f0212c7-002e-4eb8-a3bd-935555a965b6 req-293b762b-ee05-4583-bc7f-17babff165a7 service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7f0212c7-002e-4eb8-a3bd-935555a965b6 req-293b762b-ee05-4583-bc7f-17babff165a7 service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG nova.compute.manager [req-7f0212c7-002e-4eb8-a3bd-935555a965b6 req-293b762b-ee05-4583-bc7f-17babff165a7 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] No waiting events found dispatching network-vif-unplugged-984d64db-ae0d-45be-a0cd-3bcc5b00008b {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG nova.compute.manager [req-7f0212c7-002e-4eb8-a3bd-935555a965b6 req-293b762b-ee05-4583-bc7f-17babff165a7 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-unplugged-984d64db-ae0d-45be-a0cd-3bcc5b00008b for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:50 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:52 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Instance destroyed successfully.
Jul 29 13:39:52 user nova-compute[231753]: DEBUG nova.objects.instance [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Lazy-loading 'resources' on Instance uuid 894f5e40-e585-41c0-9dd8-e94d8a9400ef {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:37:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-760304032',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-760304032',id=16,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJAA7nV1bCNkU952F/cZ76kN28PQKANdkmvJPcn5ae13AzCEKy4tPqxG+We4+ntx5/wii47tLrGtk//N9hghMdTQ8qL5bl7Q+UzjCEdRqHOtTxevUzaqM4O1XrZLEej0g==',key_name='tempest-keypair-1726319149',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:38:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11bd37c7c8524d2b961e5b1aa1e92e9e',ramdisk_id='',reservation_id='r-vbcco03p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1447223842',owner_user_name='tempest-TaggedBootDevicesTest_v242-1447223842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:38:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85b304003a524464a7d013228d650d3b',uuid=894f5e40-e585-41c0-9dd8-e94d8a9400ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "984d64db-ae0d-45be-a0cd-3bcc5b00008b", "address": "fa:16:3e:4f:92:db", "network": {"id": "322b52d5-b11a-4c3c-a30b-adfbfee8d1b2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1087548543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap984d64db-ae", "ovs_interfaceid": "984d64db-ae0d-45be-a0cd-3bcc5b00008b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converting VIF {"id": "984d64db-ae0d-45be-a0cd-3bcc5b00008b", "address": "fa:16:3e:4f:92:db", "network": {"id": "322b52d5-b11a-4c3c-a30b-adfbfee8d1b2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1087548543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap984d64db-ae", "ovs_interfaceid": "984d64db-ae0d-45be-a0cd-3bcc5b00008b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:92:db,bridge_name='br-int',has_traffic_filtering=True,id=984d64db-ae0d-45be-a0cd-3bcc5b00008b,network=Network(322b52d5-b11a-4c3c-a30b-adfbfee8d1b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap984d64db-ae') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG os_vif [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:92:db,bridge_name='br-int',has_traffic_filtering=True,id=984d64db-ae0d-45be-a0cd-3bcc5b00008b,network=Network(322b52d5-b11a-4c3c-a30b-adfbfee8d1b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap984d64db-ae') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap984d64db-ae, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:52 user nova-compute[231753]: INFO os_vif [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:92:db,bridge_name='br-int',has_traffic_filtering=True,id=984d64db-ae0d-45be-a0cd-3bcc5b00008b,network=Network(322b52d5-b11a-4c3c-a30b-adfbfee8d1b2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap984d64db-ae')
Jul 29 13:39:52 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:37:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-760304032',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-760304032',id=16,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJAA7nV1bCNkU952F/cZ76kN28PQKANdkmvJPcn5ae13AzCEKy4tPqxG+We4+ntx5/wii47tLrGtk//N9hghMdTQ8qL5bl7Q+UzjCEdRqHOtTxevUzaqM4O1XrZLEej0g==',key_name='tempest-keypair-1726319149',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:38:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11bd37c7c8524d2b961e5b1aa1e92e9e',ramdisk_id='',reservation_id='r-vbcco03p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1447223842',owner_user_name='tempest-TaggedBootDevicesTest_v242-1447223842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:38:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85b304003a524464a7d013228d650d3b',uuid=894f5e40-e585-41c0-9dd8-e94d8a9400ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dcd40805-07c1-45d2-a795-f3085231f735", "address": "fa:16:3e:b4:73:7b", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcd40805-07", "ovs_interfaceid": "dcd40805-07c1-45d2-a795-f3085231f735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converting VIF {"id": "dcd40805-07c1-45d2-a795-f3085231f735", "address": "fa:16:3e:b4:73:7b", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcd40805-07", "ovs_interfaceid": "dcd40805-07c1-45d2-a795-f3085231f735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b4:73:7b,bridge_name='br-int',has_traffic_filtering=True,id=dcd40805-07c1-45d2-a795-f3085231f735,network=Network(022a1d0e-dd19-41f2-9079-ce71ed9530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdcd40805-07') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG os_vif [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:73:7b,bridge_name='br-int',has_traffic_filtering=True,id=dcd40805-07c1-45d2-a795-f3085231f735,network=Network(022a1d0e-dd19-41f2-9079-ce71ed9530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdcd40805-07') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdcd40805-07, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:52 user nova-compute[231753]: INFO os_vif [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b4:73:7b,bridge_name='br-int',has_traffic_filtering=True,id=dcd40805-07c1-45d2-a795-f3085231f735,network=Network(022a1d0e-dd19-41f2-9079-ce71ed9530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdcd40805-07')
Jul 29 13:39:52 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:37:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-760304032',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-760304032',id=16,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJAA7nV1bCNkU952F/cZ76kN28PQKANdkmvJPcn5ae13AzCEKy4tPqxG+We4+ntx5/wii47tLrGtk//N9hghMdTQ8qL5bl7Q+UzjCEdRqHOtTxevUzaqM4O1XrZLEej0g==',key_name='tempest-keypair-1726319149',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:38:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11bd37c7c8524d2b961e5b1aa1e92e9e',ramdisk_id='',reservation_id='r-vbcco03p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1447223842',owner_user_name='tempest-TaggedBootDevicesTest_v242-1447223842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:38:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85b304003a524464a7d013228d650d3b',uuid=894f5e40-e585-41c0-9dd8-e94d8a9400ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4a95b92c-9a5b-4fd4-bbfd-36063a073c11", "address": "fa:16:3e:ff:85:55", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a95b92c-9a", "ovs_interfaceid": "4a95b92c-9a5b-4fd4-bbfd-36063a073c11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converting VIF {"id": "4a95b92c-9a5b-4fd4-bbfd-36063a073c11", "address": "fa:16:3e:ff:85:55", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a95b92c-9a", "ovs_interfaceid": "4a95b92c-9a5b-4fd4-bbfd-36063a073c11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ff:85:55,bridge_name='br-int',has_traffic_filtering=True,id=4a95b92c-9a5b-4fd4-bbfd-36063a073c11,network=Network(022a1d0e-dd19-41f2-9079-ce71ed9530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4a95b92c-9a') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG os_vif [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:85:55,bridge_name='br-int',has_traffic_filtering=True,id=4a95b92c-9a5b-4fd4-bbfd-36063a073c11,network=Network(022a1d0e-dd19-41f2-9079-ce71ed9530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4a95b92c-9a') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4a95b92c-9a, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:52 user nova-compute[231753]: INFO os_vif [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ff:85:55,bridge_name='br-int',has_traffic_filtering=True,id=4a95b92c-9a5b-4fd4-bbfd-36063a073c11,network=Network(022a1d0e-dd19-41f2-9079-ce71ed9530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap4a95b92c-9a')
Jul 29 13:39:52 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:37:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-760304032',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-760304032',id=16,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJAA7nV1bCNkU952F/cZ76kN28PQKANdkmvJPcn5ae13AzCEKy4tPqxG+We4+ntx5/wii47tLrGtk//N9hghMdTQ8qL5bl7Q+UzjCEdRqHOtTxevUzaqM4O1XrZLEej0g==',key_name='tempest-keypair-1726319149',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:38:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11bd37c7c8524d2b961e5b1aa1e92e9e',ramdisk_id='',reservation_id='r-vbcco03p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1447223842',owner_user_name='tempest-TaggedBootDevicesTest_v242-1447223842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:38:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85b304003a524464a7d013228d650d3b',uuid=894f5e40-e585-41c0-9dd8-e94d8a9400ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2789bcf9-55ed-4893-85f4-7595c6df0400", "address": "fa:16:3e:ae:53:f8", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2789bcf9-55", "ovs_interfaceid": "2789bcf9-55ed-4893-85f4-7595c6df0400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converting VIF {"id": "2789bcf9-55ed-4893-85f4-7595c6df0400", "address": "fa:16:3e:ae:53:f8", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2789bcf9-55", "ovs_interfaceid": "2789bcf9-55ed-4893-85f4-7595c6df0400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:53:f8,bridge_name='br-int',has_traffic_filtering=True,id=2789bcf9-55ed-4893-85f4-7595c6df0400,network=Network(022a1d0e-dd19-41f2-9079-ce71ed9530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2789bcf9-55') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG os_vif [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:53:f8,bridge_name='br-int',has_traffic_filtering=True,id=2789bcf9-55ed-4893-85f4-7595c6df0400,network=Network(022a1d0e-dd19-41f2-9079-ce71ed9530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2789bcf9-55') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2789bcf9-55, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:52 user nova-compute[231753]: INFO os_vif [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:53:f8,bridge_name='br-int',has_traffic_filtering=True,id=2789bcf9-55ed-4893-85f4-7595c6df0400,network=Network(022a1d0e-dd19-41f2-9079-ce71ed9530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2789bcf9-55')
Jul 29 13:39:52 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:37:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-760304032',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-760304032',id=16,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJAA7nV1bCNkU952F/cZ76kN28PQKANdkmvJPcn5ae13AzCEKy4tPqxG+We4+ntx5/wii47tLrGtk//N9hghMdTQ8qL5bl7Q+UzjCEdRqHOtTxevUzaqM4O1XrZLEej0g==',key_name='tempest-keypair-1726319149',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:38:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11bd37c7c8524d2b961e5b1aa1e92e9e',ramdisk_id='',reservation_id='r-vbcco03p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1447223842',owner_user_name='tempest-TaggedBootDevicesTest_v242-1447223842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:38:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85b304003a524464a7d013228d650d3b',uuid=894f5e40-e585-41c0-9dd8-e94d8a9400ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f0ade4f6-225a-4c66-a2f5-d5793cfa7a96", "address": "fa:16:3e:43:c1:d4", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ade4f6-22", "ovs_interfaceid": "f0ade4f6-225a-4c66-a2f5-d5793cfa7a96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converting VIF {"id": "f0ade4f6-225a-4c66-a2f5-d5793cfa7a96", "address": "fa:16:3e:43:c1:d4", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ade4f6-22", "ovs_interfaceid": "f0ade4f6-225a-4c66-a2f5-d5793cfa7a96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:c1:d4,bridge_name='br-int',has_traffic_filtering=True,id=f0ade4f6-225a-4c66-a2f5-d5793cfa7a96,network=Network(022a1d0e-dd19-41f2-9079-ce71ed9530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0ade4f6-22') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG os_vif [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:c1:d4,bridge_name='br-int',has_traffic_filtering=True,id=f0ade4f6-225a-4c66-a2f5-d5793cfa7a96,network=Network(022a1d0e-dd19-41f2-9079-ce71ed9530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0ade4f6-22') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf0ade4f6-22, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:52 user nova-compute[231753]: INFO os_vif [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:c1:d4,bridge_name='br-int',has_traffic_filtering=True,id=f0ade4f6-225a-4c66-a2f5-d5793cfa7a96,network=Network(022a1d0e-dd19-41f2-9079-ce71ed9530cf),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf0ade4f6-22')
Jul 29 13:39:52 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:37:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-760304032',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-760304032',id=16,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJAA7nV1bCNkU952F/cZ76kN28PQKANdkmvJPcn5ae13AzCEKy4tPqxG+We4+ntx5/wii47tLrGtk//N9hghMdTQ8qL5bl7Q+UzjCEdRqHOtTxevUzaqM4O1XrZLEej0g==',key_name='tempest-keypair-1726319149',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:38:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11bd37c7c8524d2b961e5b1aa1e92e9e',ramdisk_id='',reservation_id='r-vbcco03p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1447223842',owner_user_name='tempest-TaggedBootDevicesTest_v242-1447223842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:38:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85b304003a524464a7d013228d650d3b',uuid=894f5e40-e585-41c0-9dd8-e94d8a9400ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a795944f-ca69-4b3d-90b6-bf61d16fa1a8", "address": "fa:16:3e:47:62:b3", "network": {"id": "d45dd21d-a9cd-4c70-9b98-aae5f9179d8c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1287922789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa795944f-ca", "ovs_interfaceid": "a795944f-ca69-4b3d-90b6-bf61d16fa1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converting VIF {"id": "a795944f-ca69-4b3d-90b6-bf61d16fa1a8", "address": "fa:16:3e:47:62:b3", "network": {"id": "d45dd21d-a9cd-4c70-9b98-aae5f9179d8c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1287922789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa795944f-ca", "ovs_interfaceid": "a795944f-ca69-4b3d-90b6-bf61d16fa1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:47:62:b3,bridge_name='br-int',has_traffic_filtering=True,id=a795944f-ca69-4b3d-90b6-bf61d16fa1a8,network=Network(d45dd21d-a9cd-4c70-9b98-aae5f9179d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa795944f-ca') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG os_vif [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:62:b3,bridge_name='br-int',has_traffic_filtering=True,id=a795944f-ca69-4b3d-90b6-bf61d16fa1a8,network=Network(d45dd21d-a9cd-4c70-9b98-aae5f9179d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa795944f-ca') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa795944f-ca, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:52 user nova-compute[231753]: INFO os_vif [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:47:62:b3,bridge_name='br-int',has_traffic_filtering=True,id=a795944f-ca69-4b3d-90b6-bf61d16fa1a8,network=Network(d45dd21d-a9cd-4c70-9b98-aae5f9179d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa795944f-ca')
Jul 29 13:39:52 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2023-07-29T13:37:54Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-760304032',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-device-tagging-server-760304032',id=16,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNJAA7nV1bCNkU952F/cZ76kN28PQKANdkmvJPcn5ae13AzCEKy4tPqxG+We4+ntx5/wii47tLrGtk//N9hghMdTQ8qL5bl7Q+UzjCEdRqHOtTxevUzaqM4O1XrZLEej0g==',key_name='tempest-keypair-1726319149',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:38:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='11bd37c7c8524d2b961e5b1aa1e92e9e',ramdisk_id='',reservation_id='r-vbcco03p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-1447223842',owner_user_name='tempest-TaggedBootDevicesTest_v242-1447223842-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:38:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='85b304003a524464a7d013228d650d3b',uuid=894f5e40-e585-41c0-9dd8-e94d8a9400ef,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a4a0b15f-494b-4934-8b4f-fb8df577a60d", "address": "fa:16:3e:a3:46:6e", "network": {"id": "d45dd21d-a9cd-4c70-9b98-aae5f9179d8c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1287922789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a0b15f-49", "ovs_interfaceid": "a4a0b15f-494b-4934-8b4f-fb8df577a60d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converting VIF {"id": "a4a0b15f-494b-4934-8b4f-fb8df577a60d", "address": "fa:16:3e:a3:46:6e", "network": {"id": "d45dd21d-a9cd-4c70-9b98-aae5f9179d8c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1287922789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa4a0b15f-49", "ovs_interfaceid": "a4a0b15f-494b-4934-8b4f-fb8df577a60d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a3:46:6e,bridge_name='br-int',has_traffic_filtering=True,id=a4a0b15f-494b-4934-8b4f-fb8df577a60d,network=Network(d45dd21d-a9cd-4c70-9b98-aae5f9179d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4a0b15f-49') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG os_vif [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:46:6e,bridge_name='br-int',has_traffic_filtering=True,id=a4a0b15f-494b-4934-8b4f-fb8df577a60d,network=Network(d45dd21d-a9cd-4c70-9b98-aae5f9179d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4a0b15f-49') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa4a0b15f-49, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:52 user nova-compute[231753]: INFO os_vif [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a3:46:6e,bridge_name='br-int',has_traffic_filtering=True,id=a4a0b15f-494b-4934-8b4f-fb8df577a60d,network=Network(d45dd21d-a9cd-4c70-9b98-aae5f9179d8c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa4a0b15f-49')
Jul 29 13:39:52 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'uSQsjNbX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:39:52 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:39:52 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e6fa8c3-5d8f-402f-a776-117b911b6f75]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:39:52 user nova-compute[231753]: No targets found.
Jul 29 13:39:52 user nova-compute[231753]: iSNS:
Jul 29 13:39:52 user nova-compute[231753]: No targets found.
Jul 29 13:39:52 user nova-compute[231753]: STATIC:
Jul 29 13:39:52 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0
Jul 29 13:39:52 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:39:52 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:39:52 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4
Jul 29 13:39:52 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:39:52 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:39:52 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3
Jul 29 13:39:52 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:39:52 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:39:52 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7
Jul 29 13:39:52 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:39:52 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:39:52 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be
Jul 29 13:39:52 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:39:52 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:39:52 user nova-compute[231753]: FIRMWARE:
Jul 29 13:39:52 user nova-compute[231753]: No targets found.
Jul 29 13:39:52 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:39:52 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:39:52 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b60fc97-d282-44b9-93e6-fa9e3c1965bc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb22cb4-7929-4f4d-805e-e6e03b564258]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)\ntcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:52 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:39:52 user nova-compute[231753]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 (non-flash)
Jul 29 13:39:52 user nova-compute[231753]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be (non-flash)
Jul 29 13:39:52 user nova-compute[231753]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 (non-flash)
Jul 29 13:39:52 user nova-compute[231753]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:39:52 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:39:53 user nova-compute[231753]: tcp: [19] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 (non-flash)
Jul 29 13:39:53 user nova-compute[231753]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be (non-flash)
Jul 29 13:39:53 user nova-compute[231753]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 (non-flash)
Jul 29 13:39:53 user nova-compute[231753]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:39:53 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c806c6b00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0'): ({'sdf'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Removing single pathed devices sdf {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8845ef3-fb93-47c0-bce5-191ed2916594]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.028s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e40b2b1-1efd-4e3c-9d46-7edfb306968c]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Flushing IO for device /dev/sdf {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.015s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3eb2593-d274-42bd-aa16-b2a944772372]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.132s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[962ca0bb-d596-4bd7-97c3-5cb94d22b2ff]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] SCSI volumes sdf have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d8fc4b9-5ca1-4efa-90d7-b58b6151d9d3]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG nova.compute.manager [req-a4eb1adf-c6f6-4a09-bc82-fb875ff6c966 req-930f2644-7c22-46b8-b002-00e68bdc0f96 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-plugged-dcd40805-07c1-45d2-a795-f3085231f735 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a4eb1adf-c6f6-4a09-bc82-fb875ff6c966 req-930f2644-7c22-46b8-b002-00e68bdc0f96 service nova] Acquiring lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a4eb1adf-c6f6-4a09-bc82-fb875ff6c966 req-930f2644-7c22-46b8-b002-00e68bdc0f96 service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a4eb1adf-c6f6-4a09-bc82-fb875ff6c966 req-930f2644-7c22-46b8-b002-00e68bdc0f96 service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG nova.compute.manager [req-a4eb1adf-c6f6-4a09-bc82-fb875ff6c966 req-930f2644-7c22-46b8-b002-00e68bdc0f96 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] No waiting events found dispatching network-vif-plugged-dcd40805-07c1-45d2-a795-f3085231f735 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:39:53 user nova-compute[231753]: WARNING nova.compute.manager [req-a4eb1adf-c6f6-4a09-bc82-fb875ff6c966 req-930f2644-7c22-46b8-b002-00e68bdc0f96 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received unexpected event network-vif-plugged-dcd40805-07c1-45d2-a795-f3085231f735 for instance with vm_state active and task_state deleting.
Jul 29 13:39:53 user nova-compute[231753]: DEBUG nova.compute.manager [req-9afa1087-3b42-496f-a158-174fb771a783 req-57350580-15b6-4438-af59-98f21eef363e service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-plugged-4a95b92c-9a5b-4fd4-bbfd-36063a073c11 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9afa1087-3b42-496f-a158-174fb771a783 req-57350580-15b6-4438-af59-98f21eef363e service nova] Acquiring lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9afa1087-3b42-496f-a158-174fb771a783 req-57350580-15b6-4438-af59-98f21eef363e service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9afa1087-3b42-496f-a158-174fb771a783 req-57350580-15b6-4438-af59-98f21eef363e service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG nova.compute.manager [req-9afa1087-3b42-496f-a158-174fb771a783 req-57350580-15b6-4438-af59-98f21eef363e service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] No waiting events found dispatching network-vif-plugged-4a95b92c-9a5b-4fd4-bbfd-36063a073c11 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:39:53 user nova-compute[231753]: WARNING nova.compute.manager [req-9afa1087-3b42-496f-a158-174fb771a783 req-57350580-15b6-4438-af59-98f21eef363e service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received unexpected event network-vif-plugged-4a95b92c-9a5b-4fd4-bbfd-36063a073c11 for instance with vm_state active and task_state deleting.
Jul 29 13:39:53 user nova-compute[231753]: DEBUG nova.compute.manager [req-9afa1087-3b42-496f-a158-174fb771a783 req-57350580-15b6-4438-af59-98f21eef363e service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-unplugged-a795944f-ca69-4b3d-90b6-bf61d16fa1a8 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9afa1087-3b42-496f-a158-174fb771a783 req-57350580-15b6-4438-af59-98f21eef363e service nova] Acquiring lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9afa1087-3b42-496f-a158-174fb771a783 req-57350580-15b6-4438-af59-98f21eef363e service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9afa1087-3b42-496f-a158-174fb771a783 req-57350580-15b6-4438-af59-98f21eef363e service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG nova.compute.manager [req-9afa1087-3b42-496f-a158-174fb771a783 req-57350580-15b6-4438-af59-98f21eef363e service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] No waiting events found dispatching network-vif-unplugged-a795944f-ca69-4b3d-90b6-bf61d16fa1a8 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG nova.compute.manager [req-9afa1087-3b42-496f-a158-174fb771a783 req-57350580-15b6-4438-af59-98f21eef363e service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-unplugged-a795944f-ca69-4b3d-90b6-bf61d16fa1a8 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG nova.compute.manager [req-9afa1087-3b42-496f-a158-174fb771a783 req-57350580-15b6-4438-af59-98f21eef363e service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-plugged-a795944f-ca69-4b3d-90b6-bf61d16fa1a8 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9afa1087-3b42-496f-a158-174fb771a783 req-57350580-15b6-4438-af59-98f21eef363e service nova] Acquiring lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9afa1087-3b42-496f-a158-174fb771a783 req-57350580-15b6-4438-af59-98f21eef363e service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9afa1087-3b42-496f-a158-174fb771a783 req-57350580-15b6-4438-af59-98f21eef363e service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG nova.compute.manager [req-9afa1087-3b42-496f-a158-174fb771a783 req-57350580-15b6-4438-af59-98f21eef363e service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] No waiting events found dispatching network-vif-plugged-a795944f-ca69-4b3d-90b6-bf61d16fa1a8 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:39:53 user nova-compute[231753]: WARNING nova.compute.manager [req-9afa1087-3b42-496f-a158-174fb771a783 req-57350580-15b6-4438-af59-98f21eef363e service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received unexpected event network-vif-plugged-a795944f-ca69-4b3d-90b6-bf61d16fa1a8 for instance with vm_state active and task_state deleting.
Jul 29 13:39:53 user nova-compute[231753]: DEBUG nova.compute.manager [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-plugged-984d64db-ae0d-45be-a0cd-3bcc5b00008b {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] Acquiring lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG nova.compute.manager [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] No waiting events found dispatching network-vif-plugged-984d64db-ae0d-45be-a0cd-3bcc5b00008b {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:39:53 user nova-compute[231753]: WARNING nova.compute.manager [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received unexpected event network-vif-plugged-984d64db-ae0d-45be-a0cd-3bcc5b00008b for instance with vm_state active and task_state deleting.
Jul 29 13:39:53 user nova-compute[231753]: DEBUG nova.compute.manager [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-unplugged-2789bcf9-55ed-4893-85f4-7595c6df0400 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] Acquiring lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG nova.compute.manager [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] No waiting events found dispatching network-vif-unplugged-2789bcf9-55ed-4893-85f4-7595c6df0400 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG nova.compute.manager [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-unplugged-2789bcf9-55ed-4893-85f4-7595c6df0400 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG nova.compute.manager [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-plugged-2789bcf9-55ed-4893-85f4-7595c6df0400 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] Acquiring lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG nova.compute.manager [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] No waiting events found dispatching network-vif-plugged-2789bcf9-55ed-4893-85f4-7595c6df0400 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:39:53 user nova-compute[231753]: WARNING nova.compute.manager [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received unexpected event network-vif-plugged-2789bcf9-55ed-4893-85f4-7595c6df0400 for instance with vm_state active and task_state deleting.
Jul 29 13:39:53 user nova-compute[231753]: DEBUG nova.compute.manager [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-unplugged-f0ade4f6-225a-4c66-a2f5-d5793cfa7a96 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] Acquiring lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG nova.compute.manager [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] No waiting events found dispatching network-vif-unplugged-f0ade4f6-225a-4c66-a2f5-d5793cfa7a96 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG nova.compute.manager [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-unplugged-f0ade4f6-225a-4c66-a2f5-d5793cfa7a96 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG nova.compute.manager [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-plugged-f0ade4f6-225a-4c66-a2f5-d5793cfa7a96 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] Acquiring lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG nova.compute.manager [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] No waiting events found dispatching network-vif-plugged-f0ade4f6-225a-4c66-a2f5-d5793cfa7a96 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:39:53 user nova-compute[231753]: WARNING nova.compute.manager [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received unexpected event network-vif-plugged-f0ade4f6-225a-4c66-a2f5-d5793cfa7a96 for instance with vm_state active and task_state deleting.
Jul 29 13:39:53 user nova-compute[231753]: DEBUG nova.compute.manager [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-unplugged-a4a0b15f-494b-4934-8b4f-fb8df577a60d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] Acquiring lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG nova.compute.manager [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] No waiting events found dispatching network-vif-unplugged-a4a0b15f-494b-4934-8b4f-fb8df577a60d {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG nova.compute.manager [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-unplugged-a4a0b15f-494b-4934-8b4f-fb8df577a60d for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG nova.compute.manager [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-plugged-a4a0b15f-494b-4934-8b4f-fb8df577a60d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] Acquiring lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG nova.compute.manager [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] No waiting events found dispatching network-vif-plugged-a4a0b15f-494b-4934-8b4f-fb8df577a60d {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:39:53 user nova-compute[231753]: WARNING nova.compute.manager [req-ee2e96af-21aa-4d91-bbcb-fe9a31fe1b9f req-398b42da-8dc5-4af8-a883-489323551b3b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received unexpected event network-vif-plugged-a4a0b15f-494b-4934-8b4f-fb8df577a60d for instance with vm_state active and task_state deleting.
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fb4990-9fa0-4d3c-86d8-059b78bfc647]: (4, ('Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0, portal: 172.16.0.220,3260]\nLogout of [sid: 19, target: iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0, portal: 172.16.0.220,3260]
Jul 29 13:39:53 user nova-compute[231753]: Logout of [sid: 19, target: iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0, portal: 172.16.0.220,3260] successful.
Jul 29 13:39:53 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b82c6905-a234-45d8-945c-ab8abef447d0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce17898-02ee-4aae-b66e-d3b164e8cf23]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.429s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] <== disconnect_volume: return (430ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FkLqNyZH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:39:53 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[94710d28-05c6-4afb-9054-3b928dabfbd3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:39:53 user nova-compute[231753]: No targets found.
Jul 29 13:39:53 user nova-compute[231753]: iSNS:
Jul 29 13:39:53 user nova-compute[231753]: No targets found.
Jul 29 13:39:53 user nova-compute[231753]: STATIC:
Jul 29 13:39:53 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4
Jul 29 13:39:53 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:39:53 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:39:53 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3
Jul 29 13:39:53 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:39:53 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:39:53 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7
Jul 29 13:39:53 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:39:53 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:39:53 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be
Jul 29 13:39:53 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:39:53 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:39:53 user nova-compute[231753]: FIRMWARE:
Jul 29 13:39:53 user nova-compute[231753]: No targets found.
Jul 29 13:39:53 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:39:53 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:39:53 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[234ba164-c65e-40ba-89db-f02510d37d87]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[54faf858-b64a-4d17-8f24-e36307619018]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)\ntcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:39:53 user nova-compute[231753]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be (non-flash)
Jul 29 13:39:53 user nova-compute[231753]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 (non-flash)
Jul 29 13:39:53 user nova-compute[231753]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:39:53 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:39:53 user nova-compute[231753]: tcp: [20] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be (non-flash)
Jul 29 13:39:53 user nova-compute[231753]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 (non-flash)
Jul 29 13:39:53 user nova-compute[231753]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:39:53 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c8073c820>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be'): ({'sdg'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Removing single pathed devices sdg {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3525067-f896-4301-88de-65ac475d0ab1]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f16b3ff-73bf-4517-a6c5-6610ce85cdfc]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Flushing IO for device /dev/sdg {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.027s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb960337-35b1-4bd6-a8f8-0b616d265cf7]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.078s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[011f6f51-6f7c-4870-ac85-ac851f3aaad2]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] SCSI volumes sdg have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[1698181c-bfa5-471b-9070-210bbc2fc0f8]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be -p 172.16.0.220:3260 --logout" returned: 0 in 0.080s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01f42dd-b6fd-42c6-922f-1437afd68277]: (4, ('Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be, portal: 172.16.0.220,3260]\nLogout of [sid: 20, target: iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be, portal: 172.16.0.220,3260]
Jul 29 13:39:53 user nova-compute[231753]: Logout of [sid: 20, target: iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be, portal: 172.16.0.220,3260] successful.
Jul 29 13:39:53 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84ca643c-1d19-4f8d-b0a5-25eb9179b1be -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b2a849f-9ce5-4a55-a36d-2d9119c0a14b]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] <== disconnect_volume: return (389ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'enLdoxWs', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': True}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:39:53 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9895e201-445b-425a-a272-d49aa5eb9434]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:39:53 user nova-compute[231753]: No targets found.
Jul 29 13:39:53 user nova-compute[231753]: iSNS:
Jul 29 13:39:53 user nova-compute[231753]: No targets found.
Jul 29 13:39:53 user nova-compute[231753]: STATIC:
Jul 29 13:39:53 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4
Jul 29 13:39:53 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:39:53 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:39:53 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3
Jul 29 13:39:53 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:39:53 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:39:53 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7
Jul 29 13:39:53 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:39:53 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:39:53 user nova-compute[231753]: FIRMWARE:
Jul 29 13:39:53 user nova-compute[231753]: No targets found.
Jul 29 13:39:53 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:39:53 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:39:53 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[eadb9a42-10b1-4d18-94d0-4c6221aceb33]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[246101c1-8b72-4567-99b2-0951d4df9fed]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)\ntcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:39:53 user nova-compute[231753]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 (non-flash)
Jul 29 13:39:53 user nova-compute[231753]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:39:53 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:39:53 user nova-compute[231753]: tcp: [21] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 (non-flash)
Jul 29 13:39:53 user nova-compute[231753]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:39:53 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c9832b9a0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3'): ({'sdh'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Removing single pathed devices sdh {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[acbad0fa-e625-42ec-9dd2-1377dc4d4b82]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc1bb56f-00e5-44be-9197-0614969e1939]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Flushing IO for device /dev/sdh {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.012s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e87c0faf-d0c2-46ad-ac6b-4b4115f5597f]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.046s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[455e0185-3c7e-400e-a861-2421881c6e3d]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] SCSI volumes sdh have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0304fd8f-75df-4c39-97ff-4f4a541a676c]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 -p 172.16.0.220:3260 --logout" returned: 0 in 0.051s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e505146-f418-4e26-8c69-2e36e11a004e]: (4, ('Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3, portal: 172.16.0.220,3260]\nLogout of [sid: 21, target: iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3, portal: 172.16.0.220,3260]
Jul 29 13:39:53 user nova-compute[231753]: Logout of [sid: 21, target: iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3, portal: 172.16.0.220,3260] successful.
Jul 29 13:39:53 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:845a966e-2db8-49d3-b406-6a630cd840b3 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b6d8a1-7b97-493b-aed6-68046a49491f]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.282s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] <== disconnect_volume: return (283ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:39:53 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Deleting instance files /opt/stack/data/nova/instances/894f5e40-e585-41c0-9dd8-e94d8a9400ef_del
Jul 29 13:39:53 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Deletion of /opt/stack/data/nova/instances/894f5e40-e585-41c0-9dd8-e94d8a9400ef_del complete
Jul 29 13:39:53 user nova-compute[231753]: INFO nova.compute.manager [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Took 3.42 seconds to destroy the instance on the hypervisor.
Jul 29 13:39:53 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:39:53 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:39:55 user nova-compute[231753]: DEBUG nova.compute.manager [req-ea6bd28e-9cbb-4b18-bfc0-417292a18989 req-64807c19-b15e-44d7-a773-cd1c936704b9 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-deleted-a4a0b15f-494b-4934-8b4f-fb8df577a60d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:39:55 user nova-compute[231753]: INFO nova.compute.manager [req-ea6bd28e-9cbb-4b18-bfc0-417292a18989 req-64807c19-b15e-44d7-a773-cd1c936704b9 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Neutron deleted interface a4a0b15f-494b-4934-8b4f-fb8df577a60d; detaching it from the instance and deleting it from the info cache
Jul 29 13:39:55 user nova-compute[231753]: DEBUG nova.network.neutron [req-ea6bd28e-9cbb-4b18-bfc0-417292a18989 req-64807c19-b15e-44d7-a773-cd1c936704b9 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Updating instance_info_cache with network_info: [{"id": "984d64db-ae0d-45be-a0cd-3bcc5b00008b", "address": "fa:16:3e:4f:92:db", "network": {"id": "322b52d5-b11a-4c3c-a30b-adfbfee8d1b2", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-1087548543-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap984d64db-ae", "ovs_interfaceid": "984d64db-ae0d-45be-a0cd-3bcc5b00008b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "dcd40805-07c1-45d2-a795-f3085231f735", "address": "fa:16:3e:b4:73:7b", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcd40805-07", "ovs_interfaceid": "dcd40805-07c1-45d2-a795-f3085231f735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a95b92c-9a5b-4fd4-bbfd-36063a073c11", "address": "fa:16:3e:ff:85:55", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a95b92c-9a", "ovs_interfaceid": "4a95b92c-9a5b-4fd4-bbfd-36063a073c11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2789bcf9-55ed-4893-85f4-7595c6df0400", "address": "fa:16:3e:ae:53:f8", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2789bcf9-55", "ovs_interfaceid": "2789bcf9-55ed-4893-85f4-7595c6df0400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0ade4f6-225a-4c66-a2f5-d5793cfa7a96", "address": "fa:16:3e:43:c1:d4", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ade4f6-22", "ovs_interfaceid": "f0ade4f6-225a-4c66-a2f5-d5793cfa7a96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a795944f-ca69-4b3d-90b6-bf61d16fa1a8", "address": "fa:16:3e:47:62:b3", "network": {"id": "d45dd21d-a9cd-4c70-9b98-aae5f9179d8c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1287922789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa795944f-ca", "ovs_interfaceid": "a795944f-ca69-4b3d-90b6-bf61d16fa1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:39:55 user nova-compute[231753]: DEBUG nova.compute.manager [req-ea6bd28e-9cbb-4b18-bfc0-417292a18989 req-64807c19-b15e-44d7-a773-cd1c936704b9 service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Detach interface failed, port_id=a4a0b15f-494b-4934-8b4f-fb8df577a60d, reason: Instance 894f5e40-e585-41c0-9dd8-e94d8a9400ef could not be found. {{(pid=231753) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 13:39:57 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:57 user nova-compute[231753]: DEBUG nova.compute.manager [req-e8f37ded-d5f3-46de-9838-c7e3eb687742 req-325e10f8-228b-469d-b206-000f95bc417b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-deleted-984d64db-ae0d-45be-a0cd-3bcc5b00008b {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:39:57 user nova-compute[231753]: INFO nova.compute.manager [req-e8f37ded-d5f3-46de-9838-c7e3eb687742 req-325e10f8-228b-469d-b206-000f95bc417b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Neutron deleted interface 984d64db-ae0d-45be-a0cd-3bcc5b00008b; detaching it from the instance and deleting it from the info cache
Jul 29 13:39:57 user nova-compute[231753]: DEBUG nova.network.neutron [req-e8f37ded-d5f3-46de-9838-c7e3eb687742 req-325e10f8-228b-469d-b206-000f95bc417b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Updating instance_info_cache with network_info: [{"id": "dcd40805-07c1-45d2-a795-f3085231f735", "address": "fa:16:3e:b4:73:7b", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcd40805-07", "ovs_interfaceid": "dcd40805-07c1-45d2-a795-f3085231f735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a95b92c-9a5b-4fd4-bbfd-36063a073c11", "address": "fa:16:3e:ff:85:55", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a95b92c-9a", "ovs_interfaceid": "4a95b92c-9a5b-4fd4-bbfd-36063a073c11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "2789bcf9-55ed-4893-85f4-7595c6df0400", "address": "fa:16:3e:ae:53:f8", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.128", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2789bcf9-55", "ovs_interfaceid": "2789bcf9-55ed-4893-85f4-7595c6df0400", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "f0ade4f6-225a-4c66-a2f5-d5793cfa7a96", "address": "fa:16:3e:43:c1:d4", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ade4f6-22", "ovs_interfaceid": "f0ade4f6-225a-4c66-a2f5-d5793cfa7a96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a795944f-ca69-4b3d-90b6-bf61d16fa1a8", "address": "fa:16:3e:47:62:b3", "network": {"id": "d45dd21d-a9cd-4c70-9b98-aae5f9179d8c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1287922789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa795944f-ca", "ovs_interfaceid": "a795944f-ca69-4b3d-90b6-bf61d16fa1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:39:57 user nova-compute[231753]: DEBUG nova.compute.manager [req-e8f37ded-d5f3-46de-9838-c7e3eb687742 req-325e10f8-228b-469d-b206-000f95bc417b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Detach interface failed, port_id=984d64db-ae0d-45be-a0cd-3bcc5b00008b, reason: Instance 894f5e40-e585-41c0-9dd8-e94d8a9400ef could not be found. {{(pid=231753) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 13:39:57 user nova-compute[231753]: DEBUG nova.compute.manager [req-e8f37ded-d5f3-46de-9838-c7e3eb687742 req-325e10f8-228b-469d-b206-000f95bc417b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-deleted-2789bcf9-55ed-4893-85f4-7595c6df0400 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:39:57 user nova-compute[231753]: INFO nova.compute.manager [req-e8f37ded-d5f3-46de-9838-c7e3eb687742 req-325e10f8-228b-469d-b206-000f95bc417b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Neutron deleted interface 2789bcf9-55ed-4893-85f4-7595c6df0400; detaching it from the instance and deleting it from the info cache
Jul 29 13:39:57 user nova-compute[231753]: DEBUG nova.network.neutron [req-e8f37ded-d5f3-46de-9838-c7e3eb687742 req-325e10f8-228b-469d-b206-000f95bc417b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Updating instance_info_cache with network_info: [{"id": "dcd40805-07c1-45d2-a795-f3085231f735", "address": "fa:16:3e:b4:73:7b", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.182", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcd40805-07", "ovs_interfaceid": "dcd40805-07c1-45d2-a795-f3085231f735", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "4a95b92c-9a5b-4fd4-bbfd-36063a073c11", "address": "fa:16:3e:ff:85:55", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.224", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4a95b92c-9a", "ovs_interfaceid": "4a95b92c-9a5b-4fd4-bbfd-36063a073c11", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f0ade4f6-225a-4c66-a2f5-d5793cfa7a96", "address": "fa:16:3e:43:c1:d4", "network": {"id": "022a1d0e-dd19-41f2-9079-ce71ed9530cf", "bridge": "br-int", "label": "tempest-device-tagging-net1-622135304", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.35", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.1.1.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapf0ade4f6-22", "ovs_interfaceid": "f0ade4f6-225a-4c66-a2f5-d5793cfa7a96", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "a795944f-ca69-4b3d-90b6-bf61d16fa1a8", "address": "fa:16:3e:47:62:b3", "network": {"id": "d45dd21d-a9cd-4c70-9b98-aae5f9179d8c", "bridge": "br-int", "label": "tempest-device-tagging-net2-1287922789", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.2.2.1"}}], "meta": {"injected": false, "tenant_id": "11bd37c7c8524d2b961e5b1aa1e92e9e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa795944f-ca", "ovs_interfaceid": "a795944f-ca69-4b3d-90b6-bf61d16fa1a8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:39:57 user nova-compute[231753]: DEBUG nova.compute.manager [req-e8f37ded-d5f3-46de-9838-c7e3eb687742 req-325e10f8-228b-469d-b206-000f95bc417b service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Detach interface failed, port_id=2789bcf9-55ed-4893-85f4-7595c6df0400, reason: Instance 894f5e40-e585-41c0-9dd8-e94d8a9400ef could not be found. {{(pid=231753) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 13:39:58 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:39:58 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Took 4.58 seconds to deallocate network for instance.
Jul 29 13:39:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:39:59 user nova-compute[231753]: DEBUG nova.compute.manager [req-266acac5-b9cc-4495-b99b-ed27c43b864b req-f3ace5b3-0032-4d5a-bdb5-d3c208131b5e service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-deleted-f0ade4f6-225a-4c66-a2f5-d5793cfa7a96 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:39:59 user nova-compute[231753]: DEBUG nova.compute.manager [req-266acac5-b9cc-4495-b99b-ed27c43b864b req-f3ace5b3-0032-4d5a-bdb5-d3c208131b5e service nova] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Received event network-vif-deleted-a795944f-ca69-4b3d-90b6-bf61d16fa1a8 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:40:00 user nova-compute[231753]: DEBUG nova.compute.manager [None req-584de11a-6b44-4d57-b101-701bc5c18cd9 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:40:00 user nova-compute[231753]: INFO nova.compute.manager [None req-584de11a-6b44-4d57-b101-701bc5c18cd9 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] instance snapshotting
Jul 29 13:40:00 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-584de11a-6b44-4d57-b101-701bc5c18cd9 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Beginning live snapshot process
Jul 29 13:40:00 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-584de11a-6b44-4d57-b101-701bc5c18cd9 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json -f qcow2 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:00 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-584de11a-6b44-4d57-b101-701bc5c18cd9 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json -f qcow2" returned: 0 in 0.143s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:00 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-584de11a-6b44-4d57-b101-701bc5c18cd9 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json -f qcow2 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:00 user nova-compute[231753]: INFO nova.compute.manager [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Took 2.27 seconds to detach 3 volumes for instance.
Jul 29 13:40:00 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-584de11a-6b44-4d57-b101-701bc5c18cd9 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json -f qcow2" returned: 0 in 0.153s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:00 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-584de11a-6b44-4d57-b101-701bc5c18cd9 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:40:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.003s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:40:00 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-584de11a-6b44-4d57-b101-701bc5c18cd9 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.133s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:00 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-584de11a-6b44-4d57-b101-701bc5c18cd9 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp01r0elg7/0d68f7eecb0c4631b48169ca375fc034.delta 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:00 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-584de11a-6b44-4d57-b101-701bc5c18cd9 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmp01r0elg7/0d68f7eecb0c4631b48169ca375fc034.delta 1073741824" returned: 0 in 0.050s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:00 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-584de11a-6b44-4d57-b101-701bc5c18cd9 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 29 13:40:00 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:40:00 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:40:01 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.374s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:40:01 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Deleted allocations for instance 894f5e40-e585-41c0-9dd8-e94d8a9400ef
Jul 29 13:40:01 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-51227630-c5e2-4b05-b2c4-0c9b8175affa tempest-TaggedBootDevicesTest_v242-1447223842 tempest-TaggedBootDevicesTest_v242-1447223842-project-member] Lock "894f5e40-e585-41c0-9dd8-e94d8a9400ef" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 10.875s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:40:01 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-584de11a-6b44-4d57-b101-701bc5c18cd9 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] COPY block job progress, current cursor: 65536 final cursor: 75497472 {{(pid=231753) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 13:40:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-584de11a-6b44-4d57-b101-701bc5c18cd9 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] COPY block job progress, current cursor: 17563648 final cursor: 75497472 {{(pid=231753) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 13:40:02 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690637987.142223, 4475f276-acc4-44f1-a5fa-6a7fb2165493 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:40:02 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] VM Stopped (Lifecycle Event)
Jul 29 13:40:02 user nova-compute[231753]: DEBUG nova.compute.manager [None req-394a27fc-5de4-4e4d-9aa4-449cd7a0f775 None None] [instance: 4475f276-acc4-44f1-a5fa-6a7fb2165493] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:40:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-584de11a-6b44-4d57-b101-701bc5c18cd9 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=231753) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 13:40:02 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-584de11a-6b44-4d57-b101-701bc5c18cd9 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 29 13:40:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:02 user nova-compute[231753]: DEBUG nova.privsep.utils [None req-584de11a-6b44-4d57-b101-701bc5c18cd9 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=231753) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 29 13:40:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-584de11a-6b44-4d57-b101-701bc5c18cd9 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp01r0elg7/0d68f7eecb0c4631b48169ca375fc034.delta /opt/stack/data/nova/instances/snapshots/tmp01r0elg7/0d68f7eecb0c4631b48169ca375fc034 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:03 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-584de11a-6b44-4d57-b101-701bc5c18cd9 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmp01r0elg7/0d68f7eecb0c4631b48169ca375fc034.delta /opt/stack/data/nova/instances/snapshots/tmp01r0elg7/0d68f7eecb0c4631b48169ca375fc034" returned: 0 in 0.593s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:03 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-584de11a-6b44-4d57-b101-701bc5c18cd9 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Snapshot extracted, beginning image upload
Jul 29 13:40:04 user nova-compute[231753]: DEBUG nova.compute.manager [req-03b6c592-28f2-4ee9-a206-bd714ce08fe9 req-b4ce6c19-dd85-4708-901b-c15c2eaf0695 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Received event network-changed-20213688-43ed-4115-bd0d-bc74791d95c4 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:40:04 user nova-compute[231753]: DEBUG nova.compute.manager [req-03b6c592-28f2-4ee9-a206-bd714ce08fe9 req-b4ce6c19-dd85-4708-901b-c15c2eaf0695 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Refreshing instance network info cache due to event network-changed-20213688-43ed-4115-bd0d-bc74791d95c4. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:40:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-03b6c592-28f2-4ee9-a206-bd714ce08fe9 req-b4ce6c19-dd85-4708-901b-c15c2eaf0695 service nova] Acquiring lock "refresh_cache-55bfcd1f-2b51-4e10-84a3-e132b96111e3" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:40:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-03b6c592-28f2-4ee9-a206-bd714ce08fe9 req-b4ce6c19-dd85-4708-901b-c15c2eaf0695 service nova] Acquired lock "refresh_cache-55bfcd1f-2b51-4e10-84a3-e132b96111e3" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:40:04 user nova-compute[231753]: DEBUG nova.network.neutron [req-03b6c592-28f2-4ee9-a206-bd714ce08fe9 req-b4ce6c19-dd85-4708-901b-c15c2eaf0695 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Refreshing network info cache for port 20213688-43ed-4115-bd0d-bc74791d95c4 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:40:05 user nova-compute[231753]: DEBUG nova.network.neutron [req-03b6c592-28f2-4ee9-a206-bd714ce08fe9 req-b4ce6c19-dd85-4708-901b-c15c2eaf0695 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Updated VIF entry in instance network info cache for port 20213688-43ed-4115-bd0d-bc74791d95c4. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:40:05 user nova-compute[231753]: DEBUG nova.network.neutron [req-03b6c592-28f2-4ee9-a206-bd714ce08fe9 req-b4ce6c19-dd85-4708-901b-c15c2eaf0695 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Updating instance_info_cache with network_info: [{"id": "20213688-43ed-4115-bd0d-bc74791d95c4", "address": "fa:16:3e:5b:23:7c", "network": {"id": "e8ad7fa5-6e98-46f4-8062-0b9eddaa76a6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-253010414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b08b115e89482f9b81e621485c5eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20213688-43", "ovs_interfaceid": "20213688-43ed-4115-bd0d-bc74791d95c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:40:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-03b6c592-28f2-4ee9-a206-bd714ce08fe9 req-b4ce6c19-dd85-4708-901b-c15c2eaf0695 service nova] Releasing lock "refresh_cache-55bfcd1f-2b51-4e10-84a3-e132b96111e3" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:40:05 user nova-compute[231753]: DEBUG nova.compute.manager [None req-845f208b-d713-4fe1-9644-44251d3e4724 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:40:05 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-584de11a-6b44-4d57-b101-701bc5c18cd9 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Snapshot image upload complete
Jul 29 13:40:05 user nova-compute[231753]: INFO nova.compute.manager [None req-584de11a-6b44-4d57-b101-701bc5c18cd9 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Took 5.73 seconds to snapshot the instance on the hypervisor.
Jul 29 13:40:05 user nova-compute[231753]: INFO nova.compute.manager [None req-845f208b-d713-4fe1-9644-44251d3e4724 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] instance snapshotting
Jul 29 13:40:05 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-845f208b-d713-4fe1-9644-44251d3e4724 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Beginning live snapshot process
Jul 29 13:40:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-845f208b-d713-4fe1-9644-44251d3e4724 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk --force-share --output=json -f qcow2 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-845f208b-d713-4fe1-9644-44251d3e4724 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk --force-share --output=json -f qcow2" returned: 0 in 0.133s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-845f208b-d713-4fe1-9644-44251d3e4724 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk --force-share --output=json -f qcow2 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:06 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:40:06 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:40:06 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:40:06 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 13:40:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-845f208b-d713-4fe1-9644-44251d3e4724 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk --force-share --output=json -f qcow2" returned: 0 in 0.139s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-845f208b-d713-4fe1-9644-44251d3e4724 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-845f208b-d713-4fe1-9644-44251d3e4724 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.135s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-845f208b-d713-4fe1-9644-44251d3e4724 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpe_el4yig/24c071c83b7843208af957f7b348cdb1.delta 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-845f208b-d713-4fe1-9644-44251d3e4724 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpe_el4yig/24c071c83b7843208af957f7b348cdb1.delta 1073741824" returned: 0 in 0.046s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:06 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-845f208b-d713-4fe1-9644-44251d3e4724 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 29 13:40:07 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690637992.1228147, 894f5e40-e585-41c0-9dd8-e94d8a9400ef => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:40:07 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] VM Stopped (Lifecycle Event)
Jul 29 13:40:07 user nova-compute[231753]: DEBUG nova.compute.manager [None req-4c2e948c-f3b9-4b86-9401-9a6974e39751 None None] [instance: 894f5e40-e585-41c0-9dd8-e94d8a9400ef] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:40:07 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-845f208b-d713-4fe1-9644-44251d3e4724 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=231753) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 13:40:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:40:07 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-845f208b-d713-4fe1-9644-44251d3e4724 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=231753) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 13:40:07 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-845f208b-d713-4fe1-9644-44251d3e4724 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 29 13:40:07 user nova-compute[231753]: DEBUG nova.privsep.utils [None req-845f208b-d713-4fe1-9644-44251d3e4724 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=231753) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 29 13:40:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-845f208b-d713-4fe1-9644-44251d3e4724 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpe_el4yig/24c071c83b7843208af957f7b348cdb1.delta /opt/stack/data/nova/instances/snapshots/tmpe_el4yig/24c071c83b7843208af957f7b348cdb1 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:08 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:40:08 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:40:08 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:40:08 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:40:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:40:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:40:08 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 13:40:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-845f208b-d713-4fe1-9644-44251d3e4724 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpe_el4yig/24c071c83b7843208af957f7b348cdb1.delta /opt/stack/data/nova/instances/snapshots/tmpe_el4yig/24c071c83b7843208af957f7b348cdb1" returned: 0 in 0.521s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:08 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-845f208b-d713-4fe1-9644-44251d3e4724 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Snapshot extracted, beginning image upload
Jul 29 13:40:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1cc70bf0-c4af-434b-9151-a3993f995bb6 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:40:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1cc70bf0-c4af-434b-9151-a3993f995bb6 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:40:08 user nova-compute[231753]: INFO nova.compute.manager [None req-1cc70bf0-c4af-434b-9151-a3993f995bb6 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Detaching volume ff96d4b8-97db-4db7-821f-a3a64b4be6f7
Jul 29 13:40:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:08 user nova-compute[231753]: INFO nova.virt.block_device [None req-1cc70bf0-c4af-434b-9151-a3993f995bb6 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Attempting to driver detach volume ff96d4b8-97db-4db7-821f-a3a64b4be6f7 from mountpoint /dev/vdb
Jul 29 13:40:08 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-1cc70bf0-c4af-434b-9151-a3993f995bb6 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Attempting to detach device vdb from instance 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb from the persistent domain config. {{(pid=231753) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 13:40:08 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-1cc70bf0-c4af-434b-9151-a3993f995bb6 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:40:08 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:40:08 user nova-compute[231753]:   <source dev="/dev/sdc"/>
Jul 29 13:40:08 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:40:08 user nova-compute[231753]:   <serial>ff96d4b8-97db-4db7-821f-a3a64b4be6f7</serial>
Jul 29 13:40:08 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 29 13:40:08 user nova-compute[231753]: </disk>
Jul 29 13:40:08 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:40:08 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-1cc70bf0-c4af-434b-9151-a3993f995bb6 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Successfully detached device vdb from instance 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb from the persistent domain config.
Jul 29 13:40:08 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-1cc70bf0-c4af-434b-9151-a3993f995bb6 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb from the live domain config. {{(pid=231753) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 13:40:08 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-1cc70bf0-c4af-434b-9151-a3993f995bb6 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:40:08 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:40:08 user nova-compute[231753]:   <source dev="/dev/sdc"/>
Jul 29 13:40:08 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:40:08 user nova-compute[231753]:   <serial>ff96d4b8-97db-4db7-821f-a3a64b4be6f7</serial>
Jul 29 13:40:08 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 29 13:40:08 user nova-compute[231753]: </disk>
Jul 29 13:40:08 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:40:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:08 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:40:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Acquiring lock "aa8c3210-37e5-4e33-8ea4-98a70fa9800b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "aa8c3210-37e5-4e33-8ea4-98a70fa9800b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG nova.compute.manager [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:40:09 user nova-compute[231753]: INFO nova.compute.claims [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Claim successful on node user
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Received event <DeviceRemovedEvent: 1690638009.217213, 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=231753) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-1cc70bf0-c4af-434b-9151-a3993f995bb6 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb {{(pid=231753) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 13:40:09 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-1cc70bf0-c4af-434b-9151-a3993f995bb6 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Successfully detached device vdb from instance 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb from the live domain config.
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cc70bf0-c4af-434b-9151-a3993f995bb6 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc70bf0-c4af-434b-9151-a3993f995bb6 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rywvfqid', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:40:09 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-1cc70bf0-c4af-434b-9151-a3993f995bb6 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:40:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-1cc70bf0-c4af-434b-9151-a3993f995bb6 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-1cc70bf0-c4af-434b-9151-a3993f995bb6 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e26fbf0b-fc9e-4cd8-ad3a-30d0c3667780]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc70bf0-c4af-434b-9151-a3993f995bb6 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:40:09 user nova-compute[231753]: No targets found.
Jul 29 13:40:09 user nova-compute[231753]: iSNS:
Jul 29 13:40:09 user nova-compute[231753]: No targets found.
Jul 29 13:40:09 user nova-compute[231753]: STATIC:
Jul 29 13:40:09 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4
Jul 29 13:40:09 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:40:09 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:40:09 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7
Jul 29 13:40:09 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:40:09 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:40:09 user nova-compute[231753]: FIRMWARE:
Jul 29 13:40:09 user nova-compute[231753]: No targets found.
Jul 29 13:40:09 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc70bf0-c4af-434b-9151-a3993f995bb6 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:40:09 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:40:09 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc70bf0-c4af-434b-9151-a3993f995bb6 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d7ebb16-e84c-4151-90be-7c49186d7bc7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c214dff5-6621-4c22-98cb-53b75dd31a8f]: (4, ('tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)\ntcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc70bf0-c4af-434b-9151-a3993f995bb6 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:40:09 user nova-compute[231753]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:40:09 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc70bf0-c4af-434b-9151-a3993f995bb6 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsi session list stdout=tcp: [16] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 (non-flash)
Jul 29 13:40:09 user nova-compute[231753]: tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:40:09 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc70bf0-c4af-434b-9151-a3993f995bb6 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ca67b6e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7'): ({'sdc'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-1cc70bf0-c4af-434b-9151-a3993f995bb6 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Removing single pathed devices sdc {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c5ef612-67ea-4ffe-85a0-8e50b701def6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[712a54a7-49fe-4707-8d46-b588194b23c1]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-1cc70bf0-c4af-434b-9151-a3993f995bb6 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Flushing IO for device /dev/sdc {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7c9f18-260a-40bd-bf43-b0bc65968f83]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-1cc70bf0-c4af-434b-9151-a3993f995bb6 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.052s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[904d921a-6d11-461b-9e52-96dd2cd842c4]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-1cc70bf0-c4af-434b-9151-a3993f995bb6 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-1cc70bf0-c4af-434b-9151-a3993f995bb6 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] SCSI volumes sdc have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc70bf0-c4af-434b-9151-a3993f995bb6 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5491c514-4b97-4011-b067-d5e37a5ae9ff]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc70bf0-c4af-434b-9151-a3993f995bb6 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fc740c-b097-4d88-bd4e-5bd306ea0e25]: (4, ('Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7, portal: 172.16.0.220,3260]\nLogout of [sid: 16, target: iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc70bf0-c4af-434b-9151-a3993f995bb6 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7, portal: 172.16.0.220,3260]
Jul 29 13:40:09 user nova-compute[231753]: Logout of [sid: 16, target: iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7, portal: 172.16.0.220,3260] successful.
Jul 29 13:40:09 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ff96d4b8-97db-4db7-821f-a3a64b4be6f7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e10aa84c-e77e-4ff5-bf4a-3c956959be59]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc70bf0-c4af-434b-9151-a3993f995bb6 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-1cc70bf0-c4af-434b-9151-a3993f995bb6 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.414s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc70bf0-c4af-434b-9151-a3993f995bb6 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] <== disconnect_volume: return (416ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cc70bf0-c4af-434b-9151-a3993f995bb6 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.585s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG nova.compute.manager [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG nova.compute.manager [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG nova.network.neutron [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:40:09 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG nova.compute.manager [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG nova.policy [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2c57d05306648e786200a93a121966e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cdd0f16e49ef48ff99752b6aec718358', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG nova.compute.manager [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:40:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:40:09 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Creating image(s)
Jul 29 13:40:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Acquiring lock "/opt/stack/data/nova/instances/aa8c3210-37e5-4e33-8ea4-98a70fa9800b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "/opt/stack/data/nova/instances/aa8c3210-37e5-4e33-8ea4-98a70fa9800b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "/opt/stack/data/nova/instances/aa8c3210-37e5-4e33-8ea4-98a70fa9800b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.137s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.147s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/aa8c3210-37e5-4e33-8ea4-98a70fa9800b/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json" returned: 0 in 0.185s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/aa8c3210-37e5-4e33-8ea4-98a70fa9800b/disk 1073741824" returned: 0 in 0.139s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.292s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG nova.objects.instance [None req-1cc70bf0-c4af-434b-9151-a3993f995bb6 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lazy-loading 'flavor' on Instance uuid 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json" returned: 0 in 0.142s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1cc70bf0-c4af-434b-9151-a3993f995bb6 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.893s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.153s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aa8c3210-37e5-4e33-8ea4-98a70fa9800b/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8c3210-37e5-4e33-8ea4-98a70fa9800b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8c3210-37e5-4e33-8ea4-98a70fa9800b/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Cannot resize image /opt/stack/data/nova/instances/aa8c3210-37e5-4e33-8ea4-98a70fa9800b/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG nova.objects.instance [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lazy-loading 'migration_context' on Instance uuid aa8c3210-37e5-4e33-8ea4-98a70fa9800b {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG nova.network.neutron [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Successfully created port: 980d6903-8cea-4a60-bd44-e8a7343d991f {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Ensure instance console log exists: /opt/stack/data/nova/instances/aa8c3210-37e5-4e33-8ea4-98a70fa9800b/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:10 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-845f208b-d713-4fe1-9644-44251d3e4724 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Snapshot image upload complete
Jul 29 13:40:10 user nova-compute[231753]: INFO nova.compute.manager [None req-845f208b-d713-4fe1-9644-44251d3e4724 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Took 5.06 seconds to snapshot the instance on the hypervisor.
Jul 29 13:40:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:11 user nova-compute[231753]: DEBUG nova.network.neutron [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Successfully updated port: 980d6903-8cea-4a60-bd44-e8a7343d991f {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:40:11 user nova-compute[231753]: DEBUG nova.compute.manager [req-c0688d13-fcc0-4b68-859e-69d4b2fdc627 req-d49e7988-a20a-4937-b32f-8de7a9487a6a service nova] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Received event network-changed-980d6903-8cea-4a60-bd44-e8a7343d991f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:40:11 user nova-compute[231753]: DEBUG nova.compute.manager [req-c0688d13-fcc0-4b68-859e-69d4b2fdc627 req-d49e7988-a20a-4937-b32f-8de7a9487a6a service nova] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Refreshing instance network info cache due to event network-changed-980d6903-8cea-4a60-bd44-e8a7343d991f. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:40:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c0688d13-fcc0-4b68-859e-69d4b2fdc627 req-d49e7988-a20a-4937-b32f-8de7a9487a6a service nova] Acquiring lock "refresh_cache-aa8c3210-37e5-4e33-8ea4-98a70fa9800b" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:40:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c0688d13-fcc0-4b68-859e-69d4b2fdc627 req-d49e7988-a20a-4937-b32f-8de7a9487a6a service nova] Acquired lock "refresh_cache-aa8c3210-37e5-4e33-8ea4-98a70fa9800b" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:40:11 user nova-compute[231753]: DEBUG nova.network.neutron [req-c0688d13-fcc0-4b68-859e-69d4b2fdc627 req-d49e7988-a20a-4937-b32f-8de7a9487a6a service nova] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Refreshing network info cache for port 980d6903-8cea-4a60-bd44-e8a7343d991f {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:40:11 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:40:11 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:40:11 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=7380MB free_disk=25.352787017822266GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 13:40:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:40:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:40:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Acquiring lock "refresh_cache-aa8c3210-37e5-4e33-8ea4-98a70fa9800b" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:40:11 user nova-compute[231753]: DEBUG nova.network.neutron [req-c0688d13-fcc0-4b68-859e-69d4b2fdc627 req-d49e7988-a20a-4937-b32f-8de7a9487a6a service nova] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:40:11 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:40:11 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b67b98f8-a7b3-499e-ba32-9520bbced960 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:40:11 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 7e2615c1-b03e-4076-bcd9-3585fb11b8ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:40:11 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8ea52d41-7ec3-44d7-8421-133000ee887b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:40:11 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 63fad324-aac2-4d60-b4ce-a32a5736657d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:40:11 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance cf326e80-7293-4764-9411-ed05a5aeba23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:40:11 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 55bfcd1f-2b51-4e10-84a3-e132b96111e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:40:11 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 481435b2-4319-4caf-aa5b-5c986a747258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:40:11 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance aa8c3210-37e5-4e33-8ea4-98a70fa9800b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:40:11 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 13:40:11 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG nova.network.neutron [req-c0688d13-fcc0-4b68-859e-69d4b2fdc627 req-d49e7988-a20a-4937-b32f-8de7a9487a6a service nova] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c0688d13-fcc0-4b68-859e-69d4b2fdc627 req-d49e7988-a20a-4937-b32f-8de7a9487a6a service nova] Releasing lock "refresh_cache-aa8c3210-37e5-4e33-8ea4-98a70fa9800b" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Acquired lock "refresh_cache-aa8c3210-37e5-4e33-8ea4-98a70fa9800b" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG nova.network.neutron [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG nova.network.neutron [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.449s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG nova.network.neutron [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Updating instance_info_cache with network_info: [{"id": "980d6903-8cea-4a60-bd44-e8a7343d991f", "address": "fa:16:3e:e7:5e:eb", "network": {"id": "7f0a516e-a6d1-4198-b7f7-d1eef96625cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-408682612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd0f16e49ef48ff99752b6aec718358", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap980d6903-8c", "ovs_interfaceid": "980d6903-8cea-4a60-bd44-e8a7343d991f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Releasing lock "refresh_cache-aa8c3210-37e5-4e33-8ea4-98a70fa9800b" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG nova.compute.manager [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Instance network_info: |[{"id": "980d6903-8cea-4a60-bd44-e8a7343d991f", "address": "fa:16:3e:e7:5e:eb", "network": {"id": "7f0a516e-a6d1-4198-b7f7-d1eef96625cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-408682612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd0f16e49ef48ff99752b6aec718358", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap980d6903-8c", "ovs_interfaceid": "980d6903-8cea-4a60-bd44-e8a7343d991f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Start _get_guest_xml network_info=[{"id": "980d6903-8cea-4a60-bd44-e8a7343d991f", "address": "fa:16:3e:e7:5e:eb", "network": {"id": "7f0a516e-a6d1-4198-b7f7-d1eef96625cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-408682612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd0f16e49ef48ff99752b6aec718358", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap980d6903-8c", "ovs_interfaceid": "980d6903-8cea-4a60-bd44-e8a7343d991f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:40:12 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:40:12 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:40:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:40:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1060977057',display_name='tempest-VolumesSnapshotTestJSON-instance-1060977057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1060977057',id=20,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK72fRD2cqAPSvA5XiNDr1lxjVQKMvhlOvHhfISOLK83tuEudjB4A/hWe/vBqZXOvLTBkh3iGnIhJSWaaSCuYKvHYaAInH4YbOXjMaDe/evl7Bi6Fp3oKm5Pw/2TRBlYlw==',key_name='tempest-keypair-1719847082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cdd0f16e49ef48ff99752b6aec718358',ramdisk_id='',reservation_id='r-anwqckf9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-563591119',owner_user_name='tempest-VolumesSnapshotTestJSON-563591119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:40:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2c57d05306648e786200a93a121966e',uuid=aa8c3210-37e5-4e33-8ea4-98a70fa9800b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "980d6903-8cea-4a60-bd44-e8a7343d991f", "address": "fa:16:3e:e7:5e:eb", "network": {"id": "7f0a516e-a6d1-4198-b7f7-d1eef96625cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-408682612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd0f16e49ef48ff99752b6aec718358", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap980d6903-8c", "ovs_interfaceid": "980d6903-8cea-4a60-bd44-e8a7343d991f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Converting VIF {"id": "980d6903-8cea-4a60-bd44-e8a7343d991f", "address": "fa:16:3e:e7:5e:eb", "network": {"id": "7f0a516e-a6d1-4198-b7f7-d1eef96625cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-408682612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd0f16e49ef48ff99752b6aec718358", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap980d6903-8c", "ovs_interfaceid": "980d6903-8cea-4a60-bd44-e8a7343d991f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:5e:eb,bridge_name='br-int',has_traffic_filtering=True,id=980d6903-8cea-4a60-bd44-e8a7343d991f,network=Network(7f0a516e-a6d1-4198-b7f7-d1eef96625cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap980d6903-8c') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG nova.objects.instance [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lazy-loading 'pci_devices' on Instance uuid aa8c3210-37e5-4e33-8ea4-98a70fa9800b {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:40:12 user nova-compute[231753]:   <uuid>aa8c3210-37e5-4e33-8ea4-98a70fa9800b</uuid>
Jul 29 13:40:12 user nova-compute[231753]:   <name>instance-00000014</name>
Jul 29 13:40:12 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:40:12 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:40:12 user nova-compute[231753]:   <metadata>
Jul 29 13:40:12 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:40:12 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:40:12 user nova-compute[231753]:       <nova:name>tempest-VolumesSnapshotTestJSON-instance-1060977057</nova:name>
Jul 29 13:40:12 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:40:12</nova:creationTime>
Jul 29 13:40:12 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:40:12 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:40:12 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:40:12 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:40:12 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:40:12 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:40:12 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:40:12 user nova-compute[231753]:       <nova:owner>
Jul 29 13:40:12 user nova-compute[231753]:         <nova:user uuid="a2c57d05306648e786200a93a121966e">tempest-VolumesSnapshotTestJSON-563591119-project-member</nova:user>
Jul 29 13:40:12 user nova-compute[231753]:         <nova:project uuid="cdd0f16e49ef48ff99752b6aec718358">tempest-VolumesSnapshotTestJSON-563591119</nova:project>
Jul 29 13:40:12 user nova-compute[231753]:       </nova:owner>
Jul 29 13:40:12 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:40:12 user nova-compute[231753]:       <nova:ports>
Jul 29 13:40:12 user nova-compute[231753]:         <nova:port uuid="980d6903-8cea-4a60-bd44-e8a7343d991f">
Jul 29 13:40:12 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 29 13:40:12 user nova-compute[231753]:         </nova:port>
Jul 29 13:40:12 user nova-compute[231753]:       </nova:ports>
Jul 29 13:40:12 user nova-compute[231753]:     </nova:instance>
Jul 29 13:40:12 user nova-compute[231753]:   </metadata>
Jul 29 13:40:12 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:40:12 user nova-compute[231753]:     <system>
Jul 29 13:40:12 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:40:12 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:40:12 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:40:12 user nova-compute[231753]:       <entry name="serial">aa8c3210-37e5-4e33-8ea4-98a70fa9800b</entry>
Jul 29 13:40:12 user nova-compute[231753]:       <entry name="uuid">aa8c3210-37e5-4e33-8ea4-98a70fa9800b</entry>
Jul 29 13:40:12 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:40:12 user nova-compute[231753]:     </system>
Jul 29 13:40:12 user nova-compute[231753]:   </sysinfo>
Jul 29 13:40:12 user nova-compute[231753]:   <os>
Jul 29 13:40:12 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:40:12 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:40:12 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:40:12 user nova-compute[231753]:   </os>
Jul 29 13:40:12 user nova-compute[231753]:   <features>
Jul 29 13:40:12 user nova-compute[231753]:     <acpi/>
Jul 29 13:40:12 user nova-compute[231753]:     <apic/>
Jul 29 13:40:12 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:40:12 user nova-compute[231753]:   </features>
Jul 29 13:40:12 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:40:12 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:40:12 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:40:12 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:40:12 user nova-compute[231753]:   </clock>
Jul 29 13:40:12 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:40:12 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:40:12 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:40:12 user nova-compute[231753]:   </cpu>
Jul 29 13:40:12 user nova-compute[231753]:   <devices>
Jul 29 13:40:12 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:40:12 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:40:12 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/aa8c3210-37e5-4e33-8ea4-98a70fa9800b/disk"/>
Jul 29 13:40:12 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:40:12 user nova-compute[231753]:     </disk>
Jul 29 13:40:12 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:40:12 user nova-compute[231753]:       <mac address="fa:16:3e:e7:5e:eb"/>
Jul 29 13:40:12 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:40:12 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:40:12 user nova-compute[231753]:       <target dev="tap980d6903-8c"/>
Jul 29 13:40:12 user nova-compute[231753]:     </interface>
Jul 29 13:40:12 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:40:12 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/aa8c3210-37e5-4e33-8ea4-98a70fa9800b/console.log" append="off"/>
Jul 29 13:40:12 user nova-compute[231753]:     </serial>
Jul 29 13:40:12 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:40:12 user nova-compute[231753]:     <video>
Jul 29 13:40:12 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:40:12 user nova-compute[231753]:     </video>
Jul 29 13:40:12 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:40:12 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:40:12 user nova-compute[231753]:     </rng>
Jul 29 13:40:12 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:40:12 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:40:12 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:40:12 user nova-compute[231753]:     </memballoon>
Jul 29 13:40:12 user nova-compute[231753]:   </devices>
Jul 29 13:40:12 user nova-compute[231753]: </domain>
Jul 29 13:40:12 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:40:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1060977057',display_name='tempest-VolumesSnapshotTestJSON-instance-1060977057',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1060977057',id=20,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK72fRD2cqAPSvA5XiNDr1lxjVQKMvhlOvHhfISOLK83tuEudjB4A/hWe/vBqZXOvLTBkh3iGnIhJSWaaSCuYKvHYaAInH4YbOXjMaDe/evl7Bi6Fp3oKm5Pw/2TRBlYlw==',key_name='tempest-keypair-1719847082',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='cdd0f16e49ef48ff99752b6aec718358',ramdisk_id='',reservation_id='r-anwqckf9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesSnapshotTestJSON-563591119',owner_user_name='tempest-VolumesSnapshotTestJSON-563591119-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:40:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2c57d05306648e786200a93a121966e',uuid=aa8c3210-37e5-4e33-8ea4-98a70fa9800b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "980d6903-8cea-4a60-bd44-e8a7343d991f", "address": "fa:16:3e:e7:5e:eb", "network": {"id": "7f0a516e-a6d1-4198-b7f7-d1eef96625cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-408682612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd0f16e49ef48ff99752b6aec718358", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap980d6903-8c", "ovs_interfaceid": "980d6903-8cea-4a60-bd44-e8a7343d991f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Converting VIF {"id": "980d6903-8cea-4a60-bd44-e8a7343d991f", "address": "fa:16:3e:e7:5e:eb", "network": {"id": "7f0a516e-a6d1-4198-b7f7-d1eef96625cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-408682612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd0f16e49ef48ff99752b6aec718358", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap980d6903-8c", "ovs_interfaceid": "980d6903-8cea-4a60-bd44-e8a7343d991f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:e7:5e:eb,bridge_name='br-int',has_traffic_filtering=True,id=980d6903-8cea-4a60-bd44-e8a7343d991f,network=Network(7f0a516e-a6d1-4198-b7f7-d1eef96625cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap980d6903-8c') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG os_vif [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:5e:eb,bridge_name='br-int',has_traffic_filtering=True,id=980d6903-8cea-4a60-bd44-e8a7343d991f,network=Network(7f0a516e-a6d1-4198-b7f7-d1eef96625cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap980d6903-8c') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap980d6903-8c, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap980d6903-8c, col_values=(('external_ids', {'iface-id': '980d6903-8cea-4a60-bd44-e8a7343d991f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:e7:5e:eb', 'vm-uuid': 'aa8c3210-37e5-4e33-8ea4-98a70fa9800b'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:12 user nova-compute[231753]: INFO os_vif [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:e7:5e:eb,bridge_name='br-int',has_traffic_filtering=True,id=980d6903-8cea-4a60-bd44-e8a7343d991f,network=Network(7f0a516e-a6d1-4198-b7f7-d1eef96625cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap980d6903-8c')
Jul 29 13:40:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:40:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] No VIF found with MAC fa:16:3e:e7:5e:eb, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:40:13 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:40:13 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 13:40:13 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Rebuilding the list of instances to heal {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 13:40:13 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Skipping network cache update for instance because it is Building. {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9855}}
Jul 29 13:40:13 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "refresh_cache-63fad324-aac2-4d60-b4ce-a32a5736657d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:40:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquired lock "refresh_cache-63fad324-aac2-4d60-b4ce-a32a5736657d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:40:13 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Forcefully refreshing network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 13:40:13 user nova-compute[231753]: DEBUG nova.objects.instance [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lazy-loading 'info_cache' on Instance uuid 63fad324-aac2-4d60-b4ce-a32a5736657d {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:40:13 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:13 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:13 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:13 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:14 user nova-compute[231753]: DEBUG nova.compute.manager [req-4e78fc38-b790-48fc-9503-25ea89eba225 req-cdd40f42-51cb-4c46-ab9a-53ad864c6e6b service nova] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Received event network-vif-plugged-980d6903-8cea-4a60-bd44-e8a7343d991f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:40:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4e78fc38-b790-48fc-9503-25ea89eba225 req-cdd40f42-51cb-4c46-ab9a-53ad864c6e6b service nova] Acquiring lock "aa8c3210-37e5-4e33-8ea4-98a70fa9800b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:40:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4e78fc38-b790-48fc-9503-25ea89eba225 req-cdd40f42-51cb-4c46-ab9a-53ad864c6e6b service nova] Lock "aa8c3210-37e5-4e33-8ea4-98a70fa9800b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:40:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4e78fc38-b790-48fc-9503-25ea89eba225 req-cdd40f42-51cb-4c46-ab9a-53ad864c6e6b service nova] Lock "aa8c3210-37e5-4e33-8ea4-98a70fa9800b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:40:14 user nova-compute[231753]: DEBUG nova.compute.manager [req-4e78fc38-b790-48fc-9503-25ea89eba225 req-cdd40f42-51cb-4c46-ab9a-53ad864c6e6b service nova] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] No waiting events found dispatching network-vif-plugged-980d6903-8cea-4a60-bd44-e8a7343d991f {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:40:14 user nova-compute[231753]: WARNING nova.compute.manager [req-4e78fc38-b790-48fc-9503-25ea89eba225 req-cdd40f42-51cb-4c46-ab9a-53ad864c6e6b service nova] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Received unexpected event network-vif-plugged-980d6903-8cea-4a60-bd44-e8a7343d991f for instance with vm_state building and task_state spawning.
Jul 29 13:40:14 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Updating instance_info_cache with network_info: [{"id": "fadc1466-5336-4230-b0f1-4fe4053f216a", "address": "fa:16:3e:df:12:9c", "network": {"id": "8897db8c-6e92-4b9e-b7ee-a69230eb07f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1596242231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a8a3e0bcef4bbc979ef187e4ed48cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc1466-53", "ovs_interfaceid": "fadc1466-5336-4230-b0f1-4fe4053f216a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:40:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Releasing lock "refresh_cache-63fad324-aac2-4d60-b4ce-a32a5736657d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:40:14 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Updated the network info_cache for instance {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 13:40:14 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:40:14 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:40:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:16 user nova-compute[231753]: DEBUG nova.compute.manager [req-7a8b9d68-9186-44e0-8859-e6e5b4cae03a req-45710697-f7b1-4f68-bd41-b46404118b81 service nova] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Received event network-vif-plugged-980d6903-8cea-4a60-bd44-e8a7343d991f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:40:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7a8b9d68-9186-44e0-8859-e6e5b4cae03a req-45710697-f7b1-4f68-bd41-b46404118b81 service nova] Acquiring lock "aa8c3210-37e5-4e33-8ea4-98a70fa9800b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:40:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7a8b9d68-9186-44e0-8859-e6e5b4cae03a req-45710697-f7b1-4f68-bd41-b46404118b81 service nova] Lock "aa8c3210-37e5-4e33-8ea4-98a70fa9800b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:40:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7a8b9d68-9186-44e0-8859-e6e5b4cae03a req-45710697-f7b1-4f68-bd41-b46404118b81 service nova] Lock "aa8c3210-37e5-4e33-8ea4-98a70fa9800b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:40:16 user nova-compute[231753]: DEBUG nova.compute.manager [req-7a8b9d68-9186-44e0-8859-e6e5b4cae03a req-45710697-f7b1-4f68-bd41-b46404118b81 service nova] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] No waiting events found dispatching network-vif-plugged-980d6903-8cea-4a60-bd44-e8a7343d991f {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:40:16 user nova-compute[231753]: WARNING nova.compute.manager [req-7a8b9d68-9186-44e0-8859-e6e5b4cae03a req-45710697-f7b1-4f68-bd41-b46404118b81 service nova] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Received unexpected event network-vif-plugged-980d6903-8cea-4a60-bd44-e8a7343d991f for instance with vm_state building and task_state spawning.
Jul 29 13:40:16 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638016.2790112, aa8c3210-37e5-4e33-8ea4-98a70fa9800b => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:40:16 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] VM Resumed (Lifecycle Event)
Jul 29 13:40:16 user nova-compute[231753]: DEBUG nova.compute.manager [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:40:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:40:16 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Instance spawned successfully.
Jul 29 13:40:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:40:16 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:40:16 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:40:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:40:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:40:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:40:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:40:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:40:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:40:16 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:40:16 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638016.2829776, aa8c3210-37e5-4e33-8ea4-98a70fa9800b => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:40:16 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] VM Started (Lifecycle Event)
Jul 29 13:40:16 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:40:16 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:40:16 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:40:16 user nova-compute[231753]: INFO nova.compute.manager [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Took 6.40 seconds to spawn the instance on the hypervisor.
Jul 29 13:40:16 user nova-compute[231753]: DEBUG nova.compute.manager [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:40:16 user nova-compute[231753]: INFO nova.compute.manager [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Took 7.34 seconds to build instance.
Jul 29 13:40:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-52636f94-f401-42ad-b4b7-a9f17a5421fb tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "aa8c3210-37e5-4e33-8ea4-98a70fa9800b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.461s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:40:17 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Acquiring lock "576f5002-4e4d-4236-8b0f-9b8788246de2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:40:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "576f5002-4e4d-4236-8b0f-9b8788246de2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:40:37 user nova-compute[231753]: DEBUG nova.compute.manager [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:40:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:40:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:40:37 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:40:37 user nova-compute[231753]: INFO nova.compute.claims [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Claim successful on node user
Jul 29 13:40:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:37 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:40:37 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:40:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.560s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:40:37 user nova-compute[231753]: DEBUG nova.compute.manager [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:40:37 user nova-compute[231753]: DEBUG nova.compute.manager [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:40:37 user nova-compute[231753]: DEBUG nova.network.neutron [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:40:37 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:40:38 user nova-compute[231753]: DEBUG nova.compute.manager [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:40:38 user nova-compute[231753]: DEBUG nova.policy [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3330125060d64234bce343af655e58e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876fbcda354d47c197ce14ca4ed7ead6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:40:38 user nova-compute[231753]: DEBUG nova.compute.manager [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:40:38 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:40:38 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Creating image(s)
Jul 29 13:40:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Acquiring lock "/opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:40:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "/opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:40:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "/opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:40:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.137s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:40:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:40:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.148s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk 1073741824" returned: 0 in 0.095s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.249s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:40:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.141s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:38 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Checking if we can resize image /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:40:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:38 user nova-compute[231753]: DEBUG nova.network.neutron [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Successfully created port: 89a6c6db-c40f-428c-8739-3f780154f935 {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:40:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:38 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Cannot resize image /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:40:38 user nova-compute[231753]: DEBUG nova.objects.instance [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lazy-loading 'migration_context' on Instance uuid 576f5002-4e4d-4236-8b0f-9b8788246de2 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:40:38 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:40:38 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Ensure instance console log exists: /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:40:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:40:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:40:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG nova.network.neutron [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Successfully updated port: 89a6c6db-c40f-428c-8739-3f780154f935 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Acquiring lock "refresh_cache-576f5002-4e4d-4236-8b0f-9b8788246de2" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Acquired lock "refresh_cache-576f5002-4e4d-4236-8b0f-9b8788246de2" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG nova.network.neutron [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG nova.compute.manager [req-323704dc-4f28-4c2b-a746-dfa4334dd19a req-97b89ef9-2e4b-446f-a72b-1caea8be3b43 service nova] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Received event network-changed-89a6c6db-c40f-428c-8739-3f780154f935 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG nova.compute.manager [req-323704dc-4f28-4c2b-a746-dfa4334dd19a req-97b89ef9-2e4b-446f-a72b-1caea8be3b43 service nova] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Refreshing instance network info cache due to event network-changed-89a6c6db-c40f-428c-8739-3f780154f935. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-323704dc-4f28-4c2b-a746-dfa4334dd19a req-97b89ef9-2e4b-446f-a72b-1caea8be3b43 service nova] Acquiring lock "refresh_cache-576f5002-4e4d-4236-8b0f-9b8788246de2" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG nova.network.neutron [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG nova.network.neutron [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Updating instance_info_cache with network_info: [{"id": "89a6c6db-c40f-428c-8739-3f780154f935", "address": "fa:16:3e:73:e5:d2", "network": {"id": "c8ebc7da-3ffe-45a0-b7f5-bb85261852ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1496462371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876fbcda354d47c197ce14ca4ed7ead6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a6c6db-c4", "ovs_interfaceid": "89a6c6db-c40f-428c-8739-3f780154f935", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Releasing lock "refresh_cache-576f5002-4e4d-4236-8b0f-9b8788246de2" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG nova.compute.manager [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Instance network_info: |[{"id": "89a6c6db-c40f-428c-8739-3f780154f935", "address": "fa:16:3e:73:e5:d2", "network": {"id": "c8ebc7da-3ffe-45a0-b7f5-bb85261852ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1496462371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876fbcda354d47c197ce14ca4ed7ead6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a6c6db-c4", "ovs_interfaceid": "89a6c6db-c40f-428c-8739-3f780154f935", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-323704dc-4f28-4c2b-a746-dfa4334dd19a req-97b89ef9-2e4b-446f-a72b-1caea8be3b43 service nova] Acquired lock "refresh_cache-576f5002-4e4d-4236-8b0f-9b8788246de2" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG nova.network.neutron [req-323704dc-4f28-4c2b-a746-dfa4334dd19a req-97b89ef9-2e4b-446f-a72b-1caea8be3b43 service nova] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Refreshing network info cache for port 89a6c6db-c40f-428c-8739-3f780154f935 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Start _get_guest_xml network_info=[{"id": "89a6c6db-c40f-428c-8739-3f780154f935", "address": "fa:16:3e:73:e5:d2", "network": {"id": "c8ebc7da-3ffe-45a0-b7f5-bb85261852ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1496462371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876fbcda354d47c197ce14ca4ed7ead6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a6c6db-c4", "ovs_interfaceid": "89a6c6db-c40f-428c-8739-3f780154f935", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:40:40 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:40:40 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:40:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:40:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1355663658',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1355663658',id=21,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfXpH2RnoHEl8tlTCSXkRfawa9eiuCdOUHYAaG4NQXZan6vLxBaEtIPr7wVGpyz5DltTEyJzaREkh2cXVCInuJ6dn1UhGgsq7Ktg8mBUfdq5DvLdw0PRjlIdqg/qxUXdg==',key_name='tempest-keypair-722483403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='876fbcda354d47c197ce14ca4ed7ead6',ramdisk_id='',reservation_id='r-wlhg00zc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1385583979',owner_user_name='tempest-ServerActionsV293TestJSON-1385583979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:40:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3330125060d64234bce343af655e58e3',uuid=576f5002-4e4d-4236-8b0f-9b8788246de2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89a6c6db-c40f-428c-8739-3f780154f935", "address": "fa:16:3e:73:e5:d2", "network": {"id": "c8ebc7da-3ffe-45a0-b7f5-bb85261852ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1496462371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876fbcda354d47c197ce14ca4ed7ead6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a6c6db-c4", "ovs_interfaceid": "89a6c6db-c40f-428c-8739-3f780154f935", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Converting VIF {"id": "89a6c6db-c40f-428c-8739-3f780154f935", "address": "fa:16:3e:73:e5:d2", "network": {"id": "c8ebc7da-3ffe-45a0-b7f5-bb85261852ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1496462371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876fbcda354d47c197ce14ca4ed7ead6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a6c6db-c4", "ovs_interfaceid": "89a6c6db-c40f-428c-8739-3f780154f935", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:e5:d2,bridge_name='br-int',has_traffic_filtering=True,id=89a6c6db-c40f-428c-8739-3f780154f935,network=Network(c8ebc7da-3ffe-45a0-b7f5-bb85261852ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89a6c6db-c4') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG nova.objects.instance [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lazy-loading 'pci_devices' on Instance uuid 576f5002-4e4d-4236-8b0f-9b8788246de2 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:40:40 user nova-compute[231753]:   <uuid>576f5002-4e4d-4236-8b0f-9b8788246de2</uuid>
Jul 29 13:40:40 user nova-compute[231753]:   <name>instance-00000015</name>
Jul 29 13:40:40 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:40:40 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:40:40 user nova-compute[231753]:   <metadata>
Jul 29 13:40:40 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:40:40 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:40:40 user nova-compute[231753]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1355663658</nova:name>
Jul 29 13:40:40 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:40:40</nova:creationTime>
Jul 29 13:40:40 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:40:40 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:40:40 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:40:40 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:40:40 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:40:40 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:40:40 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:40:40 user nova-compute[231753]:       <nova:owner>
Jul 29 13:40:40 user nova-compute[231753]:         <nova:user uuid="3330125060d64234bce343af655e58e3">tempest-ServerActionsV293TestJSON-1385583979-project-member</nova:user>
Jul 29 13:40:40 user nova-compute[231753]:         <nova:project uuid="876fbcda354d47c197ce14ca4ed7ead6">tempest-ServerActionsV293TestJSON-1385583979</nova:project>
Jul 29 13:40:40 user nova-compute[231753]:       </nova:owner>
Jul 29 13:40:40 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:40:40 user nova-compute[231753]:       <nova:ports>
Jul 29 13:40:40 user nova-compute[231753]:         <nova:port uuid="89a6c6db-c40f-428c-8739-3f780154f935">
Jul 29 13:40:40 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 29 13:40:40 user nova-compute[231753]:         </nova:port>
Jul 29 13:40:40 user nova-compute[231753]:       </nova:ports>
Jul 29 13:40:40 user nova-compute[231753]:     </nova:instance>
Jul 29 13:40:40 user nova-compute[231753]:   </metadata>
Jul 29 13:40:40 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:40:40 user nova-compute[231753]:     <system>
Jul 29 13:40:40 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:40:40 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:40:40 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:40:40 user nova-compute[231753]:       <entry name="serial">576f5002-4e4d-4236-8b0f-9b8788246de2</entry>
Jul 29 13:40:40 user nova-compute[231753]:       <entry name="uuid">576f5002-4e4d-4236-8b0f-9b8788246de2</entry>
Jul 29 13:40:40 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:40:40 user nova-compute[231753]:     </system>
Jul 29 13:40:40 user nova-compute[231753]:   </sysinfo>
Jul 29 13:40:40 user nova-compute[231753]:   <os>
Jul 29 13:40:40 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:40:40 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:40:40 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:40:40 user nova-compute[231753]:   </os>
Jul 29 13:40:40 user nova-compute[231753]:   <features>
Jul 29 13:40:40 user nova-compute[231753]:     <acpi/>
Jul 29 13:40:40 user nova-compute[231753]:     <apic/>
Jul 29 13:40:40 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:40:40 user nova-compute[231753]:   </features>
Jul 29 13:40:40 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:40:40 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:40:40 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:40:40 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:40:40 user nova-compute[231753]:   </clock>
Jul 29 13:40:40 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:40:40 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:40:40 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:40:40 user nova-compute[231753]:   </cpu>
Jul 29 13:40:40 user nova-compute[231753]:   <devices>
Jul 29 13:40:40 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:40:40 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:40:40 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk"/>
Jul 29 13:40:40 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:40:40 user nova-compute[231753]:     </disk>
Jul 29 13:40:40 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:40:40 user nova-compute[231753]:       <mac address="fa:16:3e:73:e5:d2"/>
Jul 29 13:40:40 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:40:40 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:40:40 user nova-compute[231753]:       <target dev="tap89a6c6db-c4"/>
Jul 29 13:40:40 user nova-compute[231753]:     </interface>
Jul 29 13:40:40 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:40:40 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/console.log" append="off"/>
Jul 29 13:40:40 user nova-compute[231753]:     </serial>
Jul 29 13:40:40 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:40:40 user nova-compute[231753]:     <video>
Jul 29 13:40:40 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:40:40 user nova-compute[231753]:     </video>
Jul 29 13:40:40 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:40:40 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:40:40 user nova-compute[231753]:     </rng>
Jul 29 13:40:40 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:40:40 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:40:40 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:40:40 user nova-compute[231753]:     </memballoon>
Jul 29 13:40:40 user nova-compute[231753]:   </devices>
Jul 29 13:40:40 user nova-compute[231753]: </domain>
Jul 29 13:40:40 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:40:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1355663658',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1355663658',id=21,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfXpH2RnoHEl8tlTCSXkRfawa9eiuCdOUHYAaG4NQXZan6vLxBaEtIPr7wVGpyz5DltTEyJzaREkh2cXVCInuJ6dn1UhGgsq7Ktg8mBUfdq5DvLdw0PRjlIdqg/qxUXdg==',key_name='tempest-keypair-722483403',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='876fbcda354d47c197ce14ca4ed7ead6',ramdisk_id='',reservation_id='r-wlhg00zc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1385583979',owner_user_name='tempest-ServerActionsV293TestJSON-1385583979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:40:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3330125060d64234bce343af655e58e3',uuid=576f5002-4e4d-4236-8b0f-9b8788246de2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89a6c6db-c40f-428c-8739-3f780154f935", "address": "fa:16:3e:73:e5:d2", "network": {"id": "c8ebc7da-3ffe-45a0-b7f5-bb85261852ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1496462371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876fbcda354d47c197ce14ca4ed7ead6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a6c6db-c4", "ovs_interfaceid": "89a6c6db-c40f-428c-8739-3f780154f935", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Converting VIF {"id": "89a6c6db-c40f-428c-8739-3f780154f935", "address": "fa:16:3e:73:e5:d2", "network": {"id": "c8ebc7da-3ffe-45a0-b7f5-bb85261852ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1496462371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876fbcda354d47c197ce14ca4ed7ead6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a6c6db-c4", "ovs_interfaceid": "89a6c6db-c40f-428c-8739-3f780154f935", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:e5:d2,bridge_name='br-int',has_traffic_filtering=True,id=89a6c6db-c40f-428c-8739-3f780154f935,network=Network(c8ebc7da-3ffe-45a0-b7f5-bb85261852ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89a6c6db-c4') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG os_vif [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:e5:d2,bridge_name='br-int',has_traffic_filtering=True,id=89a6c6db-c40f-428c-8739-3f780154f935,network=Network(c8ebc7da-3ffe-45a0-b7f5-bb85261852ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89a6c6db-c4') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89a6c6db-c4, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap89a6c6db-c4, col_values=(('external_ids', {'iface-id': '89a6c6db-c40f-428c-8739-3f780154f935', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:e5:d2', 'vm-uuid': '576f5002-4e4d-4236-8b0f-9b8788246de2'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:40 user nova-compute[231753]: INFO os_vif [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:e5:d2,bridge_name='br-int',has_traffic_filtering=True,id=89a6c6db-c40f-428c-8739-3f780154f935,network=Network(c8ebc7da-3ffe-45a0-b7f5-bb85261852ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89a6c6db-c4')
Jul 29 13:40:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] No VIF found with MAC fa:16:3e:73:e5:d2, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "16097b06-976f-4fcd-a449-7b1ec8f739d1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "16097b06-976f-4fcd-a449-7b1ec8f739d1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG nova.compute.manager [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:40:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:40:41 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:40:41 user nova-compute[231753]: INFO nova.compute.claims [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Claim successful on node user
Jul 29 13:40:41 user nova-compute[231753]: DEBUG nova.network.neutron [req-323704dc-4f28-4c2b-a746-dfa4334dd19a req-97b89ef9-2e4b-446f-a72b-1caea8be3b43 service nova] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Updated VIF entry in instance network info cache for port 89a6c6db-c40f-428c-8739-3f780154f935. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:40:41 user nova-compute[231753]: DEBUG nova.network.neutron [req-323704dc-4f28-4c2b-a746-dfa4334dd19a req-97b89ef9-2e4b-446f-a72b-1caea8be3b43 service nova] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Updating instance_info_cache with network_info: [{"id": "89a6c6db-c40f-428c-8739-3f780154f935", "address": "fa:16:3e:73:e5:d2", "network": {"id": "c8ebc7da-3ffe-45a0-b7f5-bb85261852ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1496462371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876fbcda354d47c197ce14ca4ed7ead6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a6c6db-c4", "ovs_interfaceid": "89a6c6db-c40f-428c-8739-3f780154f935", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:40:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-323704dc-4f28-4c2b-a746-dfa4334dd19a req-97b89ef9-2e4b-446f-a72b-1caea8be3b43 service nova] Releasing lock "refresh_cache-576f5002-4e4d-4236-8b0f-9b8788246de2" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:40:41 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:40:41 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:40:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.464s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:40:41 user nova-compute[231753]: DEBUG nova.compute.manager [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:40:41 user nova-compute[231753]: DEBUG nova.compute.manager [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:40:41 user nova-compute[231753]: DEBUG nova.network.neutron [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:40:41 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:40:41 user nova-compute[231753]: DEBUG nova.compute.manager [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:40:41 user nova-compute[231753]: DEBUG nova.policy [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '932b5bd757f94be29d52035fd9f70293', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd53ebbb5f2e440dfa0cf3950232b4853', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:40:41 user nova-compute[231753]: DEBUG nova.compute.manager [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:40:41 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:40:41 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Creating image(s)
Jul 29 13:40:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "/opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:40:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "/opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:40:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "/opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.009s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:40:41 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:41 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.151s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:40:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:40:41 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:41 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.132s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:41 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/disk 1073741824" returned: 0 in 0.049s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.189s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:40:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.161s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:42 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Checking if we can resize image /opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:40:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:42 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Cannot resize image /opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:40:42 user nova-compute[231753]: DEBUG nova.objects.instance [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lazy-loading 'migration_context' on Instance uuid 16097b06-976f-4fcd-a449-7b1ec8f739d1 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:40:42 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:40:42 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Ensure instance console log exists: /opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:40:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:40:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:40:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:40:42 user nova-compute[231753]: DEBUG nova.compute.manager [req-d298d81d-9d71-4220-a0ce-30abf85932d0 req-486f4875-7db3-425d-af1a-202efc20a6f5 service nova] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Received event network-vif-plugged-89a6c6db-c40f-428c-8739-3f780154f935 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:40:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d298d81d-9d71-4220-a0ce-30abf85932d0 req-486f4875-7db3-425d-af1a-202efc20a6f5 service nova] Acquiring lock "576f5002-4e4d-4236-8b0f-9b8788246de2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:40:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d298d81d-9d71-4220-a0ce-30abf85932d0 req-486f4875-7db3-425d-af1a-202efc20a6f5 service nova] Lock "576f5002-4e4d-4236-8b0f-9b8788246de2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:40:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d298d81d-9d71-4220-a0ce-30abf85932d0 req-486f4875-7db3-425d-af1a-202efc20a6f5 service nova] Lock "576f5002-4e4d-4236-8b0f-9b8788246de2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:40:42 user nova-compute[231753]: DEBUG nova.compute.manager [req-d298d81d-9d71-4220-a0ce-30abf85932d0 req-486f4875-7db3-425d-af1a-202efc20a6f5 service nova] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] No waiting events found dispatching network-vif-plugged-89a6c6db-c40f-428c-8739-3f780154f935 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:40:42 user nova-compute[231753]: WARNING nova.compute.manager [req-d298d81d-9d71-4220-a0ce-30abf85932d0 req-486f4875-7db3-425d-af1a-202efc20a6f5 service nova] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Received unexpected event network-vif-plugged-89a6c6db-c40f-428c-8739-3f780154f935 for instance with vm_state building and task_state spawning.
Jul 29 13:40:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:42 user nova-compute[231753]: DEBUG nova.network.neutron [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Successfully created port: 7066a691-9911-48c6-a50c-de2e25f08f1d {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:40:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:43 user nova-compute[231753]: DEBUG nova.network.neutron [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Successfully updated port: 7066a691-9911-48c6-a50c-de2e25f08f1d {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:40:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "refresh_cache-16097b06-976f-4fcd-a449-7b1ec8f739d1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:40:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquired lock "refresh_cache-16097b06-976f-4fcd-a449-7b1ec8f739d1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:40:43 user nova-compute[231753]: DEBUG nova.network.neutron [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:40:43 user nova-compute[231753]: DEBUG nova.network.neutron [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.network.neutron [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Updating instance_info_cache with network_info: [{"id": "7066a691-9911-48c6-a50c-de2e25f08f1d", "address": "fa:16:3e:33:c2:0b", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7066a691-99", "ovs_interfaceid": "7066a691-9911-48c6-a50c-de2e25f08f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Releasing lock "refresh_cache-16097b06-976f-4fcd-a449-7b1ec8f739d1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.compute.manager [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Instance network_info: |[{"id": "7066a691-9911-48c6-a50c-de2e25f08f1d", "address": "fa:16:3e:33:c2:0b", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7066a691-99", "ovs_interfaceid": "7066a691-9911-48c6-a50c-de2e25f08f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Start _get_guest_xml network_info=[{"id": "7066a691-9911-48c6-a50c-de2e25f08f1d", "address": "fa:16:3e:33:c2:0b", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7066a691-99", "ovs_interfaceid": "7066a691-9911-48c6-a50c-de2e25f08f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:40:44 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:40:44 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:40:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1785686519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1785686519',id=22,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIltVyANnBLQo5ZkaO2rhyJWlvJIw2quOPh0zhPSCEV5HqmmGHMXccTyUpnsRkyvdMtse0ovY8hkA/H4UxPyXE0wALQj07YRnF9pVYigWhQcgRInlw5MXYbG0KJZyckXbw==',key_name='tempest-keypair-1407725312',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d53ebbb5f2e440dfa0cf3950232b4853',ramdisk_id='',reservation_id='r-u7dl5zqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-460717858',owner_user_name='tempest-AttachVolumeShelveTestJSON-460717858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:40:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='932b5bd757f94be29d52035fd9f70293',uuid=16097b06-976f-4fcd-a449-7b1ec8f739d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7066a691-9911-48c6-a50c-de2e25f08f1d", "address": "fa:16:3e:33:c2:0b", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7066a691-99", "ovs_interfaceid": "7066a691-9911-48c6-a50c-de2e25f08f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Converting VIF {"id": "7066a691-9911-48c6-a50c-de2e25f08f1d", "address": "fa:16:3e:33:c2:0b", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7066a691-99", "ovs_interfaceid": "7066a691-9911-48c6-a50c-de2e25f08f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:c2:0b,bridge_name='br-int',has_traffic_filtering=True,id=7066a691-9911-48c6-a50c-de2e25f08f1d,network=Network(9be19067-cc29-4c67-95a0-cf37f95f9fc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7066a691-99') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.objects.instance [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lazy-loading 'pci_devices' on Instance uuid 16097b06-976f-4fcd-a449-7b1ec8f739d1 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:40:44 user nova-compute[231753]:   <uuid>16097b06-976f-4fcd-a449-7b1ec8f739d1</uuid>
Jul 29 13:40:44 user nova-compute[231753]:   <name>instance-00000016</name>
Jul 29 13:40:44 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:40:44 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:40:44 user nova-compute[231753]:   <metadata>
Jul 29 13:40:44 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:40:44 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:40:44 user nova-compute[231753]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1785686519</nova:name>
Jul 29 13:40:44 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:40:44</nova:creationTime>
Jul 29 13:40:44 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:40:44 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:40:44 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:40:44 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:40:44 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:40:44 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:40:44 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:40:44 user nova-compute[231753]:       <nova:owner>
Jul 29 13:40:44 user nova-compute[231753]:         <nova:user uuid="932b5bd757f94be29d52035fd9f70293">tempest-AttachVolumeShelveTestJSON-460717858-project-member</nova:user>
Jul 29 13:40:44 user nova-compute[231753]:         <nova:project uuid="d53ebbb5f2e440dfa0cf3950232b4853">tempest-AttachVolumeShelveTestJSON-460717858</nova:project>
Jul 29 13:40:44 user nova-compute[231753]:       </nova:owner>
Jul 29 13:40:44 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:40:44 user nova-compute[231753]:       <nova:ports>
Jul 29 13:40:44 user nova-compute[231753]:         <nova:port uuid="7066a691-9911-48c6-a50c-de2e25f08f1d">
Jul 29 13:40:44 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 29 13:40:44 user nova-compute[231753]:         </nova:port>
Jul 29 13:40:44 user nova-compute[231753]:       </nova:ports>
Jul 29 13:40:44 user nova-compute[231753]:     </nova:instance>
Jul 29 13:40:44 user nova-compute[231753]:   </metadata>
Jul 29 13:40:44 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:40:44 user nova-compute[231753]:     <system>
Jul 29 13:40:44 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:40:44 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:40:44 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:40:44 user nova-compute[231753]:       <entry name="serial">16097b06-976f-4fcd-a449-7b1ec8f739d1</entry>
Jul 29 13:40:44 user nova-compute[231753]:       <entry name="uuid">16097b06-976f-4fcd-a449-7b1ec8f739d1</entry>
Jul 29 13:40:44 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:40:44 user nova-compute[231753]:     </system>
Jul 29 13:40:44 user nova-compute[231753]:   </sysinfo>
Jul 29 13:40:44 user nova-compute[231753]:   <os>
Jul 29 13:40:44 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:40:44 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:40:44 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:40:44 user nova-compute[231753]:   </os>
Jul 29 13:40:44 user nova-compute[231753]:   <features>
Jul 29 13:40:44 user nova-compute[231753]:     <acpi/>
Jul 29 13:40:44 user nova-compute[231753]:     <apic/>
Jul 29 13:40:44 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:40:44 user nova-compute[231753]:   </features>
Jul 29 13:40:44 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:40:44 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:40:44 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:40:44 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:40:44 user nova-compute[231753]:   </clock>
Jul 29 13:40:44 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:40:44 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:40:44 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:40:44 user nova-compute[231753]:   </cpu>
Jul 29 13:40:44 user nova-compute[231753]:   <devices>
Jul 29 13:40:44 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:40:44 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:40:44 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/disk"/>
Jul 29 13:40:44 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:40:44 user nova-compute[231753]:     </disk>
Jul 29 13:40:44 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:40:44 user nova-compute[231753]:       <mac address="fa:16:3e:33:c2:0b"/>
Jul 29 13:40:44 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:40:44 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:40:44 user nova-compute[231753]:       <target dev="tap7066a691-99"/>
Jul 29 13:40:44 user nova-compute[231753]:     </interface>
Jul 29 13:40:44 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:40:44 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/console.log" append="off"/>
Jul 29 13:40:44 user nova-compute[231753]:     </serial>
Jul 29 13:40:44 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:40:44 user nova-compute[231753]:     <video>
Jul 29 13:40:44 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:40:44 user nova-compute[231753]:     </video>
Jul 29 13:40:44 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:40:44 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:40:44 user nova-compute[231753]:     </rng>
Jul 29 13:40:44 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:40:44 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:40:44 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:40:44 user nova-compute[231753]:     </memballoon>
Jul 29 13:40:44 user nova-compute[231753]:   </devices>
Jul 29 13:40:44 user nova-compute[231753]: </domain>
Jul 29 13:40:44 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:40:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1785686519',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1785686519',id=22,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIltVyANnBLQo5ZkaO2rhyJWlvJIw2quOPh0zhPSCEV5HqmmGHMXccTyUpnsRkyvdMtse0ovY8hkA/H4UxPyXE0wALQj07YRnF9pVYigWhQcgRInlw5MXYbG0KJZyckXbw==',key_name='tempest-keypair-1407725312',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='d53ebbb5f2e440dfa0cf3950232b4853',ramdisk_id='',reservation_id='r-u7dl5zqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-460717858',owner_user_name='tempest-AttachVolumeShelveTestJSON-460717858-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:40:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='932b5bd757f94be29d52035fd9f70293',uuid=16097b06-976f-4fcd-a449-7b1ec8f739d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7066a691-9911-48c6-a50c-de2e25f08f1d", "address": "fa:16:3e:33:c2:0b", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7066a691-99", "ovs_interfaceid": "7066a691-9911-48c6-a50c-de2e25f08f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Converting VIF {"id": "7066a691-9911-48c6-a50c-de2e25f08f1d", "address": "fa:16:3e:33:c2:0b", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7066a691-99", "ovs_interfaceid": "7066a691-9911-48c6-a50c-de2e25f08f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:c2:0b,bridge_name='br-int',has_traffic_filtering=True,id=7066a691-9911-48c6-a50c-de2e25f08f1d,network=Network(9be19067-cc29-4c67-95a0-cf37f95f9fc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7066a691-99') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG os_vif [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:c2:0b,bridge_name='br-int',has_traffic_filtering=True,id=7066a691-9911-48c6-a50c-de2e25f08f1d,network=Network(9be19067-cc29-4c67-95a0-cf37f95f9fc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7066a691-99') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638044.256217, 576f5002-4e4d-4236-8b0f-9b8788246de2 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:40:44 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] VM Resumed (Lifecycle Event)
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.compute.manager [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7066a691-99, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7066a691-99, col_values=(('external_ids', {'iface-id': '7066a691-9911-48c6-a50c-de2e25f08f1d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:c2:0b', 'vm-uuid': '16097b06-976f-4fcd-a449-7b1ec8f739d1'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:40:44 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Instance spawned successfully.
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:44 user nova-compute[231753]: INFO os_vif [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:c2:0b,bridge_name='br-int',has_traffic_filtering=True,id=7066a691-9911-48c6-a50c-de2e25f08f1d,network=Network(9be19067-cc29-4c67-95a0-cf37f95f9fc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7066a691-99')
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:40:44 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638044.256733, 576f5002-4e4d-4236-8b0f-9b8788246de2 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:40:44 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] VM Started (Lifecycle Event)
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] No VIF found with MAC fa:16:3e:33:c2:0b, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:40:44 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:40:44 user nova-compute[231753]: INFO nova.compute.manager [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Took 6.32 seconds to spawn the instance on the hypervisor.
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.compute.manager [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:40:44 user nova-compute[231753]: INFO nova.compute.manager [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Took 7.22 seconds to build instance.
Jul 29 13:40:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-f30c8bf4-45cb-45af-8cd7-5a6364c95db8 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "576f5002-4e4d-4236-8b0f-9b8788246de2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.315s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-af7810b2-ba44-41af-b76e-292d19df1e1e req-4e4a1216-757e-47e1-99ea-0592d1847566 service nova] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Received event network-vif-plugged-89a6c6db-c40f-428c-8739-3f780154f935 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-af7810b2-ba44-41af-b76e-292d19df1e1e req-4e4a1216-757e-47e1-99ea-0592d1847566 service nova] Acquiring lock "576f5002-4e4d-4236-8b0f-9b8788246de2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-af7810b2-ba44-41af-b76e-292d19df1e1e req-4e4a1216-757e-47e1-99ea-0592d1847566 service nova] Lock "576f5002-4e4d-4236-8b0f-9b8788246de2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-af7810b2-ba44-41af-b76e-292d19df1e1e req-4e4a1216-757e-47e1-99ea-0592d1847566 service nova] Lock "576f5002-4e4d-4236-8b0f-9b8788246de2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-af7810b2-ba44-41af-b76e-292d19df1e1e req-4e4a1216-757e-47e1-99ea-0592d1847566 service nova] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] No waiting events found dispatching network-vif-plugged-89a6c6db-c40f-428c-8739-3f780154f935 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:40:44 user nova-compute[231753]: WARNING nova.compute.manager [req-af7810b2-ba44-41af-b76e-292d19df1e1e req-4e4a1216-757e-47e1-99ea-0592d1847566 service nova] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Received unexpected event network-vif-plugged-89a6c6db-c40f-428c-8739-3f780154f935 for instance with vm_state active and task_state None.
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-af7810b2-ba44-41af-b76e-292d19df1e1e req-4e4a1216-757e-47e1-99ea-0592d1847566 service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Received event network-changed-7066a691-9911-48c6-a50c-de2e25f08f1d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-af7810b2-ba44-41af-b76e-292d19df1e1e req-4e4a1216-757e-47e1-99ea-0592d1847566 service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Refreshing instance network info cache due to event network-changed-7066a691-9911-48c6-a50c-de2e25f08f1d. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-af7810b2-ba44-41af-b76e-292d19df1e1e req-4e4a1216-757e-47e1-99ea-0592d1847566 service nova] Acquiring lock "refresh_cache-16097b06-976f-4fcd-a449-7b1ec8f739d1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-af7810b2-ba44-41af-b76e-292d19df1e1e req-4e4a1216-757e-47e1-99ea-0592d1847566 service nova] Acquired lock "refresh_cache-16097b06-976f-4fcd-a449-7b1ec8f739d1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.network.neutron [req-af7810b2-ba44-41af-b76e-292d19df1e1e req-4e4a1216-757e-47e1-99ea-0592d1847566 service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Refreshing network info cache for port 7066a691-9911-48c6-a50c-de2e25f08f1d {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-1aa0ac7c-a796-4085-b5e2-33cf6cee0b63 req-91a62a84-3e8c-4cc4-a98c-c18375673582 service nova] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Received event network-changed-a73b2376-652b-4f89-a463-3f854a2995ee {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-1aa0ac7c-a796-4085-b5e2-33cf6cee0b63 req-91a62a84-3e8c-4cc4-a98c-c18375673582 service nova] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Refreshing instance network info cache due to event network-changed-a73b2376-652b-4f89-a463-3f854a2995ee. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-1aa0ac7c-a796-4085-b5e2-33cf6cee0b63 req-91a62a84-3e8c-4cc4-a98c-c18375673582 service nova] Acquiring lock "refresh_cache-481435b2-4319-4caf-aa5b-5c986a747258" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-1aa0ac7c-a796-4085-b5e2-33cf6cee0b63 req-91a62a84-3e8c-4cc4-a98c-c18375673582 service nova] Acquired lock "refresh_cache-481435b2-4319-4caf-aa5b-5c986a747258" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:40:44 user nova-compute[231753]: DEBUG nova.network.neutron [req-1aa0ac7c-a796-4085-b5e2-33cf6cee0b63 req-91a62a84-3e8c-4cc4-a98c-c18375673582 service nova] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Refreshing network info cache for port a73b2376-652b-4f89-a463-3f854a2995ee {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:40:45 user nova-compute[231753]: DEBUG nova.network.neutron [req-1aa0ac7c-a796-4085-b5e2-33cf6cee0b63 req-91a62a84-3e8c-4cc4-a98c-c18375673582 service nova] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Updated VIF entry in instance network info cache for port a73b2376-652b-4f89-a463-3f854a2995ee. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:40:45 user nova-compute[231753]: DEBUG nova.network.neutron [req-1aa0ac7c-a796-4085-b5e2-33cf6cee0b63 req-91a62a84-3e8c-4cc4-a98c-c18375673582 service nova] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Updating instance_info_cache with network_info: [{"id": "a73b2376-652b-4f89-a463-3f854a2995ee", "address": "fa:16:3e:77:e8:2e", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73b2376-65", "ovs_interfaceid": "a73b2376-652b-4f89-a463-3f854a2995ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:40:45 user nova-compute[231753]: DEBUG nova.network.neutron [req-af7810b2-ba44-41af-b76e-292d19df1e1e req-4e4a1216-757e-47e1-99ea-0592d1847566 service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Updated VIF entry in instance network info cache for port 7066a691-9911-48c6-a50c-de2e25f08f1d. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:40:45 user nova-compute[231753]: DEBUG nova.network.neutron [req-af7810b2-ba44-41af-b76e-292d19df1e1e req-4e4a1216-757e-47e1-99ea-0592d1847566 service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Updating instance_info_cache with network_info: [{"id": "7066a691-9911-48c6-a50c-de2e25f08f1d", "address": "fa:16:3e:33:c2:0b", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7066a691-99", "ovs_interfaceid": "7066a691-9911-48c6-a50c-de2e25f08f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:40:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-1aa0ac7c-a796-4085-b5e2-33cf6cee0b63 req-91a62a84-3e8c-4cc4-a98c-c18375673582 service nova] Releasing lock "refresh_cache-481435b2-4319-4caf-aa5b-5c986a747258" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:40:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-af7810b2-ba44-41af-b76e-292d19df1e1e req-4e4a1216-757e-47e1-99ea-0592d1847566 service nova] Releasing lock "refresh_cache-16097b06-976f-4fcd-a449-7b1ec8f739d1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:40:45 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:45 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:45 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:46 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:46 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:46 user nova-compute[231753]: DEBUG nova.compute.manager [req-f0f2d978-396e-4166-9132-e0699dc02966 req-b995794c-6b75-4e77-b97e-06df36e909d9 service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Received event network-vif-plugged-7066a691-9911-48c6-a50c-de2e25f08f1d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:40:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-f0f2d978-396e-4166-9132-e0699dc02966 req-b995794c-6b75-4e77-b97e-06df36e909d9 service nova] Acquiring lock "16097b06-976f-4fcd-a449-7b1ec8f739d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:40:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-f0f2d978-396e-4166-9132-e0699dc02966 req-b995794c-6b75-4e77-b97e-06df36e909d9 service nova] Lock "16097b06-976f-4fcd-a449-7b1ec8f739d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:40:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-f0f2d978-396e-4166-9132-e0699dc02966 req-b995794c-6b75-4e77-b97e-06df36e909d9 service nova] Lock "16097b06-976f-4fcd-a449-7b1ec8f739d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:40:46 user nova-compute[231753]: DEBUG nova.compute.manager [req-f0f2d978-396e-4166-9132-e0699dc02966 req-b995794c-6b75-4e77-b97e-06df36e909d9 service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] No waiting events found dispatching network-vif-plugged-7066a691-9911-48c6-a50c-de2e25f08f1d {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:40:46 user nova-compute[231753]: WARNING nova.compute.manager [req-f0f2d978-396e-4166-9132-e0699dc02966 req-b995794c-6b75-4e77-b97e-06df36e909d9 service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Received unexpected event network-vif-plugged-7066a691-9911-48c6-a50c-de2e25f08f1d for instance with vm_state building and task_state spawning.
Jul 29 13:40:46 user nova-compute[231753]: DEBUG nova.compute.manager [req-f0f2d978-396e-4166-9132-e0699dc02966 req-b995794c-6b75-4e77-b97e-06df36e909d9 service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Received event network-vif-plugged-7066a691-9911-48c6-a50c-de2e25f08f1d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:40:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-f0f2d978-396e-4166-9132-e0699dc02966 req-b995794c-6b75-4e77-b97e-06df36e909d9 service nova] Acquiring lock "16097b06-976f-4fcd-a449-7b1ec8f739d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:40:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-f0f2d978-396e-4166-9132-e0699dc02966 req-b995794c-6b75-4e77-b97e-06df36e909d9 service nova] Lock "16097b06-976f-4fcd-a449-7b1ec8f739d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:40:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-f0f2d978-396e-4166-9132-e0699dc02966 req-b995794c-6b75-4e77-b97e-06df36e909d9 service nova] Lock "16097b06-976f-4fcd-a449-7b1ec8f739d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:40:46 user nova-compute[231753]: DEBUG nova.compute.manager [req-f0f2d978-396e-4166-9132-e0699dc02966 req-b995794c-6b75-4e77-b97e-06df36e909d9 service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] No waiting events found dispatching network-vif-plugged-7066a691-9911-48c6-a50c-de2e25f08f1d {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:40:46 user nova-compute[231753]: WARNING nova.compute.manager [req-f0f2d978-396e-4166-9132-e0699dc02966 req-b995794c-6b75-4e77-b97e-06df36e909d9 service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Received unexpected event network-vif-plugged-7066a691-9911-48c6-a50c-de2e25f08f1d for instance with vm_state building and task_state spawning.
Jul 29 13:40:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:48 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638048.497951, 16097b06-976f-4fcd-a449-7b1ec8f739d1 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:40:48 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] VM Resumed (Lifecycle Event)
Jul 29 13:40:48 user nova-compute[231753]: DEBUG nova.compute.manager [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:40:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:40:48 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Instance spawned successfully.
Jul 29 13:40:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:40:48 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:40:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:40:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:40:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:40:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:40:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:40:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:40:48 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:40:48 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:40:48 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638048.4982176, 16097b06-976f-4fcd-a449-7b1ec8f739d1 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:40:48 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] VM Started (Lifecycle Event)
Jul 29 13:40:48 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:40:48 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:40:48 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:40:48 user nova-compute[231753]: INFO nova.compute.manager [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Took 7.02 seconds to spawn the instance on the hypervisor.
Jul 29 13:40:48 user nova-compute[231753]: DEBUG nova.compute.manager [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:40:48 user nova-compute[231753]: INFO nova.compute.manager [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Took 7.81 seconds to build instance.
Jul 29 13:40:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-344cf752-0917-4bd0-ba28-8146397fc50a tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "16097b06-976f-4fcd-a449-7b1ec8f739d1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.912s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:40:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "481435b2-4319-4caf-aa5b-5c986a747258" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:40:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "481435b2-4319-4caf-aa5b-5c986a747258" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:40:48 user nova-compute[231753]: DEBUG nova.objects.instance [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lazy-loading 'flavor' on Instance uuid 481435b2-4319-4caf-aa5b-5c986a747258 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:40:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "481435b2-4319-4caf-aa5b-5c986a747258" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.062s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:40:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "481435b2-4319-4caf-aa5b-5c986a747258" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:40:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "481435b2-4319-4caf-aa5b-5c986a747258" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:40:49 user nova-compute[231753]: INFO nova.compute.manager [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Attaching volume 27a0926a-875c-4f2d-bdcf-fce9178772b0 to /dev/vdb
Jul 29 13:40:49 user nova-compute[231753]: DEBUG os_brick.utils [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:40:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:49 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[668b8fef-693c-4141-b334-59d6ea196f76]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:40:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:49 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b285de2-2160-45c2-b757-f21f89f62df7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:40:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:49 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a9ed1f4-aa9e-45ab-bb6d-54df68cfb6b5]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:40:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:49 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f34e0cdf-aa0c-4141-ac1a-36e60daa89d9]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:40:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:40:49 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:40:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:40:49 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:40:49 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[557425c8-29fb-45e2-a809-692d3b33db00]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:40:49 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:40:49 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:40:49 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:40:49 user nova-compute[231753]: DEBUG os_brick.utils [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] <== get_connector_properties: return (156ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:40:49 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Updating existing volume attachment record: be2922bd-d732-40cd-a057-3b7f8f0f3d8a {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:40:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yfIMhgvi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:40:57 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:40:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:40:57 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:40:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:40:57 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:40:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4866f28-5b59-45a1-a294-0fe2d6e3ae46]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:40:57 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[36426081-732e-4986-8b34-a6cbe6977103]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0] added
Jul 29 13:40:57 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6fc960c-4bd7-4078-8e2d-f6785f7edd00]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[51405e6f-d84f-4bea-8de9-7253afdac030]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yfIMhgvi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yfIMhgvi" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b95db2fe-6fd2-439a-ae5b-acdb2adfb9cb]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yfIMhgvi'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ee98ca4-839f-4615-804e-df60289bf011]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea763f5e-276b-409e-b578-31e779e3cb1d]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:40:57 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:40:57 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 -p 172.16.0.220:3260 --login" returned: 0 in 0.054s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd2e1510-2eea-4df8-b92e-70e2781f2bbc]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0, portal: 172.16.0.220,3260]
Jul 29 13:40:57 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0, portal: 172.16.0.220,3260] successful.
Jul 29 13:40:57 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[40bac52b-b22a-441f-b436-4783ebb7f624]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c9e7ccc-c53c-4876-b24e-ce49c0b126df]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:40:57 user nova-compute[231753]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:40:57 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:40:57 user nova-compute[231753]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:40:57 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.289s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] HCTL ('34', '-', '-', 0) found on session 23 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a959a77-360a-4fbe-af2d-65cc30b83389]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Searching for a device in session 23 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:40:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yfIMhgvi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:40:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.333s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:40:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '23837633064623565', 'path': '/dev/sdc'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:40:58 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23837633064623565', 'path': '/dev/sdc'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:40:58 user nova-compute[231753]: DEBUG nova.objects.instance [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lazy-loading 'flavor' on Instance uuid 481435b2-4319-4caf-aa5b-5c986a747258 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:40:58 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 13:40:58 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:40:58 user nova-compute[231753]:   <source dev="/dev/sdc"/>
Jul 29 13:40:58 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:40:58 user nova-compute[231753]:   <serial>27a0926a-875c-4f2d-bdcf-fce9178772b0</serial>
Jul 29 13:40:58 user nova-compute[231753]: </disk>
Jul 29 13:40:58 user nova-compute[231753]:  {{(pid=231753) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 13:40:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:40:59 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:40:59 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] No BDM found with device name vdb, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:40:59 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] No VIF found with MAC fa:16:3e:77:e8:2e, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:40:59 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e0e656ff-492d-4100-b25e-6854b5360567 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "481435b2-4319-4caf-aa5b-5c986a747258" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.431s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:41:00 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:41:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:41:04 user nova-compute[231753]: DEBUG nova.compute.manager [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:41:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:41:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:41:04 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:41:04 user nova-compute[231753]: INFO nova.compute.claims [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Claim successful on node user
Jul 29 13:41:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:04 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:41:04 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:41:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.499s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:41:04 user nova-compute[231753]: DEBUG nova.compute.manager [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:41:04 user nova-compute[231753]: DEBUG nova.compute.manager [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:41:04 user nova-compute[231753]: DEBUG nova.network.neutron [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:41:04 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:41:04 user nova-compute[231753]: DEBUG nova.compute.manager [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:41:04 user nova-compute[231753]: DEBUG nova.policy [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a09de75c8ab742fe951604b612ea5839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3122196c4504a82a2a01774ab60406a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:41:04 user nova-compute[231753]: DEBUG nova.compute.manager [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:41:04 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:41:04 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Creating image(s)
Jul 29 13:41:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "/opt/stack/data/nova/instances/627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:41:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "/opt/stack/data/nova/instances/627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:41:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "/opt/stack/data/nova/instances/627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:41:04 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.140s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:41:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:41:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.136s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb/disk 1073741824" returned: 0 in 0.057s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:41:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.146s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:05 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Checking if we can resize image /opt/stack/data/nova/instances/627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:41:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:05 user nova-compute[231753]: DEBUG nova.network.neutron [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Successfully created port: a734ebff-155c-4861-ae71-26ab6a2b794f {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:41:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:05 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Cannot resize image /opt/stack/data/nova/instances/627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:41:05 user nova-compute[231753]: DEBUG nova.objects.instance [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lazy-loading 'migration_context' on Instance uuid 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:41:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:41:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Ensure instance console log exists: /opt/stack/data/nova/instances/627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:41:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:41:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:41:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG nova.network.neutron [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Successfully updated port: a734ebff-155c-4861-ae71-26ab6a2b794f {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "refresh_cache-627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquired lock "refresh_cache-627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG nova.network.neutron [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG nova.compute.manager [req-89fcb9c4-b110-4aae-b10d-8fcb0daa9d17 req-b74a65db-8cb1-4867-91dc-b902975c4f81 service nova] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Received event network-changed-a734ebff-155c-4861-ae71-26ab6a2b794f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG nova.compute.manager [req-89fcb9c4-b110-4aae-b10d-8fcb0daa9d17 req-b74a65db-8cb1-4867-91dc-b902975c4f81 service nova] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Refreshing instance network info cache due to event network-changed-a734ebff-155c-4861-ae71-26ab6a2b794f. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-89fcb9c4-b110-4aae-b10d-8fcb0daa9d17 req-b74a65db-8cb1-4867-91dc-b902975c4f81 service nova] Acquiring lock "refresh_cache-627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG nova.network.neutron [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG nova.network.neutron [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Updating instance_info_cache with network_info: [{"id": "a734ebff-155c-4861-ae71-26ab6a2b794f", "address": "fa:16:3e:28:dc:4c", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa734ebff-15", "ovs_interfaceid": "a734ebff-155c-4861-ae71-26ab6a2b794f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Releasing lock "refresh_cache-627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG nova.compute.manager [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Instance network_info: |[{"id": "a734ebff-155c-4861-ae71-26ab6a2b794f", "address": "fa:16:3e:28:dc:4c", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa734ebff-15", "ovs_interfaceid": "a734ebff-155c-4861-ae71-26ab6a2b794f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-89fcb9c4-b110-4aae-b10d-8fcb0daa9d17 req-b74a65db-8cb1-4867-91dc-b902975c4f81 service nova] Acquired lock "refresh_cache-627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG nova.network.neutron [req-89fcb9c4-b110-4aae-b10d-8fcb0daa9d17 req-b74a65db-8cb1-4867-91dc-b902975c4f81 service nova] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Refreshing network info cache for port a734ebff-155c-4861-ae71-26ab6a2b794f {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Start _get_guest_xml network_info=[{"id": "a734ebff-155c-4861-ae71-26ab6a2b794f", "address": "fa:16:3e:28:dc:4c", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa734ebff-15", "ovs_interfaceid": "a734ebff-155c-4861-ae71-26ab6a2b794f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:41:06 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:41:06 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:41:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-278113094',display_name='tempest-AttachVolumeNegativeTest-server-278113094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-278113094',id=23,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCw+nln1PMAQSc3mEp48EwaUKF1xqasXXy9+La1d4yOKfsTSxlR+P7FbTXFFiuDVLV+SoXac5JlLoARhkFgmhltTSKNnY1uI3tUcqgGZ5b/WLkfx1TGIRB45PUjU8ko+4w==',key_name='tempest-keypair-470099786',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3122196c4504a82a2a01774ab60406a',ramdisk_id='',reservation_id='r-cg7hfqig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1031975907',owner_user_name='tempest-AttachVolumeNegativeTest-1031975907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:41:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a09de75c8ab742fe951604b612ea5839',uuid=627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a734ebff-155c-4861-ae71-26ab6a2b794f", "address": "fa:16:3e:28:dc:4c", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa734ebff-15", "ovs_interfaceid": "a734ebff-155c-4861-ae71-26ab6a2b794f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Converting VIF {"id": "a734ebff-155c-4861-ae71-26ab6a2b794f", "address": "fa:16:3e:28:dc:4c", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa734ebff-15", "ovs_interfaceid": "a734ebff-155c-4861-ae71-26ab6a2b794f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:dc:4c,bridge_name='br-int',has_traffic_filtering=True,id=a734ebff-155c-4861-ae71-26ab6a2b794f,network=Network(1ff03660-77ea-4ec6-8eeb-55df7e78096b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa734ebff-15') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG nova.objects.instance [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lazy-loading 'pci_devices' on Instance uuid 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:41:06 user nova-compute[231753]:   <uuid>627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb</uuid>
Jul 29 13:41:06 user nova-compute[231753]:   <name>instance-00000017</name>
Jul 29 13:41:06 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:41:06 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:41:06 user nova-compute[231753]:   <metadata>
Jul 29 13:41:06 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:41:06 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:41:06 user nova-compute[231753]:       <nova:name>tempest-AttachVolumeNegativeTest-server-278113094</nova:name>
Jul 29 13:41:06 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:41:06</nova:creationTime>
Jul 29 13:41:06 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:41:06 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:41:06 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:41:06 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:41:06 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:41:06 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:41:06 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:41:06 user nova-compute[231753]:       <nova:owner>
Jul 29 13:41:06 user nova-compute[231753]:         <nova:user uuid="a09de75c8ab742fe951604b612ea5839">tempest-AttachVolumeNegativeTest-1031975907-project-member</nova:user>
Jul 29 13:41:06 user nova-compute[231753]:         <nova:project uuid="f3122196c4504a82a2a01774ab60406a">tempest-AttachVolumeNegativeTest-1031975907</nova:project>
Jul 29 13:41:06 user nova-compute[231753]:       </nova:owner>
Jul 29 13:41:06 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:41:06 user nova-compute[231753]:       <nova:ports>
Jul 29 13:41:06 user nova-compute[231753]:         <nova:port uuid="a734ebff-155c-4861-ae71-26ab6a2b794f">
Jul 29 13:41:06 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 29 13:41:06 user nova-compute[231753]:         </nova:port>
Jul 29 13:41:06 user nova-compute[231753]:       </nova:ports>
Jul 29 13:41:06 user nova-compute[231753]:     </nova:instance>
Jul 29 13:41:06 user nova-compute[231753]:   </metadata>
Jul 29 13:41:06 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:41:06 user nova-compute[231753]:     <system>
Jul 29 13:41:06 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:41:06 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:41:06 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:41:06 user nova-compute[231753]:       <entry name="serial">627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb</entry>
Jul 29 13:41:06 user nova-compute[231753]:       <entry name="uuid">627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb</entry>
Jul 29 13:41:06 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:41:06 user nova-compute[231753]:     </system>
Jul 29 13:41:06 user nova-compute[231753]:   </sysinfo>
Jul 29 13:41:06 user nova-compute[231753]:   <os>
Jul 29 13:41:06 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:41:06 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:41:06 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:41:06 user nova-compute[231753]:   </os>
Jul 29 13:41:06 user nova-compute[231753]:   <features>
Jul 29 13:41:06 user nova-compute[231753]:     <acpi/>
Jul 29 13:41:06 user nova-compute[231753]:     <apic/>
Jul 29 13:41:06 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:41:06 user nova-compute[231753]:   </features>
Jul 29 13:41:06 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:41:06 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:41:06 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:41:06 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:41:06 user nova-compute[231753]:   </clock>
Jul 29 13:41:06 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:41:06 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:41:06 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:41:06 user nova-compute[231753]:   </cpu>
Jul 29 13:41:06 user nova-compute[231753]:   <devices>
Jul 29 13:41:06 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:41:06 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:41:06 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb/disk"/>
Jul 29 13:41:06 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:41:06 user nova-compute[231753]:     </disk>
Jul 29 13:41:06 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:41:06 user nova-compute[231753]:       <mac address="fa:16:3e:28:dc:4c"/>
Jul 29 13:41:06 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:41:06 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:41:06 user nova-compute[231753]:       <target dev="tapa734ebff-15"/>
Jul 29 13:41:06 user nova-compute[231753]:     </interface>
Jul 29 13:41:06 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:41:06 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb/console.log" append="off"/>
Jul 29 13:41:06 user nova-compute[231753]:     </serial>
Jul 29 13:41:06 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:41:06 user nova-compute[231753]:     <video>
Jul 29 13:41:06 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:41:06 user nova-compute[231753]:     </video>
Jul 29 13:41:06 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:41:06 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:41:06 user nova-compute[231753]:     </rng>
Jul 29 13:41:06 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:41:06 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:41:06 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:41:06 user nova-compute[231753]:     </memballoon>
Jul 29 13:41:06 user nova-compute[231753]:   </devices>
Jul 29 13:41:06 user nova-compute[231753]: </domain>
Jul 29 13:41:06 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-278113094',display_name='tempest-AttachVolumeNegativeTest-server-278113094',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-278113094',id=23,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCw+nln1PMAQSc3mEp48EwaUKF1xqasXXy9+La1d4yOKfsTSxlR+P7FbTXFFiuDVLV+SoXac5JlLoARhkFgmhltTSKNnY1uI3tUcqgGZ5b/WLkfx1TGIRB45PUjU8ko+4w==',key_name='tempest-keypair-470099786',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3122196c4504a82a2a01774ab60406a',ramdisk_id='',reservation_id='r-cg7hfqig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1031975907',owner_user_name='tempest-AttachVolumeNegativeTest-1031975907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:41:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a09de75c8ab742fe951604b612ea5839',uuid=627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a734ebff-155c-4861-ae71-26ab6a2b794f", "address": "fa:16:3e:28:dc:4c", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa734ebff-15", "ovs_interfaceid": "a734ebff-155c-4861-ae71-26ab6a2b794f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Converting VIF {"id": "a734ebff-155c-4861-ae71-26ab6a2b794f", "address": "fa:16:3e:28:dc:4c", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa734ebff-15", "ovs_interfaceid": "a734ebff-155c-4861-ae71-26ab6a2b794f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:dc:4c,bridge_name='br-int',has_traffic_filtering=True,id=a734ebff-155c-4861-ae71-26ab6a2b794f,network=Network(1ff03660-77ea-4ec6-8eeb-55df7e78096b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa734ebff-15') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG os_vif [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:dc:4c,bridge_name='br-int',has_traffic_filtering=True,id=a734ebff-155c-4861-ae71-26ab6a2b794f,network=Network(1ff03660-77ea-4ec6-8eeb-55df7e78096b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa734ebff-15') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa734ebff-15, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa734ebff-15, col_values=(('external_ids', {'iface-id': 'a734ebff-155c-4861-ae71-26ab6a2b794f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:28:dc:4c', 'vm-uuid': '627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:06 user nova-compute[231753]: INFO os_vif [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:dc:4c,bridge_name='br-int',has_traffic_filtering=True,id=a734ebff-155c-4861-ae71-26ab6a2b794f,network=Network(1ff03660-77ea-4ec6-8eeb-55df7e78096b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa734ebff-15')
Jul 29 13:41:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:41:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] No VIF found with MAC fa:16:3e:28:dc:4c, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:41:07 user nova-compute[231753]: DEBUG nova.network.neutron [req-89fcb9c4-b110-4aae-b10d-8fcb0daa9d17 req-b74a65db-8cb1-4867-91dc-b902975c4f81 service nova] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Updated VIF entry in instance network info cache for port a734ebff-155c-4861-ae71-26ab6a2b794f. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:41:07 user nova-compute[231753]: DEBUG nova.network.neutron [req-89fcb9c4-b110-4aae-b10d-8fcb0daa9d17 req-b74a65db-8cb1-4867-91dc-b902975c4f81 service nova] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Updating instance_info_cache with network_info: [{"id": "a734ebff-155c-4861-ae71-26ab6a2b794f", "address": "fa:16:3e:28:dc:4c", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa734ebff-15", "ovs_interfaceid": "a734ebff-155c-4861-ae71-26ab6a2b794f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:41:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-89fcb9c4-b110-4aae-b10d-8fcb0daa9d17 req-b74a65db-8cb1-4867-91dc-b902975c4f81 service nova] Releasing lock "refresh_cache-627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:41:07 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:41:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "b99a72ba-73e2-4be7-b52b-7797351daa5f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:41:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "b99a72ba-73e2-4be7-b52b-7797351daa5f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:41:07 user nova-compute[231753]: DEBUG nova.compute.manager [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:41:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:41:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:41:07 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:41:07 user nova-compute[231753]: INFO nova.compute.claims [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Claim successful on node user
Jul 29 13:41:08 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:08 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:08 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:08 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:41:08 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:41:08 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:41:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:41:08 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:08 user nova-compute[231753]: DEBUG nova.compute.manager [req-519d868c-4770-40c5-a669-17b3c6895949 req-fcd5e269-6a86-4438-8bf3-c451bde45fbf service nova] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Received event network-vif-plugged-a734ebff-155c-4861-ae71-26ab6a2b794f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:41:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-519d868c-4770-40c5-a669-17b3c6895949 req-fcd5e269-6a86-4438-8bf3-c451bde45fbf service nova] Acquiring lock "627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:41:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-519d868c-4770-40c5-a669-17b3c6895949 req-fcd5e269-6a86-4438-8bf3-c451bde45fbf service nova] Lock "627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:41:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-519d868c-4770-40c5-a669-17b3c6895949 req-fcd5e269-6a86-4438-8bf3-c451bde45fbf service nova] Lock "627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:41:08 user nova-compute[231753]: DEBUG nova.compute.manager [req-519d868c-4770-40c5-a669-17b3c6895949 req-fcd5e269-6a86-4438-8bf3-c451bde45fbf service nova] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] No waiting events found dispatching network-vif-plugged-a734ebff-155c-4861-ae71-26ab6a2b794f {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:41:08 user nova-compute[231753]: WARNING nova.compute.manager [req-519d868c-4770-40c5-a669-17b3c6895949 req-fcd5e269-6a86-4438-8bf3-c451bde45fbf service nova] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Received unexpected event network-vif-plugged-a734ebff-155c-4861-ae71-26ab6a2b794f for instance with vm_state building and task_state spawning.
Jul 29 13:41:08 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:08 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:08 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:41:08 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:41:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.558s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:41:08 user nova-compute[231753]: DEBUG nova.compute.manager [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:41:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.210s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:41:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:41:08 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 13:41:08 user nova-compute[231753]: DEBUG nova.compute.manager [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:41:08 user nova-compute[231753]: DEBUG nova.network.neutron [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:41:08 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:41:08 user nova-compute[231753]: DEBUG nova.compute.manager [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:41:08 user nova-compute[231753]: INFO nova.virt.block_device [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Booting with blank volume at /dev/vda
Jul 29 13:41:08 user nova-compute[231753]: DEBUG nova.policy [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '618ce2d56c3c4ee8ace871d308ca45fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01165e83a3143ad83f050790f2b63fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:41:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:41:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:09 user nova-compute[231753]: DEBUG nova.network.neutron [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Successfully created port: d145cf59-908e-42c4-ba8e-ce5abe640639 {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:41:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:10 user nova-compute[231753]: DEBUG nova.compute.manager [req-ac19c0ca-6858-4953-bf3b-b48b1dfacae7 req-421d7db5-d268-49d9-8cb2-266076c5a2ae service nova] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Received event network-vif-plugged-a734ebff-155c-4861-ae71-26ab6a2b794f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:41:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ac19c0ca-6858-4953-bf3b-b48b1dfacae7 req-421d7db5-d268-49d9-8cb2-266076c5a2ae service nova] Acquiring lock "627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:41:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ac19c0ca-6858-4953-bf3b-b48b1dfacae7 req-421d7db5-d268-49d9-8cb2-266076c5a2ae service nova] Lock "627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:41:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ac19c0ca-6858-4953-bf3b-b48b1dfacae7 req-421d7db5-d268-49d9-8cb2-266076c5a2ae service nova] Lock "627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:41:10 user nova-compute[231753]: DEBUG nova.compute.manager [req-ac19c0ca-6858-4953-bf3b-b48b1dfacae7 req-421d7db5-d268-49d9-8cb2-266076c5a2ae service nova] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] No waiting events found dispatching network-vif-plugged-a734ebff-155c-4861-ae71-26ab6a2b794f {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:41:10 user nova-compute[231753]: WARNING nova.compute.manager [req-ac19c0ca-6858-4953-bf3b-b48b1dfacae7 req-421d7db5-d268-49d9-8cb2-266076c5a2ae service nova] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Received unexpected event network-vif-plugged-a734ebff-155c-4861-ae71-26ab6a2b794f for instance with vm_state building and task_state spawning.
Jul 29 13:41:10 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638070.576164, 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:41:10 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] VM Resumed (Lifecycle Event)
Jul 29 13:41:10 user nova-compute[231753]: DEBUG nova.compute.manager [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:41:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:41:10 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Instance spawned successfully.
Jul 29 13:41:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:41:10 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:41:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:10 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:41:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:41:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:41:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:41:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:41:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:41:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:41:10 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:41:10 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638070.5827136, 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:41:10 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] VM Started (Lifecycle Event)
Jul 29 13:41:10 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:41:10 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:41:10 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:41:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:10 user nova-compute[231753]: INFO nova.compute.manager [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Took 5.98 seconds to spawn the instance on the hypervisor.
Jul 29 13:41:10 user nova-compute[231753]: DEBUG nova.compute.manager [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:41:10 user nova-compute[231753]: INFO nova.compute.manager [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Took 6.83 seconds to build instance.
Jul 29 13:41:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json" returned: 0 in 0.132s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-81c63275-aa72-4f93-8a1e-fff1c938006a tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.951s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:41:11 user nova-compute[231753]: DEBUG nova.network.neutron [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Successfully updated port: d145cf59-908e-42c4-ba8e-ce5abe640639 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:41:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json" returned: 0 in 0.131s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "refresh_cache-b99a72ba-73e2-4be7-b52b-7797351daa5f" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:41:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquired lock "refresh_cache-b99a72ba-73e2-4be7-b52b-7797351daa5f" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:41:11 user nova-compute[231753]: DEBUG nova.network.neutron [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:41:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:11 user nova-compute[231753]: DEBUG nova.network.neutron [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:41:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json" returned: 0 in 0.191s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:11 user nova-compute[231753]: DEBUG nova.network.neutron [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Updating instance_info_cache with network_info: [{"id": "d145cf59-908e-42c4-ba8e-ce5abe640639", "address": "fa:16:3e:25:37:92", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd145cf59-90", "ovs_interfaceid": "d145cf59-908e-42c4-ba8e-ce5abe640639", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:41:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Releasing lock "refresh_cache-b99a72ba-73e2-4be7-b52b-7797351daa5f" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:41:11 user nova-compute[231753]: DEBUG nova.compute.manager [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Instance network_info: |[{"id": "d145cf59-908e-42c4-ba8e-ce5abe640639", "address": "fa:16:3e:25:37:92", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd145cf59-90", "ovs_interfaceid": "d145cf59-908e-42c4-ba8e-ce5abe640639", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:41:11 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8c3210-37e5-4e33-8ea4-98a70fa9800b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8c3210-37e5-4e33-8ea4-98a70fa9800b/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8c3210-37e5-4e33-8ea4-98a70fa9800b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8c3210-37e5-4e33-8ea4-98a70fa9800b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:12 user nova-compute[231753]: DEBUG nova.compute.manager [req-23c26273-7350-48ea-bccb-59498f3b313f req-74b9df3a-23b1-446f-8398-767d7791e392 service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Received event network-changed-d145cf59-908e-42c4-ba8e-ce5abe640639 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:41:12 user nova-compute[231753]: DEBUG nova.compute.manager [req-23c26273-7350-48ea-bccb-59498f3b313f req-74b9df3a-23b1-446f-8398-767d7791e392 service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Refreshing instance network info cache due to event network-changed-d145cf59-908e-42c4-ba8e-ce5abe640639. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:41:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-23c26273-7350-48ea-bccb-59498f3b313f req-74b9df3a-23b1-446f-8398-767d7791e392 service nova] Acquiring lock "refresh_cache-b99a72ba-73e2-4be7-b52b-7797351daa5f" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:41:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-23c26273-7350-48ea-bccb-59498f3b313f req-74b9df3a-23b1-446f-8398-767d7791e392 service nova] Acquired lock "refresh_cache-b99a72ba-73e2-4be7-b52b-7797351daa5f" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:41:12 user nova-compute[231753]: DEBUG nova.network.neutron [req-23c26273-7350-48ea-bccb-59498f3b313f req-74b9df3a-23b1-446f-8398-767d7791e392 service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Refreshing network info cache for port d145cf59-908e-42c4-ba8e-ce5abe640639 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:41:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:13 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:41:13 user nova-compute[231753]: DEBUG nova.network.neutron [req-23c26273-7350-48ea-bccb-59498f3b313f req-74b9df3a-23b1-446f-8398-767d7791e392 service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Updated VIF entry in instance network info cache for port d145cf59-908e-42c4-ba8e-ce5abe640639. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:41:13 user nova-compute[231753]: DEBUG nova.network.neutron [req-23c26273-7350-48ea-bccb-59498f3b313f req-74b9df3a-23b1-446f-8398-767d7791e392 service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Updating instance_info_cache with network_info: [{"id": "d145cf59-908e-42c4-ba8e-ce5abe640639", "address": "fa:16:3e:25:37:92", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd145cf59-90", "ovs_interfaceid": "d145cf59-908e-42c4-ba8e-ce5abe640639", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:41:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-23c26273-7350-48ea-bccb-59498f3b313f req-74b9df3a-23b1-446f-8398-767d7791e392 service nova] Releasing lock "refresh_cache-b99a72ba-73e2-4be7-b52b-7797351daa5f" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:41:13 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:13 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:41:13 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:41:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=6959MB free_disk=25.28472137451172GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 13:41:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:41:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:41:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:41:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b67b98f8-a7b3-499e-ba32-9520bbced960 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:41:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 7e2615c1-b03e-4076-bcd9-3585fb11b8ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:41:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8ea52d41-7ec3-44d7-8421-133000ee887b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:41:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 63fad324-aac2-4d60-b4ce-a32a5736657d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:41:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance cf326e80-7293-4764-9411-ed05a5aeba23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:41:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 55bfcd1f-2b51-4e10-84a3-e132b96111e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:41:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 481435b2-4319-4caf-aa5b-5c986a747258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:41:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance aa8c3210-37e5-4e33-8ea4-98a70fa9800b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:41:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 576f5002-4e4d-4236-8b0f-9b8788246de2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:41:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 16097b06-976f-4fcd-a449-7b1ec8f739d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:41:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:41:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b99a72ba-73e2-4be7-b52b-7797351daa5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:41:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 13:41:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=7168MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 13:41:14 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:41:14 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:41:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 13:41:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.553s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:41:14 user nova-compute[231753]: DEBUG os_brick.utils [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:41:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:14 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b1bf8b3-a182-4b40-a6e8-ce5d43986fd4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:41:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:14 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[78174e69-6c5c-4a03-982a-43e40d029f64]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:41:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:14 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d11db94c-f40f-49e8-9fd0-c0eb1c536447]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:41:14 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb906cf3-7c4b-4f89-b777-86775afb9d5f]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:41:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:41:14 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:41:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:41:14 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:41:14 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae4398e-912f-4612-af4a-c0862f471a4b]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:41:14 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:41:14 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:41:14 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:41:14 user nova-compute[231753]: DEBUG os_brick.utils [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:41:14 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Updating existing volume attachment record: 0a783884-c888-464f-bbe9-87fd369f7dbd {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:41:15 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:41:15 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:41:15 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 13:41:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "refresh_cache-b67b98f8-a7b3-499e-ba32-9520bbced960" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:41:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquired lock "refresh_cache-b67b98f8-a7b3-499e-ba32-9520bbced960" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:41:15 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Forcefully refreshing network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 13:41:15 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Updating instance_info_cache with network_info: [{"id": "a19600e4-052d-44b1-87b3-73605975e810", "address": "fa:16:3e:7a:6e:42", "network": {"id": "092d27a5-871f-4865-ac97-fbb701a5c807", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-907499567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a6a49685124aaf93030ca59169dde5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa19600e4-05", "ovs_interfaceid": "a19600e4-052d-44b1-87b3-73605975e810", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:41:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Releasing lock "refresh_cache-b67b98f8-a7b3-499e-ba32-9520bbced960" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:41:15 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Updated the network info_cache for instance {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 13:41:15 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:41:15 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:41:15 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:41:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:17 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG nova.compute.manager [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:41:22 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Creating image(s)
Jul 29 13:41:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Did not create local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Ensure instance console log exists: /opt/stack/data/nova/instances/b99a72ba-73e2-4be7-b52b-7797351daa5f/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Start _get_guest_xml network_info=[{"id": "d145cf59-908e-42c4-ba8e-ce5abe640639", "address": "fa:16:3e:25:37:92", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd145cf59-90", "ovs_interfaceid": "d145cf59-908e-42c4-ba8e-ce5abe640639", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pxcjmHFe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'b99a72ba-73e2-4be7-b52b-7797351daa5f', 'attached_at': '', 'detached_at': '', 'volume_id': 'fda4c8ca-fe57-4522-b8bf-0086825e92ea', 'serial': 'fda4c8ca-fe57-4522-b8bf-0086825e92ea'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '0a783884-c888-464f-bbe9-87fd369f7dbd', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:41:22 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:41:22 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:41:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pxcjmHFe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:41:22 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:41:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:41:22 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:41:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:41:22 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e27f7dd9-66b7-4192-96b8-4570fb3a280b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:41:22 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dda4824-50be-4434-a6ad-2c7ac2df9cb6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea] added
Jul 29 13:41:22 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb9ef40f-4f19-4d94-96e8-91190db71e33]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d02bee-6692-49fe-a5a9-e106debcfdf3]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pxcjmHFe {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pxcjmHFe" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[def06e2d-4c6b-4c0c-b29f-6d08511e28a1]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pxcjmHFe'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[492f527e-b250-4b90-8fe6-380b1fdabd5e]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[598cd25b-3607-49b0-a831-4b6bf5f83948]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:41:22 user nova-compute[231753]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:41:22 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:41:22 user nova-compute[231753]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:41:22 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "8dd26572-fe6a-40fd-8c58-6af862b340c4" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG nova.compute.manager [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea -p 172.16.0.220:3260 --login" returned: 0 in 0.061s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[994f483d-cd3e-44e4-a0b1-fd7239ca9244]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea, portal: 172.16.0.220,3260]
Jul 29 13:41:22 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea, portal: 172.16.0.220,3260] successful.
Jul 29 13:41:22 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.027s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[49e376dc-219f-44a2-b4e0-cff6e873cfd5]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e90bec-ccb3-4431-af07-b02abdc0ed99]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:41:22 user nova-compute[231753]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:41:22 user nova-compute[231753]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:41:22 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:41:22 user nova-compute[231753]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:41:22 user nova-compute[231753]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:41:22 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] HCTL ('35', '-', '-', 0) found on session 24 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:41:22 user nova-compute[231753]: INFO nova.compute.claims [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Claim successful on node user
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fb30f69-8219-418a-aae3-fdf2be34559e]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:41:22 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: None {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.544s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG nova.network.neutron [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:41:23 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:41:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG nova.policy [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df1ccafc63e0418e9889541bb8ecd3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8801c6bc4b46ef9b407426c5eb07e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:41:23 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Creating image(s)
Jul 29 13:41:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "/opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "/opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "/opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.177s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Searching for a device in session 24 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pxcjmHFe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] <== connect_volume: return (1341ms) {'type': 'block', 'scsi_wwn': '23133363730373866', 'path': '/dev/sdd'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133363730373866', 'path': '/dev/sdd'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:41:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-697372546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-697372546',id=24,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c01165e83a3143ad83f050790f2b63fe',ramdisk_id='',reservation_id='r-9hzwg4i4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-93506270',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:41:09Z,user_data=None,user_id='618ce2d56c3c4ee8ace871d308ca45fb',uuid=b99a72ba-73e2-4be7-b52b-7797351daa5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d145cf59-908e-42c4-ba8e-ce5abe640639", "address": "fa:16:3e:25:37:92", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd145cf59-90", "ovs_interfaceid": "d145cf59-908e-42c4-ba8e-ce5abe640639", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Converting VIF {"id": "d145cf59-908e-42c4-ba8e-ce5abe640639", "address": "fa:16:3e:25:37:92", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd145cf59-90", "ovs_interfaceid": "d145cf59-908e-42c4-ba8e-ce5abe640639", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:37:92,bridge_name='br-int',has_traffic_filtering=True,id=d145cf59-908e-42c4-ba8e-ce5abe640639,network=Network(03362fcb-afd6-4b0a-af44-a54a848c59f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd145cf59-90') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG nova.objects.instance [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lazy-loading 'pci_devices' on Instance uuid b99a72ba-73e2-4be7-b52b-7797351daa5f {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.160s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:41:23 user nova-compute[231753]:   <uuid>b99a72ba-73e2-4be7-b52b-7797351daa5f</uuid>
Jul 29 13:41:23 user nova-compute[231753]:   <name>instance-00000018</name>
Jul 29 13:41:23 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:41:23 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:41:23 user nova-compute[231753]:   <metadata>
Jul 29 13:41:23 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:41:23 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:41:23 user nova-compute[231753]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-697372546</nova:name>
Jul 29 13:41:23 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:41:22</nova:creationTime>
Jul 29 13:41:23 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:41:23 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:41:23 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:41:23 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:41:23 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:41:23 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:41:23 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:41:23 user nova-compute[231753]:       <nova:owner>
Jul 29 13:41:23 user nova-compute[231753]:         <nova:user uuid="618ce2d56c3c4ee8ace871d308ca45fb">tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member</nova:user>
Jul 29 13:41:23 user nova-compute[231753]:         <nova:project uuid="c01165e83a3143ad83f050790f2b63fe">tempest-ServerBootFromVolumeStableRescueTest-93506270</nova:project>
Jul 29 13:41:23 user nova-compute[231753]:       </nova:owner>
Jul 29 13:41:23 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:41:23 user nova-compute[231753]:       <nova:ports>
Jul 29 13:41:23 user nova-compute[231753]:         <nova:port uuid="d145cf59-908e-42c4-ba8e-ce5abe640639">
Jul 29 13:41:23 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 29 13:41:23 user nova-compute[231753]:         </nova:port>
Jul 29 13:41:23 user nova-compute[231753]:       </nova:ports>
Jul 29 13:41:23 user nova-compute[231753]:     </nova:instance>
Jul 29 13:41:23 user nova-compute[231753]:   </metadata>
Jul 29 13:41:23 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:41:23 user nova-compute[231753]:     <system>
Jul 29 13:41:23 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:41:23 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:41:23 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:41:23 user nova-compute[231753]:       <entry name="serial">b99a72ba-73e2-4be7-b52b-7797351daa5f</entry>
Jul 29 13:41:23 user nova-compute[231753]:       <entry name="uuid">b99a72ba-73e2-4be7-b52b-7797351daa5f</entry>
Jul 29 13:41:23 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:41:23 user nova-compute[231753]:     </system>
Jul 29 13:41:23 user nova-compute[231753]:   </sysinfo>
Jul 29 13:41:23 user nova-compute[231753]:   <os>
Jul 29 13:41:23 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:41:23 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:41:23 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:41:23 user nova-compute[231753]:   </os>
Jul 29 13:41:23 user nova-compute[231753]:   <features>
Jul 29 13:41:23 user nova-compute[231753]:     <acpi/>
Jul 29 13:41:23 user nova-compute[231753]:     <apic/>
Jul 29 13:41:23 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:41:23 user nova-compute[231753]:   </features>
Jul 29 13:41:23 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:41:23 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:41:23 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:41:23 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:41:23 user nova-compute[231753]:   </clock>
Jul 29 13:41:23 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:41:23 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:41:23 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:41:23 user nova-compute[231753]:   </cpu>
Jul 29 13:41:23 user nova-compute[231753]:   <devices>
Jul 29 13:41:23 user nova-compute[231753]:     <disk type="block" device="disk">
Jul 29 13:41:23 user nova-compute[231753]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:41:23 user nova-compute[231753]:       <source dev="/dev/sdd"/>
Jul 29 13:41:23 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:41:23 user nova-compute[231753]:       <serial>fda4c8ca-fe57-4522-b8bf-0086825e92ea</serial>
Jul 29 13:41:23 user nova-compute[231753]:     </disk>
Jul 29 13:41:23 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:41:23 user nova-compute[231753]:       <mac address="fa:16:3e:25:37:92"/>
Jul 29 13:41:23 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:41:23 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:41:23 user nova-compute[231753]:       <target dev="tapd145cf59-90"/>
Jul 29 13:41:23 user nova-compute[231753]:     </interface>
Jul 29 13:41:23 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:41:23 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/b99a72ba-73e2-4be7-b52b-7797351daa5f/console.log" append="off"/>
Jul 29 13:41:23 user nova-compute[231753]:     </serial>
Jul 29 13:41:23 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:41:23 user nova-compute[231753]:     <video>
Jul 29 13:41:23 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:41:23 user nova-compute[231753]:     </video>
Jul 29 13:41:23 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:41:23 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:41:23 user nova-compute[231753]:     </rng>
Jul 29 13:41:23 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:41:23 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:41:23 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:41:23 user nova-compute[231753]:     </memballoon>
Jul 29 13:41:23 user nova-compute[231753]:   </devices>
Jul 29 13:41:23 user nova-compute[231753]: </domain>
Jul 29 13:41:23 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:41:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-697372546',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-697372546',id=24,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c01165e83a3143ad83f050790f2b63fe',ramdisk_id='',reservation_id='r-9hzwg4i4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-93506270',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:41:09Z,user_data=None,user_id='618ce2d56c3c4ee8ace871d308ca45fb',uuid=b99a72ba-73e2-4be7-b52b-7797351daa5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d145cf59-908e-42c4-ba8e-ce5abe640639", "address": "fa:16:3e:25:37:92", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd145cf59-90", "ovs_interfaceid": "d145cf59-908e-42c4-ba8e-ce5abe640639", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Converting VIF {"id": "d145cf59-908e-42c4-ba8e-ce5abe640639", "address": "fa:16:3e:25:37:92", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd145cf59-90", "ovs_interfaceid": "d145cf59-908e-42c4-ba8e-ce5abe640639", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:25:37:92,bridge_name='br-int',has_traffic_filtering=True,id=d145cf59-908e-42c4-ba8e-ce5abe640639,network=Network(03362fcb-afd6-4b0a-af44-a54a848c59f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd145cf59-90') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG os_vif [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:37:92,bridge_name='br-int',has_traffic_filtering=True,id=d145cf59-908e-42c4-ba8e-ce5abe640639,network=Network(03362fcb-afd6-4b0a-af44-a54a848c59f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd145cf59-90') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk 1073741824" returned: 0 in 0.065s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.228s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd145cf59-90, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd145cf59-90, col_values=(('external_ids', {'iface-id': 'd145cf59-908e-42c4-ba8e-ce5abe640639', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:25:37:92', 'vm-uuid': 'b99a72ba-73e2-4be7-b52b-7797351daa5f'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:23 user nova-compute[231753]: INFO os_vif [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:25:37:92,bridge_name='br-int',has_traffic_filtering=True,id=d145cf59-908e-42c4-ba8e-ce5abe640639,network=Network(03362fcb-afd6-4b0a-af44-a54a848c59f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd145cf59-90')
Jul 29 13:41:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] No VIF found with MAC fa:16:3e:25:37:92, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.140s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:41:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:24 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Cannot resize image /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:41:24 user nova-compute[231753]: DEBUG nova.objects.instance [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lazy-loading 'migration_context' on Instance uuid 8dd26572-fe6a-40fd-8c58-6af862b340c4 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:41:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:41:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Ensure instance console log exists: /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:41:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:41:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:41:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:41:24 user nova-compute[231753]: DEBUG nova.network.neutron [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Successfully created port: ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:41:24 user nova-compute[231753]: DEBUG nova.network.neutron [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Successfully updated port: ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:41:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "refresh_cache-8dd26572-fe6a-40fd-8c58-6af862b340c4" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:41:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquired lock "refresh_cache-8dd26572-fe6a-40fd-8c58-6af862b340c4" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:41:24 user nova-compute[231753]: DEBUG nova.network.neutron [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:41:24 user nova-compute[231753]: DEBUG nova.compute.manager [req-0a73c429-3f6a-495a-a533-a4e54ad96210 req-c86a9ddc-2231-4318-8bed-a48c88e445f0 service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Received event network-changed-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:41:24 user nova-compute[231753]: DEBUG nova.compute.manager [req-0a73c429-3f6a-495a-a533-a4e54ad96210 req-c86a9ddc-2231-4318-8bed-a48c88e445f0 service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Refreshing instance network info cache due to event network-changed-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:41:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0a73c429-3f6a-495a-a533-a4e54ad96210 req-c86a9ddc-2231-4318-8bed-a48c88e445f0 service nova] Acquiring lock "refresh_cache-8dd26572-fe6a-40fd-8c58-6af862b340c4" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG nova.network.neutron [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG nova.network.neutron [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Updating instance_info_cache with network_info: [{"id": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "address": "fa:16:3e:a7:22:05", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3e2ca8-62", "ovs_interfaceid": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Releasing lock "refresh_cache-8dd26572-fe6a-40fd-8c58-6af862b340c4" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG nova.compute.manager [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Instance network_info: |[{"id": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "address": "fa:16:3e:a7:22:05", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3e2ca8-62", "ovs_interfaceid": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0a73c429-3f6a-495a-a533-a4e54ad96210 req-c86a9ddc-2231-4318-8bed-a48c88e445f0 service nova] Acquired lock "refresh_cache-8dd26572-fe6a-40fd-8c58-6af862b340c4" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG nova.network.neutron [req-0a73c429-3f6a-495a-a533-a4e54ad96210 req-c86a9ddc-2231-4318-8bed-a48c88e445f0 service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Refreshing network info cache for port ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Start _get_guest_xml network_info=[{"id": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "address": "fa:16:3e:a7:22:05", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3e2ca8-62", "ovs_interfaceid": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:41:25 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:41:25 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:41:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-307508049',display_name='tempest-AttachVolumeTestJSON-server-307508049',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-307508049',id=25,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoyUAgpcSSQTthO61utyiF8t7eniB6Jq0RtxtqYL+lvLbvmf3WG4z2Y5S66oY+znDIezboeDRUEwg+7djUWhx8vLQF2KnXuxcUYlwL/5sSfLakxOteY7b7lI0VU3lUVUA==',key_name='tempest-keypair-441207824',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a8801c6bc4b46ef9b407426c5eb07e0',ramdisk_id='',reservation_id='r-tsz4sxhz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-695592502',owner_user_name='tempest-AttachVolumeTestJSON-695592502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:41:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df1ccafc63e0418e9889541bb8ecd3d2',uuid=8dd26572-fe6a-40fd-8c58-6af862b340c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "address": "fa:16:3e:a7:22:05", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3e2ca8-62", "ovs_interfaceid": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Converting VIF {"id": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "address": "fa:16:3e:a7:22:05", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3e2ca8-62", "ovs_interfaceid": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:22:05,bridge_name='br-int',has_traffic_filtering=True,id=ef3e2ca8-6228-4cd8-b815-d06cf34e15e0,network=Network(dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef3e2ca8-62') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG nova.objects.instance [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lazy-loading 'pci_devices' on Instance uuid 8dd26572-fe6a-40fd-8c58-6af862b340c4 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:41:25 user nova-compute[231753]:   <uuid>8dd26572-fe6a-40fd-8c58-6af862b340c4</uuid>
Jul 29 13:41:25 user nova-compute[231753]:   <name>instance-00000019</name>
Jul 29 13:41:25 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:41:25 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:41:25 user nova-compute[231753]:   <metadata>
Jul 29 13:41:25 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:41:25 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:41:25 user nova-compute[231753]:       <nova:name>tempest-AttachVolumeTestJSON-server-307508049</nova:name>
Jul 29 13:41:25 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:41:25</nova:creationTime>
Jul 29 13:41:25 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:41:25 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:41:25 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:41:25 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:41:25 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:41:25 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:41:25 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:41:25 user nova-compute[231753]:       <nova:owner>
Jul 29 13:41:25 user nova-compute[231753]:         <nova:user uuid="df1ccafc63e0418e9889541bb8ecd3d2">tempest-AttachVolumeTestJSON-695592502-project-member</nova:user>
Jul 29 13:41:25 user nova-compute[231753]:         <nova:project uuid="4a8801c6bc4b46ef9b407426c5eb07e0">tempest-AttachVolumeTestJSON-695592502</nova:project>
Jul 29 13:41:25 user nova-compute[231753]:       </nova:owner>
Jul 29 13:41:25 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:41:25 user nova-compute[231753]:       <nova:ports>
Jul 29 13:41:25 user nova-compute[231753]:         <nova:port uuid="ef3e2ca8-6228-4cd8-b815-d06cf34e15e0">
Jul 29 13:41:25 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 29 13:41:25 user nova-compute[231753]:         </nova:port>
Jul 29 13:41:25 user nova-compute[231753]:       </nova:ports>
Jul 29 13:41:25 user nova-compute[231753]:     </nova:instance>
Jul 29 13:41:25 user nova-compute[231753]:   </metadata>
Jul 29 13:41:25 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:41:25 user nova-compute[231753]:     <system>
Jul 29 13:41:25 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:41:25 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:41:25 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:41:25 user nova-compute[231753]:       <entry name="serial">8dd26572-fe6a-40fd-8c58-6af862b340c4</entry>
Jul 29 13:41:25 user nova-compute[231753]:       <entry name="uuid">8dd26572-fe6a-40fd-8c58-6af862b340c4</entry>
Jul 29 13:41:25 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:41:25 user nova-compute[231753]:     </system>
Jul 29 13:41:25 user nova-compute[231753]:   </sysinfo>
Jul 29 13:41:25 user nova-compute[231753]:   <os>
Jul 29 13:41:25 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:41:25 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:41:25 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:41:25 user nova-compute[231753]:   </os>
Jul 29 13:41:25 user nova-compute[231753]:   <features>
Jul 29 13:41:25 user nova-compute[231753]:     <acpi/>
Jul 29 13:41:25 user nova-compute[231753]:     <apic/>
Jul 29 13:41:25 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:41:25 user nova-compute[231753]:   </features>
Jul 29 13:41:25 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:41:25 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:41:25 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:41:25 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:41:25 user nova-compute[231753]:   </clock>
Jul 29 13:41:25 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:41:25 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:41:25 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:41:25 user nova-compute[231753]:   </cpu>
Jul 29 13:41:25 user nova-compute[231753]:   <devices>
Jul 29 13:41:25 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:41:25 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:41:25 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk"/>
Jul 29 13:41:25 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:41:25 user nova-compute[231753]:     </disk>
Jul 29 13:41:25 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:41:25 user nova-compute[231753]:       <mac address="fa:16:3e:a7:22:05"/>
Jul 29 13:41:25 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:41:25 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:41:25 user nova-compute[231753]:       <target dev="tapef3e2ca8-62"/>
Jul 29 13:41:25 user nova-compute[231753]:     </interface>
Jul 29 13:41:25 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:41:25 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/console.log" append="off"/>
Jul 29 13:41:25 user nova-compute[231753]:     </serial>
Jul 29 13:41:25 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:41:25 user nova-compute[231753]:     <video>
Jul 29 13:41:25 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:41:25 user nova-compute[231753]:     </video>
Jul 29 13:41:25 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:41:25 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:41:25 user nova-compute[231753]:     </rng>
Jul 29 13:41:25 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:41:25 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:41:25 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:41:25 user nova-compute[231753]:     </memballoon>
Jul 29 13:41:25 user nova-compute[231753]:   </devices>
Jul 29 13:41:25 user nova-compute[231753]: </domain>
Jul 29 13:41:25 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-307508049',display_name='tempest-AttachVolumeTestJSON-server-307508049',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-307508049',id=25,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoyUAgpcSSQTthO61utyiF8t7eniB6Jq0RtxtqYL+lvLbvmf3WG4z2Y5S66oY+znDIezboeDRUEwg+7djUWhx8vLQF2KnXuxcUYlwL/5sSfLakxOteY7b7lI0VU3lUVUA==',key_name='tempest-keypair-441207824',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a8801c6bc4b46ef9b407426c5eb07e0',ramdisk_id='',reservation_id='r-tsz4sxhz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-695592502',owner_user_name='tempest-AttachVolumeTestJSON-695592502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:41:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df1ccafc63e0418e9889541bb8ecd3d2',uuid=8dd26572-fe6a-40fd-8c58-6af862b340c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "address": "fa:16:3e:a7:22:05", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3e2ca8-62", "ovs_interfaceid": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Converting VIF {"id": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "address": "fa:16:3e:a7:22:05", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3e2ca8-62", "ovs_interfaceid": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:22:05,bridge_name='br-int',has_traffic_filtering=True,id=ef3e2ca8-6228-4cd8-b815-d06cf34e15e0,network=Network(dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef3e2ca8-62') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG os_vif [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:22:05,bridge_name='br-int',has_traffic_filtering=True,id=ef3e2ca8-6228-4cd8-b815-d06cf34e15e0,network=Network(dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef3e2ca8-62') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef3e2ca8-62, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapef3e2ca8-62, col_values=(('external_ids', {'iface-id': 'ef3e2ca8-6228-4cd8-b815-d06cf34e15e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:22:05', 'vm-uuid': '8dd26572-fe6a-40fd-8c58-6af862b340c4'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:25 user nova-compute[231753]: INFO os_vif [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:22:05,bridge_name='br-int',has_traffic_filtering=True,id=ef3e2ca8-6228-4cd8-b815-d06cf34e15e0,network=Network(dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef3e2ca8-62')
Jul 29 13:41:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:41:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] No VIF found with MAC fa:16:3e:a7:22:05, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:41:26 user nova-compute[231753]: DEBUG nova.network.neutron [req-0a73c429-3f6a-495a-a533-a4e54ad96210 req-c86a9ddc-2231-4318-8bed-a48c88e445f0 service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Updated VIF entry in instance network info cache for port ef3e2ca8-6228-4cd8-b815-d06cf34e15e0. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:41:26 user nova-compute[231753]: DEBUG nova.network.neutron [req-0a73c429-3f6a-495a-a533-a4e54ad96210 req-c86a9ddc-2231-4318-8bed-a48c88e445f0 service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Updating instance_info_cache with network_info: [{"id": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "address": "fa:16:3e:a7:22:05", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3e2ca8-62", "ovs_interfaceid": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:41:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0a73c429-3f6a-495a-a533-a4e54ad96210 req-c86a9ddc-2231-4318-8bed-a48c88e445f0 service nova] Releasing lock "refresh_cache-8dd26572-fe6a-40fd-8c58-6af862b340c4" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:41:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-eb1f41a8-62ab-4379-be7b-8a0ae1e09c8d req-7179aa49-ddf1-4a1b-855f-f9d1c4730d30 service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Received event network-vif-plugged-d145cf59-908e-42c4-ba8e-ce5abe640639 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:41:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-eb1f41a8-62ab-4379-be7b-8a0ae1e09c8d req-7179aa49-ddf1-4a1b-855f-f9d1c4730d30 service nova] Acquiring lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:41:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-eb1f41a8-62ab-4379-be7b-8a0ae1e09c8d req-7179aa49-ddf1-4a1b-855f-f9d1c4730d30 service nova] Lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:41:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-eb1f41a8-62ab-4379-be7b-8a0ae1e09c8d req-7179aa49-ddf1-4a1b-855f-f9d1c4730d30 service nova] Lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:41:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-eb1f41a8-62ab-4379-be7b-8a0ae1e09c8d req-7179aa49-ddf1-4a1b-855f-f9d1c4730d30 service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] No waiting events found dispatching network-vif-plugged-d145cf59-908e-42c4-ba8e-ce5abe640639 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:41:27 user nova-compute[231753]: WARNING nova.compute.manager [req-eb1f41a8-62ab-4379-be7b-8a0ae1e09c8d req-7179aa49-ddf1-4a1b-855f-f9d1c4730d30 service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Received unexpected event network-vif-plugged-d145cf59-908e-42c4-ba8e-ce5abe640639 for instance with vm_state building and task_state spawning.
Jul 29 13:41:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-eb1f41a8-62ab-4379-be7b-8a0ae1e09c8d req-7179aa49-ddf1-4a1b-855f-f9d1c4730d30 service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Received event network-vif-plugged-d145cf59-908e-42c4-ba8e-ce5abe640639 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:41:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-eb1f41a8-62ab-4379-be7b-8a0ae1e09c8d req-7179aa49-ddf1-4a1b-855f-f9d1c4730d30 service nova] Acquiring lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:41:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-eb1f41a8-62ab-4379-be7b-8a0ae1e09c8d req-7179aa49-ddf1-4a1b-855f-f9d1c4730d30 service nova] Lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:41:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-eb1f41a8-62ab-4379-be7b-8a0ae1e09c8d req-7179aa49-ddf1-4a1b-855f-f9d1c4730d30 service nova] Lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:41:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-eb1f41a8-62ab-4379-be7b-8a0ae1e09c8d req-7179aa49-ddf1-4a1b-855f-f9d1c4730d30 service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] No waiting events found dispatching network-vif-plugged-d145cf59-908e-42c4-ba8e-ce5abe640639 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:41:27 user nova-compute[231753]: WARNING nova.compute.manager [req-eb1f41a8-62ab-4379-be7b-8a0ae1e09c8d req-7179aa49-ddf1-4a1b-855f-f9d1c4730d30 service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Received unexpected event network-vif-plugged-d145cf59-908e-42c4-ba8e-ce5abe640639 for instance with vm_state building and task_state spawning.
Jul 29 13:41:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-5d619ce4-d45f-4399-8d42-287af3fd6637 req-646681e0-544f-49c5-8dbe-430471b3bf2d service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Received event network-vif-plugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:41:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5d619ce4-d45f-4399-8d42-287af3fd6637 req-646681e0-544f-49c5-8dbe-430471b3bf2d service nova] Acquiring lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:41:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5d619ce4-d45f-4399-8d42-287af3fd6637 req-646681e0-544f-49c5-8dbe-430471b3bf2d service nova] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:41:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5d619ce4-d45f-4399-8d42-287af3fd6637 req-646681e0-544f-49c5-8dbe-430471b3bf2d service nova] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:41:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-5d619ce4-d45f-4399-8d42-287af3fd6637 req-646681e0-544f-49c5-8dbe-430471b3bf2d service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] No waiting events found dispatching network-vif-plugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:41:27 user nova-compute[231753]: WARNING nova.compute.manager [req-5d619ce4-d45f-4399-8d42-287af3fd6637 req-646681e0-544f-49c5-8dbe-430471b3bf2d service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Received unexpected event network-vif-plugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 for instance with vm_state building and task_state spawning.
Jul 29 13:41:27 user nova-compute[231753]: INFO nova.compute.manager [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Rescuing
Jul 29 13:41:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "refresh_cache-7e2615c1-b03e-4076-bcd9-3585fb11b8ac" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:41:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquired lock "refresh_cache-7e2615c1-b03e-4076-bcd9-3585fb11b8ac" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:41:27 user nova-compute[231753]: DEBUG nova.network.neutron [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:41:27 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638087.6201637, b99a72ba-73e2-4be7-b52b-7797351daa5f => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:41:27 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] VM Resumed (Lifecycle Event)
Jul 29 13:41:27 user nova-compute[231753]: DEBUG nova.compute.manager [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:41:27 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:41:27 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Instance spawned successfully.
Jul 29 13:41:27 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:41:27 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:41:27 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:41:27 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:41:27 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:41:27 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:41:27 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:41:27 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:41:27 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:41:27 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:41:27 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638087.6203895, b99a72ba-73e2-4be7-b52b-7797351daa5f => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:41:27 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] VM Started (Lifecycle Event)
Jul 29 13:41:27 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:41:27 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:41:27 user nova-compute[231753]: INFO nova.compute.manager [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Took 5.48 seconds to spawn the instance on the hypervisor.
Jul 29 13:41:27 user nova-compute[231753]: DEBUG nova.compute.manager [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:41:27 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:41:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:27 user nova-compute[231753]: INFO nova.compute.manager [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Took 19.95 seconds to build instance.
Jul 29 13:41:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-35e3e412-1118-450c-b8c4-04f5fed73f34 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "b99a72ba-73e2-4be7-b52b-7797351daa5f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 20.049s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:41:28 user nova-compute[231753]: DEBUG nova.network.neutron [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Updating instance_info_cache with network_info: [{"id": "8c8e51fe-0d15-4a27-8215-dc512b6816f5", "address": "fa:16:3e:3e:10:27", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e51fe-0d", "ovs_interfaceid": "8c8e51fe-0d15-4a27-8215-dc512b6816f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:41:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Releasing lock "refresh_cache-7e2615c1-b03e-4076-bcd9-3585fb11b8ac" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:41:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:28 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Instance destroyed successfully.
Jul 29 13:41:28 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Attempting rescue
Jul 29 13:41:28 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=231753) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 29 13:41:28 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Instance directory exists: not creating {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 29 13:41:28 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Creating image(s)
Jul 29 13:41:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "/opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:41:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "/opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:41:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "/opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:41:28 user nova-compute[231753]: DEBUG nova.objects.instance [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lazy-loading 'trusted_certs' on Instance uuid 7e2615c1-b03e-4076-bcd9-3585fb11b8ac {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:41:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:41:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:41:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.133s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk.rescue {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk.rescue" returned: 0 in 0.054s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.objects.instance [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lazy-loading 'migration_context' on Instance uuid 7e2615c1-b03e-4076-bcd9-3585fb11b8ac {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Start _get_guest_xml network_info=[{"id": "8c8e51fe-0d15-4a27-8215-dc512b6816f5", "address": "fa:16:3e:3e:10:27", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "vif_mac": "fa:16:3e:3e:10:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e51fe-0d", "ovs_interfaceid": "8c8e51fe-0d15-4a27-8215-dc512b6816f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.objects.instance [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lazy-loading 'resources' on Instance uuid 7e2615c1-b03e-4076-bcd9-3585fb11b8ac {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.objects.instance [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lazy-loading 'numa_topology' on Instance uuid 7e2615c1-b03e-4076-bcd9-3585fb11b8ac {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.compute.manager [req-0cef7638-c4d9-427e-858c-716f4a37bb00 req-94a5786c-46cc-432b-8990-e85dabb19fee service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Received event network-vif-unplugged-8c8e51fe-0d15-4a27-8215-dc512b6816f5 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0cef7638-c4d9-427e-858c-716f4a37bb00 req-94a5786c-46cc-432b-8990-e85dabb19fee service nova] Acquiring lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0cef7638-c4d9-427e-858c-716f4a37bb00 req-94a5786c-46cc-432b-8990-e85dabb19fee service nova] Lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0cef7638-c4d9-427e-858c-716f4a37bb00 req-94a5786c-46cc-432b-8990-e85dabb19fee service nova] Lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.compute.manager [req-0cef7638-c4d9-427e-858c-716f4a37bb00 req-94a5786c-46cc-432b-8990-e85dabb19fee service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] No waiting events found dispatching network-vif-unplugged-8c8e51fe-0d15-4a27-8215-dc512b6816f5 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:41:29 user nova-compute[231753]: WARNING nova.compute.manager [req-0cef7638-c4d9-427e-858c-716f4a37bb00 req-94a5786c-46cc-432b-8990-e85dabb19fee service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Received unexpected event network-vif-unplugged-8c8e51fe-0d15-4a27-8215-dc512b6816f5 for instance with vm_state active and task_state rescuing.
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.compute.manager [req-0cef7638-c4d9-427e-858c-716f4a37bb00 req-94a5786c-46cc-432b-8990-e85dabb19fee service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Received event network-vif-plugged-8c8e51fe-0d15-4a27-8215-dc512b6816f5 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0cef7638-c4d9-427e-858c-716f4a37bb00 req-94a5786c-46cc-432b-8990-e85dabb19fee service nova] Acquiring lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0cef7638-c4d9-427e-858c-716f4a37bb00 req-94a5786c-46cc-432b-8990-e85dabb19fee service nova] Lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0cef7638-c4d9-427e-858c-716f4a37bb00 req-94a5786c-46cc-432b-8990-e85dabb19fee service nova] Lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.compute.manager [req-0cef7638-c4d9-427e-858c-716f4a37bb00 req-94a5786c-46cc-432b-8990-e85dabb19fee service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] No waiting events found dispatching network-vif-plugged-8c8e51fe-0d15-4a27-8215-dc512b6816f5 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:41:29 user nova-compute[231753]: WARNING nova.compute.manager [req-0cef7638-c4d9-427e-858c-716f4a37bb00 req-94a5786c-46cc-432b-8990-e85dabb19fee service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Received unexpected event network-vif-plugged-8c8e51fe-0d15-4a27-8215-dc512b6816f5 for instance with vm_state active and task_state rescuing.
Jul 29 13:41:29 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:41:29 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.objects.instance [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lazy-loading 'vcpu_model' on Instance uuid 7e2615c1-b03e-4076-bcd9-3585fb11b8ac {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:36:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-350579303',display_name='tempest-ServerRescueNegativeTestJSON-server-350579303',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-350579303',id=14,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:36:51Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7aa6e9e70b4a49cb994440e868203c99',ramdisk_id='',reservation_id='r-3aiftumj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-700305152',owner_user_name='tempest-ServerRescueNegativeTestJSON-700305152-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:36:52Z,user_data=None,user_id='01b32889cd7442399a8bceaff3d05662',uuid=7e2615c1-b03e-4076-bcd9-3585fb11b8ac,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c8e51fe-0d15-4a27-8215-dc512b6816f5", "address": "fa:16:3e:3e:10:27", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "vif_mac": "fa:16:3e:3e:10:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e51fe-0d", "ovs_interfaceid": "8c8e51fe-0d15-4a27-8215-dc512b6816f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Converting VIF {"id": "8c8e51fe-0d15-4a27-8215-dc512b6816f5", "address": "fa:16:3e:3e:10:27", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "vif_mac": "fa:16:3e:3e:10:27"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e51fe-0d", "ovs_interfaceid": "8c8e51fe-0d15-4a27-8215-dc512b6816f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:10:27,bridge_name='br-int',has_traffic_filtering=True,id=8c8e51fe-0d15-4a27-8215-dc512b6816f5,network=Network(e1a83272-2e22-47dc-95ae-2ab9861c5925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8e51fe-0d') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.objects.instance [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lazy-loading 'pci_devices' on Instance uuid 7e2615c1-b03e-4076-bcd9-3585fb11b8ac {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:41:29 user nova-compute[231753]:   <uuid>7e2615c1-b03e-4076-bcd9-3585fb11b8ac</uuid>
Jul 29 13:41:29 user nova-compute[231753]:   <name>instance-0000000e</name>
Jul 29 13:41:29 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:41:29 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:41:29 user nova-compute[231753]:   <metadata>
Jul 29 13:41:29 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:41:29 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:41:29 user nova-compute[231753]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-350579303</nova:name>
Jul 29 13:41:29 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:41:29</nova:creationTime>
Jul 29 13:41:29 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:41:29 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:41:29 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:41:29 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:41:29 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:41:29 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:41:29 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:41:29 user nova-compute[231753]:       <nova:owner>
Jul 29 13:41:29 user nova-compute[231753]:         <nova:user uuid="01b32889cd7442399a8bceaff3d05662">tempest-ServerRescueNegativeTestJSON-700305152-project-member</nova:user>
Jul 29 13:41:29 user nova-compute[231753]:         <nova:project uuid="7aa6e9e70b4a49cb994440e868203c99">tempest-ServerRescueNegativeTestJSON-700305152</nova:project>
Jul 29 13:41:29 user nova-compute[231753]:       </nova:owner>
Jul 29 13:41:29 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:41:29 user nova-compute[231753]:       <nova:ports>
Jul 29 13:41:29 user nova-compute[231753]:         <nova:port uuid="8c8e51fe-0d15-4a27-8215-dc512b6816f5">
Jul 29 13:41:29 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 29 13:41:29 user nova-compute[231753]:         </nova:port>
Jul 29 13:41:29 user nova-compute[231753]:       </nova:ports>
Jul 29 13:41:29 user nova-compute[231753]:     </nova:instance>
Jul 29 13:41:29 user nova-compute[231753]:   </metadata>
Jul 29 13:41:29 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:41:29 user nova-compute[231753]:     <system>
Jul 29 13:41:29 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:41:29 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:41:29 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:41:29 user nova-compute[231753]:       <entry name="serial">7e2615c1-b03e-4076-bcd9-3585fb11b8ac</entry>
Jul 29 13:41:29 user nova-compute[231753]:       <entry name="uuid">7e2615c1-b03e-4076-bcd9-3585fb11b8ac</entry>
Jul 29 13:41:29 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:41:29 user nova-compute[231753]:     </system>
Jul 29 13:41:29 user nova-compute[231753]:   </sysinfo>
Jul 29 13:41:29 user nova-compute[231753]:   <os>
Jul 29 13:41:29 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:41:29 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:41:29 user nova-compute[231753]:   </os>
Jul 29 13:41:29 user nova-compute[231753]:   <features>
Jul 29 13:41:29 user nova-compute[231753]:     <acpi/>
Jul 29 13:41:29 user nova-compute[231753]:     <apic/>
Jul 29 13:41:29 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:41:29 user nova-compute[231753]:   </features>
Jul 29 13:41:29 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:41:29 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:41:29 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:41:29 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:41:29 user nova-compute[231753]:   </clock>
Jul 29 13:41:29 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:41:29 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:41:29 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:41:29 user nova-compute[231753]:   </cpu>
Jul 29 13:41:29 user nova-compute[231753]:   <devices>
Jul 29 13:41:29 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:41:29 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:41:29 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk.rescue"/>
Jul 29 13:41:29 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:41:29 user nova-compute[231753]:     </disk>
Jul 29 13:41:29 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:41:29 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:41:29 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk"/>
Jul 29 13:41:29 user nova-compute[231753]:       <target dev="vdb" bus="virtio"/>
Jul 29 13:41:29 user nova-compute[231753]:     </disk>
Jul 29 13:41:29 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:41:29 user nova-compute[231753]:       <mac address="fa:16:3e:3e:10:27"/>
Jul 29 13:41:29 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:41:29 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:41:29 user nova-compute[231753]:       <target dev="tap8c8e51fe-0d"/>
Jul 29 13:41:29 user nova-compute[231753]:     </interface>
Jul 29 13:41:29 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:41:29 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/console.log" append="off"/>
Jul 29 13:41:29 user nova-compute[231753]:     </serial>
Jul 29 13:41:29 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:41:29 user nova-compute[231753]:     <video>
Jul 29 13:41:29 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:41:29 user nova-compute[231753]:     </video>
Jul 29 13:41:29 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:41:29 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:41:29 user nova-compute[231753]:     </rng>
Jul 29 13:41:29 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:41:29 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:41:29 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:41:29 user nova-compute[231753]:     </memballoon>
Jul 29 13:41:29 user nova-compute[231753]:   </devices>
Jul 29 13:41:29 user nova-compute[231753]: </domain>
Jul 29 13:41:29 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:41:29 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Instance destroyed successfully.
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] No BDM found with device name vdb, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] No VIF found with MAC fa:16:3e:3e:10:27, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638089.4246612, 8dd26572-fe6a-40fd-8c58-6af862b340c4 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:41:29 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] VM Resumed (Lifecycle Event)
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.compute.manager [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:41:29 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Instance spawned successfully.
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.compute.manager [req-a0e4d628-8d0f-49f6-812c-a161831fe061 req-c9ff5e92-1274-4688-be26-1a8818295d2a service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Received event network-vif-plugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a0e4d628-8d0f-49f6-812c-a161831fe061 req-c9ff5e92-1274-4688-be26-1a8818295d2a service nova] Acquiring lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a0e4d628-8d0f-49f6-812c-a161831fe061 req-c9ff5e92-1274-4688-be26-1a8818295d2a service nova] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a0e4d628-8d0f-49f6-812c-a161831fe061 req-c9ff5e92-1274-4688-be26-1a8818295d2a service nova] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.compute.manager [req-a0e4d628-8d0f-49f6-812c-a161831fe061 req-c9ff5e92-1274-4688-be26-1a8818295d2a service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] No waiting events found dispatching network-vif-plugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:41:29 user nova-compute[231753]: WARNING nova.compute.manager [req-a0e4d628-8d0f-49f6-812c-a161831fe061 req-c9ff5e92-1274-4688-be26-1a8818295d2a service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Received unexpected event network-vif-plugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 for instance with vm_state building and task_state spawning.
Jul 29 13:41:29 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638089.4268537, 8dd26572-fe6a-40fd-8c58-6af862b340c4 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:41:29 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] VM Started (Lifecycle Event)
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:41:29 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:41:29 user nova-compute[231753]: INFO nova.compute.manager [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Took 6.20 seconds to spawn the instance on the hypervisor.
Jul 29 13:41:29 user nova-compute[231753]: DEBUG nova.compute.manager [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:41:29 user nova-compute[231753]: INFO nova.compute.manager [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Took 7.07 seconds to build instance.
Jul 29 13:41:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-663d378d-6517-4fbd-8a66-cd72fd79a65d tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.154s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:41:30 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:30 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:30 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:30 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:30 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:31 user nova-compute[231753]: DEBUG nova.compute.manager [req-547bb222-e112-49f3-8eb0-8345490fe104 req-d5b973f0-ed5d-4890-8a77-32869f543865 service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Received event network-vif-plugged-8c8e51fe-0d15-4a27-8215-dc512b6816f5 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:41:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-547bb222-e112-49f3-8eb0-8345490fe104 req-d5b973f0-ed5d-4890-8a77-32869f543865 service nova] Acquiring lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:41:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-547bb222-e112-49f3-8eb0-8345490fe104 req-d5b973f0-ed5d-4890-8a77-32869f543865 service nova] Lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:41:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-547bb222-e112-49f3-8eb0-8345490fe104 req-d5b973f0-ed5d-4890-8a77-32869f543865 service nova] Lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:41:31 user nova-compute[231753]: DEBUG nova.compute.manager [req-547bb222-e112-49f3-8eb0-8345490fe104 req-d5b973f0-ed5d-4890-8a77-32869f543865 service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] No waiting events found dispatching network-vif-plugged-8c8e51fe-0d15-4a27-8215-dc512b6816f5 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:41:31 user nova-compute[231753]: WARNING nova.compute.manager [req-547bb222-e112-49f3-8eb0-8345490fe104 req-d5b973f0-ed5d-4890-8a77-32869f543865 service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Received unexpected event network-vif-plugged-8c8e51fe-0d15-4a27-8215-dc512b6816f5 for instance with vm_state active and task_state rescuing.
Jul 29 13:41:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Removed pending event for 7e2615c1-b03e-4076-bcd9-3585fb11b8ac due to event {{(pid=231753) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 29 13:41:32 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638092.8921952, 7e2615c1-b03e-4076-bcd9-3585fb11b8ac => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:41:32 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] VM Resumed (Lifecycle Event)
Jul 29 13:41:32 user nova-compute[231753]: DEBUG nova.compute.manager [None req-0b0acf45-8071-4783-b82f-fb9678747256 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:41:32 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:41:32 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:41:32 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 29 13:41:32 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638092.8960774, 7e2615c1-b03e-4076-bcd9-3585fb11b8ac => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:41:32 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] VM Started (Lifecycle Event)
Jul 29 13:41:32 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:41:32 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:41:33 user nova-compute[231753]: DEBUG nova.compute.manager [req-730b5324-4428-4519-a14d-25e30e1afe77 req-da544505-6647-4f3b-9b9a-d4ac9c3cdc22 service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Received event network-vif-plugged-8c8e51fe-0d15-4a27-8215-dc512b6816f5 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:41:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-730b5324-4428-4519-a14d-25e30e1afe77 req-da544505-6647-4f3b-9b9a-d4ac9c3cdc22 service nova] Acquiring lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:41:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-730b5324-4428-4519-a14d-25e30e1afe77 req-da544505-6647-4f3b-9b9a-d4ac9c3cdc22 service nova] Lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:41:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-730b5324-4428-4519-a14d-25e30e1afe77 req-da544505-6647-4f3b-9b9a-d4ac9c3cdc22 service nova] Lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:41:33 user nova-compute[231753]: DEBUG nova.compute.manager [req-730b5324-4428-4519-a14d-25e30e1afe77 req-da544505-6647-4f3b-9b9a-d4ac9c3cdc22 service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] No waiting events found dispatching network-vif-plugged-8c8e51fe-0d15-4a27-8215-dc512b6816f5 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:41:33 user nova-compute[231753]: WARNING nova.compute.manager [req-730b5324-4428-4519-a14d-25e30e1afe77 req-da544505-6647-4f3b-9b9a-d4ac9c3cdc22 service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Received unexpected event network-vif-plugged-8c8e51fe-0d15-4a27-8215-dc512b6816f5 for instance with vm_state rescued and task_state None.
Jul 29 13:41:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:35 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:45 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:50 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Acquiring lock "63fad324-aac2-4d60-b4ce-a32a5736657d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:41:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:41:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Acquiring lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:41:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:41:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:41:53 user nova-compute[231753]: INFO nova.compute.manager [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Terminating instance
Jul 29 13:41:53 user nova-compute[231753]: DEBUG nova.compute.manager [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:41:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG nova.compute.manager [req-917c2817-7ef9-4dd8-a4c4-7c97133f51c0 req-803ec9c4-cbe0-4d0f-ae23-ebb849bd0335 service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Received event network-vif-unplugged-fadc1466-5336-4230-b0f1-4fe4053f216a {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-917c2817-7ef9-4dd8-a4c4-7c97133f51c0 req-803ec9c4-cbe0-4d0f-ae23-ebb849bd0335 service nova] Acquiring lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-917c2817-7ef9-4dd8-a4c4-7c97133f51c0 req-803ec9c4-cbe0-4d0f-ae23-ebb849bd0335 service nova] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-917c2817-7ef9-4dd8-a4c4-7c97133f51c0 req-803ec9c4-cbe0-4d0f-ae23-ebb849bd0335 service nova] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG nova.compute.manager [req-917c2817-7ef9-4dd8-a4c4-7c97133f51c0 req-803ec9c4-cbe0-4d0f-ae23-ebb849bd0335 service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] No waiting events found dispatching network-vif-unplugged-fadc1466-5336-4230-b0f1-4fe4053f216a {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG nova.compute.manager [req-917c2817-7ef9-4dd8-a4c4-7c97133f51c0 req-803ec9c4-cbe0-4d0f-ae23-ebb849bd0335 service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Received event network-vif-unplugged-fadc1466-5336-4230-b0f1-4fe4053f216a for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:54 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Instance destroyed successfully.
Jul 29 13:41:54 user nova-compute[231753]: DEBUG nova.objects.instance [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lazy-loading 'resources' on Instance uuid 63fad324-aac2-4d60-b4ce-a32a5736657d {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:33:10Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-800445599',display_name='tempest-ServerActionsTestOtherB-server-800445599',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestotherb-server-800445599',id=1,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOK3mwTAZBOJzlYUFtbhzSHDzTYFwqvVO3PSQcWrwJtS4OLSJuALDnCfY5kQP9dq+tAP99lu02YS+c2OW9ZUPQROMcosGuWuOlguzRCIeVSykNGGMYttb7ShY1vz/IoqmQ==',key_name='tempest-keypair-1690887276',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:39:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='74a8a3e0bcef4bbc979ef187e4ed48cc',ramdisk_id='',reservation_id='r-zypim8f0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherB-1624737976',owner_user_name='tempest-ServerActionsTestOtherB-1624737976-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:39:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7361505253f84cf28c8688caf4a0cd16',uuid=63fad324-aac2-4d60-b4ce-a32a5736657d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fadc1466-5336-4230-b0f1-4fe4053f216a", "address": "fa:16:3e:df:12:9c", "network": {"id": "8897db8c-6e92-4b9e-b7ee-a69230eb07f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1596242231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a8a3e0bcef4bbc979ef187e4ed48cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc1466-53", "ovs_interfaceid": "fadc1466-5336-4230-b0f1-4fe4053f216a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Converting VIF {"id": "fadc1466-5336-4230-b0f1-4fe4053f216a", "address": "fa:16:3e:df:12:9c", "network": {"id": "8897db8c-6e92-4b9e-b7ee-a69230eb07f1", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1596242231-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.41", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "74a8a3e0bcef4bbc979ef187e4ed48cc", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfadc1466-53", "ovs_interfaceid": "fadc1466-5336-4230-b0f1-4fe4053f216a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:df:12:9c,bridge_name='br-int',has_traffic_filtering=True,id=fadc1466-5336-4230-b0f1-4fe4053f216a,network=Network(8897db8c-6e92-4b9e-b7ee-a69230eb07f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfadc1466-53') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG os_vif [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:12:9c,bridge_name='br-int',has_traffic_filtering=True,id=fadc1466-5336-4230-b0f1-4fe4053f216a,network=Network(8897db8c-6e92-4b9e-b7ee-a69230eb07f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfadc1466-53') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfadc1466-53, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:41:54 user nova-compute[231753]: INFO os_vif [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:df:12:9c,bridge_name='br-int',has_traffic_filtering=True,id=fadc1466-5336-4230-b0f1-4fe4053f216a,network=Network(8897db8c-6e92-4b9e-b7ee-a69230eb07f1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfadc1466-53')
Jul 29 13:41:54 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'HxbMradf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:41:54 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:41:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dda9042-d19c-4549-aee0-887a4f363901]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:41:54 user nova-compute[231753]: No targets found.
Jul 29 13:41:54 user nova-compute[231753]: iSNS:
Jul 29 13:41:54 user nova-compute[231753]: No targets found.
Jul 29 13:41:54 user nova-compute[231753]: STATIC:
Jul 29 13:41:54 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea
Jul 29 13:41:54 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:41:54 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:41:54 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0
Jul 29 13:41:54 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:41:54 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:41:54 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4
Jul 29 13:41:54 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:41:54 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:41:54 user nova-compute[231753]: FIRMWARE:
Jul 29 13:41:54 user nova-compute[231753]: No targets found.
Jul 29 13:41:54 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:41:54 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:41:54 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[52ce04b9-5087-43ec-b084-35b70669ae6d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[343cec7f-b663-48e8-9ebf-07362e782ba7]: (4, ('tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)\ntcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:41:54 user nova-compute[231753]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:41:54 user nova-compute[231753]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:41:54 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsi session list stdout=tcp: [22] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 (non-flash)
Jul 29 13:41:54 user nova-compute[231753]: tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:41:54 user nova-compute[231753]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:41:54 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c806c68c0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4'): ({'sdb'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Removing single pathed devices sdb {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8aa5fb61-ae7a-4ef0-b366-252199d3c199]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[11e7b16e-3b7c-4c56-a2d0-8d3b4da66725]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Flushing IO for device /dev/sdb {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[06d93b0a-3d45-4d26-beed-e430504b9fdb]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.068s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f8c8ca-42e7-448a-a18d-be67a5476231]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] SCSI volumes sdb have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.119s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2825fae8-f6ad-4de3-acd7-d8c7b4757b26]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.062s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4ffad2b-28de-45b4-be10-633342cde8eb]: (4, ('Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4, portal: 172.16.0.220,3260]\nLogout of [sid: 22, target: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4, portal: 172.16.0.220,3260]
Jul 29 13:41:54 user nova-compute[231753]: Logout of [sid: 22, target: iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4, portal: 172.16.0.220,3260] successful.
Jul 29 13:41:54 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a62778d4-32b0-41ef-b7df-716d38fbcba4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[793f0dbb-be97-40e2-9cad-f6ded9fe669a]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.431s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] <== disconnect_volume: return (432ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:41:54 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Deleting instance files /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d_del
Jul 29 13:41:54 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Deletion of /opt/stack/data/nova/instances/63fad324-aac2-4d60-b4ce-a32a5736657d_del complete
Jul 29 13:41:54 user nova-compute[231753]: INFO nova.compute.manager [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Took 1.31 seconds to destroy the instance on the hypervisor.
Jul 29 13:41:54 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:41:54 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:41:55 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:41:55 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Took 0.89 seconds to deallocate network for instance.
Jul 29 13:41:55 user nova-compute[231753]: DEBUG nova.compute.manager [req-7e9f9e04-2ae4-489e-b143-7b32376bca1d req-57d65bcc-f3db-4f46-af9e-1c9c9e40b503 service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Received event network-vif-deleted-fadc1466-5336-4230-b0f1-4fe4053f216a {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:41:56 user nova-compute[231753]: DEBUG nova.compute.manager [req-6b68e34d-0c99-40d6-9140-23cd09a35302 req-bfc4b00f-14ef-41ea-bf67-e9042fbd2b31 service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Received event network-vif-plugged-fadc1466-5336-4230-b0f1-4fe4053f216a {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:41:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6b68e34d-0c99-40d6-9140-23cd09a35302 req-bfc4b00f-14ef-41ea-bf67-e9042fbd2b31 service nova] Acquiring lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:41:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6b68e34d-0c99-40d6-9140-23cd09a35302 req-bfc4b00f-14ef-41ea-bf67-e9042fbd2b31 service nova] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:41:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6b68e34d-0c99-40d6-9140-23cd09a35302 req-bfc4b00f-14ef-41ea-bf67-e9042fbd2b31 service nova] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:41:56 user nova-compute[231753]: DEBUG nova.compute.manager [req-6b68e34d-0c99-40d6-9140-23cd09a35302 req-bfc4b00f-14ef-41ea-bf67-e9042fbd2b31 service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] No waiting events found dispatching network-vif-plugged-fadc1466-5336-4230-b0f1-4fe4053f216a {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:41:56 user nova-compute[231753]: WARNING nova.compute.manager [req-6b68e34d-0c99-40d6-9140-23cd09a35302 req-bfc4b00f-14ef-41ea-bf67-e9042fbd2b31 service nova] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Received unexpected event network-vif-plugged-fadc1466-5336-4230-b0f1-4fe4053f216a for instance with vm_state active and task_state deleting.
Jul 29 13:41:56 user nova-compute[231753]: INFO nova.compute.manager [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Took 0.71 seconds to detach 1 volumes for instance.
Jul 29 13:41:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:41:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:41:57 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:41:57 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:41:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.435s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:41:57 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Deleted allocations for instance 63fad324-aac2-4d60-b4ce-a32a5736657d
Jul 29 13:41:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5bb933ad-619a-4c84-9019-d81a41f63a01 tempest-ServerActionsTestOtherB-1624737976 tempest-ServerActionsTestOtherB-1624737976-project-member] Lock "63fad324-aac2-4d60-b4ce-a32a5736657d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.526s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:41:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:41:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:00 user nova-compute[231753]: DEBUG nova.compute.manager [req-c5f4bb6a-5ee7-47d8-9006-0e4eb6c2f15e req-d123b344-3b95-42c5-907c-ceaeda4a5849 service nova] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Received event network-changed-980d6903-8cea-4a60-bd44-e8a7343d991f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:42:00 user nova-compute[231753]: DEBUG nova.compute.manager [req-c5f4bb6a-5ee7-47d8-9006-0e4eb6c2f15e req-d123b344-3b95-42c5-907c-ceaeda4a5849 service nova] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Refreshing instance network info cache due to event network-changed-980d6903-8cea-4a60-bd44-e8a7343d991f. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:42:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c5f4bb6a-5ee7-47d8-9006-0e4eb6c2f15e req-d123b344-3b95-42c5-907c-ceaeda4a5849 service nova] Acquiring lock "refresh_cache-aa8c3210-37e5-4e33-8ea4-98a70fa9800b" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:42:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c5f4bb6a-5ee7-47d8-9006-0e4eb6c2f15e req-d123b344-3b95-42c5-907c-ceaeda4a5849 service nova] Acquired lock "refresh_cache-aa8c3210-37e5-4e33-8ea4-98a70fa9800b" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:42:00 user nova-compute[231753]: DEBUG nova.network.neutron [req-c5f4bb6a-5ee7-47d8-9006-0e4eb6c2f15e req-d123b344-3b95-42c5-907c-ceaeda4a5849 service nova] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Refreshing network info cache for port 980d6903-8cea-4a60-bd44-e8a7343d991f {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:42:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Acquiring lock "aa8c3210-37e5-4e33-8ea4-98a70fa9800b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "aa8c3210-37e5-4e33-8ea4-98a70fa9800b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:00 user nova-compute[231753]: DEBUG nova.objects.instance [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lazy-loading 'flavor' on Instance uuid aa8c3210-37e5-4e33-8ea4-98a70fa9800b {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:42:00 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Ignoring supplied device name: /dev/vdb
Jul 29 13:42:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "aa8c3210-37e5-4e33-8ea4-98a70fa9800b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.065s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Acquiring lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:00 user nova-compute[231753]: DEBUG nova.objects.instance [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lazy-loading 'flavor' on Instance uuid 55bfcd1f-2b51-4e10-84a3-e132b96111e3 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:42:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.063s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Acquiring lock "aa8c3210-37e5-4e33-8ea4-98a70fa9800b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "aa8c3210-37e5-4e33-8ea4-98a70fa9800b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:00 user nova-compute[231753]: INFO nova.compute.manager [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Attaching volume 047fcc1e-d73e-40f1-b51c-eb5d5d009aaa to /dev/vdb
Jul 29 13:42:00 user nova-compute[231753]: DEBUG nova.network.neutron [req-c5f4bb6a-5ee7-47d8-9006-0e4eb6c2f15e req-d123b344-3b95-42c5-907c-ceaeda4a5849 service nova] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Updated VIF entry in instance network info cache for port 980d6903-8cea-4a60-bd44-e8a7343d991f. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:42:00 user nova-compute[231753]: DEBUG nova.network.neutron [req-c5f4bb6a-5ee7-47d8-9006-0e4eb6c2f15e req-d123b344-3b95-42c5-907c-ceaeda4a5849 service nova] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Updating instance_info_cache with network_info: [{"id": "980d6903-8cea-4a60-bd44-e8a7343d991f", "address": "fa:16:3e:e7:5e:eb", "network": {"id": "7f0a516e-a6d1-4198-b7f7-d1eef96625cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-408682612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd0f16e49ef48ff99752b6aec718358", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap980d6903-8c", "ovs_interfaceid": "980d6903-8cea-4a60-bd44-e8a7343d991f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:42:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c5f4bb6a-5ee7-47d8-9006-0e4eb6c2f15e req-d123b344-3b95-42c5-907c-ceaeda4a5849 service nova] Releasing lock "refresh_cache-aa8c3210-37e5-4e33-8ea4-98a70fa9800b" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:42:00 user nova-compute[231753]: DEBUG os_brick.utils [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:42:00 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:00 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:00 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6f9b14b-868d-4086-8d1b-aacaff652576]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:00 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:00 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:00 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b34d07a-b65f-41b2-a483-2b4efe228489]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:00 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:00 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:00 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4b021e3-70c2-481a-a75a-76160ec60402]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:00 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a9d679a-d2a0-4d66-a92b-6ac1424a0e03]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:00 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:00 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:42:00 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:42:01 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Acquiring lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:01 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:01 user nova-compute[231753]: INFO nova.compute.manager [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Attaching volume 04a22034-ac5e-42aa-a4f1-4f6bcbee85ed to /dev/vdb
Jul 29 13:42:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:42:01 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:42:01 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[594f4bcb-797d-4891-b60c-1563c2e94e3d]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:01 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:42:01 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:42:01 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:42:01 user nova-compute[231753]: DEBUG os_brick.utils [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:42:01 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Updating existing volume attachment record: 40619e47-615d-4a8f-b26d-db76d1812ed6 {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:42:01 user nova-compute[231753]: DEBUG os_brick.utils [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:42:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:01 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b16d48ea-af90-46c6-8552-dfc113e3fe09]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:01 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[22aafe35-b7bc-4824-8d04-2e0bead11c87]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:01 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e600ee7-88b6-42e1-bac1-32d490ba188e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:01 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3676bf4e-ab86-46c3-a7dc-c8b1bc8f0564]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:42:01 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:42:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:42:01 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:42:01 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d40f082-fe97-4b2e-8fac-a83bca989368]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:01 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:42:01 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:42:01 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:42:01 user nova-compute[231753]: DEBUG os_brick.utils [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] <== get_connector_properties: return (115ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:42:01 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Updating existing volume attachment record: 9644ee80-3b2f-4d99-ae26-5a4bdb5b2eaf {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:42:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:06 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:42:06 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 13:42:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:06 user nova-compute[231753]: DEBUG nova.compute.manager [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:42:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:07 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:42:07 user nova-compute[231753]: INFO nova.compute.claims [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Claim successful on node user
Jul 29 13:42:07 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:42:07 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:42:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.513s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:07 user nova-compute[231753]: DEBUG nova.compute.manager [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:42:07 user nova-compute[231753]: DEBUG nova.compute.manager [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:42:07 user nova-compute[231753]: DEBUG nova.network.neutron [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:42:07 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:42:07 user nova-compute[231753]: DEBUG nova.compute.manager [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:42:07 user nova-compute[231753]: INFO nova.virt.block_device [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Booting with volume afa3c554-c497-4ad8-94dc-fbe61541e6ef at /dev/vda
Jul 29 13:42:07 user nova-compute[231753]: DEBUG nova.policy [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '748938c3fbfb4244ab946dcfe4762435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'afff9d3d250643c58da9bc5cf5756d1e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:42:07 user nova-compute[231753]: DEBUG os_brick.utils [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:42:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e879397d-595e-47fb-9703-1f7540099cf6]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bad95d0-2526-491e-bd8c-6f290bb51571]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e483a9d-73a3-4267-8852-bc651cc88556]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cfa37a5-578e-4f79-9cd7-6e0669df9384]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:42:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:42:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:42:07 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:42:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e3b367a-7ca0-4ee8-b6b1-eba5fd0bff21]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:42:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:42:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:42:07 user nova-compute[231753]: DEBUG os_brick.utils [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:42:07 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Updating existing volume attachment record: dd1e7a91-76ec-4e2c-94a7-9290caacdecc {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fvxtHElB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:42:08 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:42:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:42:08 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:42:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:42:08 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:42:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6fa348-adbb-4477-b5bc-7ed1bec3b20c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:42:08 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG nova.network.neutron [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Successfully created port: 50f751e1-b359-47f5-8e65-19f48fcf1f4a {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[57dd7d57-76bb-4fa1-9f41-1ff6072f3b02]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa] added
Jul 29 13:42:08 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3248a84-a995-4296-bbc1-14595cfccc52]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[29b34056-cebe-484d-8a2d-a8f2cc278736]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fvxtHElB {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa -p 172.16.0.220:3260 --op update -n node.session.auth.username -v fvxtHElB" returned: 0 in 0.027s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65e4358-1e60-43d9-8c6c-681b2e7e55bf]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'fvxtHElB'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.034s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd9a17cd-68b0-4ea7-9fbd-95ffddf253da]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NVqGAIHZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:42:08 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:42:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[abd2a939-4336-44a3-80e0-40c39d12ba14]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:42:08 user nova-compute[231753]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:42:08 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:42:08 user nova-compute[231753]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:42:08 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa -p 172.16.0.220:3260 --login" returned: 0 in 0.066s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[09370044-5635-440e-ad34-95b8b9915ef4]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa, portal: 172.16.0.220,3260]
Jul 29 13:42:08 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa, portal: 172.16.0.220,3260] successful.
Jul 29 13:42:08 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e23d209-a258-4880-a256-714e7fe3b669]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a19615-b908-4f49-84ce-19d92b6c3502]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:42:08 user nova-compute[231753]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:42:08 user nova-compute[231753]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa (non-flash)
Jul 29 13:42:08 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:42:08 user nova-compute[231753]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:42:08 user nova-compute[231753]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa (non-flash)
Jul 29 13:42:08 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.371s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] HCTL ('33', '-', '-', 0) found on session 25 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ff5426-e7f6-4798-b1a3-25c34ac0ff6e]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:08 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: None {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690638114.4499815, 63fad324-aac2-4d60-b4ce-a32a5736657d => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:42:09 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] VM Stopped (Lifecycle Event)
Jul 29 13:42:09 user nova-compute[231753]: DEBUG nova.network.neutron [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Successfully updated port: 50f751e1-b359-47f5-8e65-19f48fcf1f4a {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG nova.compute.manager [None req-b922948f-00ca-4faa-89af-444109f69d84 None None] [instance: 63fad324-aac2-4d60-b4ce-a32a5736657d] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "refresh_cache-f62c7904-d9d1-4bfc-bef8-9b1c241134f1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquired lock "refresh_cache-f62c7904-d9d1-4bfc-bef8-9b1c241134f1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG nova.network.neutron [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG nova.compute.manager [req-83a56faf-55e9-4afc-8a12-fb5be6317f97 req-85c9ec5a-1979-497d-8caf-de986551cae5 service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Received event network-changed-50f751e1-b359-47f5-8e65-19f48fcf1f4a {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG nova.compute.manager [req-83a56faf-55e9-4afc-8a12-fb5be6317f97 req-85c9ec5a-1979-497d-8caf-de986551cae5 service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Refreshing instance network info cache due to event network-changed-50f751e1-b359-47f5-8e65-19f48fcf1f4a. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-83a56faf-55e9-4afc-8a12-fb5be6317f97 req-85c9ec5a-1979-497d-8caf-de986551cae5 service nova] Acquiring lock "refresh_cache-f62c7904-d9d1-4bfc-bef8-9b1c241134f1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG nova.network.neutron [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json" returned: 0 in 0.181s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Searching for a device in session 25 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fvxtHElB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.410s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] <== connect_volume: return (1413ms) {'type': 'block', 'scsi_wwn': '26636326430326331', 'path': '/dev/sdb'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26636326430326331', 'path': '/dev/sdb'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.188s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:42:09 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:42:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:42:09 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:42:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG nova.objects.instance [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lazy-loading 'flavor' on Instance uuid aa8c3210-37e5-4e33-8ea4-98a70fa9800b {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb77a31-b3f5-4563-94b6-6c8a6da2a48a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:42:09 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 13:42:09 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:42:09 user nova-compute[231753]:   <source dev="/dev/sdb"/>
Jul 29 13:42:09 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:42:09 user nova-compute[231753]:   <serial>047fcc1e-d73e-40f1-b51c-eb5d5d009aaa</serial>
Jul 29 13:42:09 user nova-compute[231753]: </disk>
Jul 29 13:42:09 user nova-compute[231753]:  {{(pid=231753) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c7e41f-0cd7-44ce-bb76-e0774e2a4c39]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed] added
Jul 29 13:42:09 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b6c6438-5b88-4fca-8f2e-5b4a724ba838]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a73f07-2e7d-41d3-96ac-0860f7d0b53b]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NVqGAIHZ {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NVqGAIHZ" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fed3ee-17ea-4a62-8f02-6e9ba6559068]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NVqGAIHZ'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[43364a65-5dd9-46d7-a100-f78f067f888c]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a124707d-6eea-4add-9ee9-a7932aa8048f]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:42:10 user nova-compute[231753]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:42:10 user nova-compute[231753]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa (non-flash)
Jul 29 13:42:10 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:42:10 user nova-compute[231753]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:42:10 user nova-compute[231753]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa (non-flash)
Jul 29 13:42:10 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a172989-f109-4f1a-88c3-0a8e67ac8d65]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed, portal: 172.16.0.220,3260]
Jul 29 13:42:10 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed, portal: 172.16.0.220,3260] successful.
Jul 29 13:42:10 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbcacb76-ca65-4f50-9c30-1a42c3a11140]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.036s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac34f69-cd99-429b-b6f3-050b21816b18]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:42:10 user nova-compute[231753]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:42:10 user nova-compute[231753]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa (non-flash)
Jul 29 13:42:10 user nova-compute[231753]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)
Jul 29 13:42:10 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:42:10 user nova-compute[231753]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:42:10 user nova-compute[231753]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa (non-flash)
Jul 29 13:42:10 user nova-compute[231753]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)
Jul 29 13:42:10 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.494s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] HCTL ('36', '-', '-', 0) found on session 26 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9de6e96-946b-4abb-94c8-d9299a7aab6a]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Searching for a device in session 26 and hctl ['36', '*', '*', 0] yield: sde {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NVqGAIHZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG nova.network.neutron [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Updating instance_info_cache with network_info: [{"id": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "address": "fa:16:3e:ed:37:b6", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f751e1-b3", "ovs_interfaceid": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Releasing lock "refresh_cache-f62c7904-d9d1-4bfc-bef8-9b1c241134f1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG nova.compute.manager [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Instance network_info: |[{"id": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "address": "fa:16:3e:ed:37:b6", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f751e1-b3", "ovs_interfaceid": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-83a56faf-55e9-4afc-8a12-fb5be6317f97 req-85c9ec5a-1979-497d-8caf-de986551cae5 service nova] Acquired lock "refresh_cache-f62c7904-d9d1-4bfc-bef8-9b1c241134f1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG nova.network.neutron [req-83a56faf-55e9-4afc-8a12-fb5be6317f97 req-85c9ec5a-1979-497d-8caf-de986551cae5 service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Refreshing network info cache for port 50f751e1-b359-47f5-8e65-19f48fcf1f4a {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] No BDM found with device name vdb, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] No VIF found with MAC fa:16:3e:e7:5e:eb, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk --force-share --output=json" returned: 0 in 0.179s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-f57b614d-551f-4c8b-bc7a-08ac439a6496 tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "aa8c3210-37e5-4e33-8ea4-98a70fa9800b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.003s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json" returned: 0 in 0.220s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:11 user nova-compute[231753]: DEBUG nova.network.neutron [req-83a56faf-55e9-4afc-8a12-fb5be6317f97 req-85c9ec5a-1979-497d-8caf-de986551cae5 service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Updated VIF entry in instance network info cache for port 50f751e1-b359-47f5-8e65-19f48fcf1f4a. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:42:11 user nova-compute[231753]: DEBUG nova.network.neutron [req-83a56faf-55e9-4afc-8a12-fb5be6317f97 req-85c9ec5a-1979-497d-8caf-de986551cae5 service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Updating instance_info_cache with network_info: [{"id": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "address": "fa:16:3e:ed:37:b6", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f751e1-b3", "ovs_interfaceid": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:42:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-83a56faf-55e9-4afc-8a12-fb5be6317f97 req-85c9ec5a-1979-497d-8caf-de986551cae5 service nova] Releasing lock "refresh_cache-f62c7904-d9d1-4bfc-bef8-9b1c241134f1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:42:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:11 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.543s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:42:11 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] <== connect_volume: return (2733ms) {'type': 'block', 'scsi_wwn': '23036393238363034', 'path': '/dev/sde'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:42:11 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036393238363034', 'path': '/dev/sde'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:42:11 user nova-compute[231753]: DEBUG nova.objects.instance [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lazy-loading 'flavor' on Instance uuid 55bfcd1f-2b51-4e10-84a3-e132b96111e3 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:42:11 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 13:42:11 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:42:11 user nova-compute[231753]:   <source dev="/dev/sde"/>
Jul 29 13:42:11 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:42:11 user nova-compute[231753]:   <serial>04a22034-ac5e-42aa-a4f1-4f6bcbee85ed</serial>
Jul 29 13:42:11 user nova-compute[231753]: </disk>
Jul 29 13:42:11 user nova-compute[231753]:  {{(pid=231753) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 13:42:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:42:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] No BDM found with device name vdb, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:42:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] No VIF found with MAC fa:16:3e:5b:23:7c, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:42:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json" returned: 0 in 0.180s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-cfcc911a-1356-4d98-a968-706da0e18112 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.307s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json" returned: 0 in 0.178s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:42:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8c3210-37e5-4e33-8ea4-98a70fa9800b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8c3210-37e5-4e33-8ea4-98a70fa9800b/disk --force-share --output=json" returned: 0 in 0.204s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8c3210-37e5-4e33-8ea4-98a70fa9800b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:13 user nova-compute[231753]: INFO nova.compute.manager [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Rescuing
Jul 29 13:42:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Acquiring lock "refresh_cache-55bfcd1f-2b51-4e10-84a3-e132b96111e3" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:42:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Acquired lock "refresh_cache-55bfcd1f-2b51-4e10-84a3-e132b96111e3" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:42:13 user nova-compute[231753]: DEBUG nova.network.neutron [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:42:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aa8c3210-37e5-4e33-8ea4-98a70fa9800b/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:13 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:42:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:14 user nova-compute[231753]: DEBUG nova.network.neutron [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Updating instance_info_cache with network_info: [{"id": "20213688-43ed-4115-bd0d-bc74791d95c4", "address": "fa:16:3e:5b:23:7c", "network": {"id": "e8ad7fa5-6e98-46f4-8062-0b9eddaa76a6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-253010414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b08b115e89482f9b81e621485c5eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20213688-43", "ovs_interfaceid": "20213688-43ed-4115-bd0d-bc74791d95c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:42:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Releasing lock "refresh_cache-55bfcd1f-2b51-4e10-84a3-e132b96111e3" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:42:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:42:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:14 user nova-compute[231753]: DEBUG nova.compute.manager [req-4f4a271c-8f6e-42f6-9f15-1a1ed7c14686 req-730b4826-1f63-4bf7-ab49-21ba4f5d6632 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Received event network-vif-unplugged-20213688-43ed-4115-bd0d-bc74791d95c4 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:42:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4f4a271c-8f6e-42f6-9f15-1a1ed7c14686 req-730b4826-1f63-4bf7-ab49-21ba4f5d6632 service nova] Acquiring lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4f4a271c-8f6e-42f6-9f15-1a1ed7c14686 req-730b4826-1f63-4bf7-ab49-21ba4f5d6632 service nova] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4f4a271c-8f6e-42f6-9f15-1a1ed7c14686 req-730b4826-1f63-4bf7-ab49-21ba4f5d6632 service nova] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:14 user nova-compute[231753]: DEBUG nova.compute.manager [req-4f4a271c-8f6e-42f6-9f15-1a1ed7c14686 req-730b4826-1f63-4bf7-ab49-21ba4f5d6632 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] No waiting events found dispatching network-vif-unplugged-20213688-43ed-4115-bd0d-bc74791d95c4 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:42:14 user nova-compute[231753]: WARNING nova.compute.manager [req-4f4a271c-8f6e-42f6-9f15-1a1ed7c14686 req-730b4826-1f63-4bf7-ab49-21ba4f5d6632 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Received unexpected event network-vif-unplugged-20213688-43ed-4115-bd0d-bc74791d95c4 for instance with vm_state active and task_state rescuing.
Jul 29 13:42:15 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:42:15 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:42:15 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=6816MB free_disk=25.23986053466797GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 13:42:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-de778960-8bb2-4ce9-baad-c065b4ed89be tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Acquiring lock "b67b98f8-a7b3-499e-ba32-9520bbced960" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-de778960-8bb2-4ce9-baad-c065b4ed89be tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lock "b67b98f8-a7b3-499e-ba32-9520bbced960" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-de778960-8bb2-4ce9-baad-c065b4ed89be tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Acquiring lock "b67b98f8-a7b3-499e-ba32-9520bbced960-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-de778960-8bb2-4ce9-baad-c065b4ed89be tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lock "b67b98f8-a7b3-499e-ba32-9520bbced960-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-de778960-8bb2-4ce9-baad-c065b4ed89be tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lock "b67b98f8-a7b3-499e-ba32-9520bbced960-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:15 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Instance destroyed successfully.
Jul 29 13:42:15 user nova-compute[231753]: INFO nova.compute.manager [None req-de778960-8bb2-4ce9-baad-c065b4ed89be tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Terminating instance
Jul 29 13:42:15 user nova-compute[231753]: DEBUG nova.compute.manager [None req-de778960-8bb2-4ce9-baad-c065b4ed89be tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:42:15 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Attempting a stable device rescue
Jul 29 13:42:15 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} {{(pid=231753) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 29 13:42:15 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Instance directory exists: not creating {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 29 13:42:15 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Creating image(s)
Jul 29 13:42:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Acquiring lock "/opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "/opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "/opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:15 user nova-compute[231753]: DEBUG nova.objects.instance [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lazy-loading 'trusted_certs' on Instance uuid 55bfcd1f-2b51-4e10-84a3-e132b96111e3 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:42:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Acquiring lock "7b36958bdf95195f31a4363d7cb8f1566af6f65e" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "7b36958bdf95195f31a4363d7cb8f1566af6f65e" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:15 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:15 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:15 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:42:15 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b67b98f8-a7b3-499e-ba32-9520bbced960 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:42:15 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 7e2615c1-b03e-4076-bcd9-3585fb11b8ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:42:15 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8ea52d41-7ec3-44d7-8421-133000ee887b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:42:15 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance cf326e80-7293-4764-9411-ed05a5aeba23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:42:15 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 55bfcd1f-2b51-4e10-84a3-e132b96111e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:42:15 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 481435b2-4319-4caf-aa5b-5c986a747258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:42:15 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance aa8c3210-37e5-4e33-8ea4-98a70fa9800b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:42:15 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 576f5002-4e4d-4236-8b0f-9b8788246de2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:42:15 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 16097b06-976f-4fcd-a449-7b1ec8f739d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:42:15 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:42:15 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b99a72ba-73e2-4be7-b52b-7797351daa5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:42:15 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8dd26572-fe6a-40fd-8c58-6af862b340c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:42:15 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance f62c7904-d9d1-4bfc-bef8-9b1c241134f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:42:15 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 13:42:15 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=7680MB phys_disk=40GB used_disk=12GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 13:42:15 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:15 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b36958bdf95195f31a4363d7cb8f1566af6f65e.part --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.compute.manager [req-9a1234c9-2716-4da9-9533-1f9299649264 req-dcb2ce76-1368-404b-9a03-226c41c65da7 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Received event network-vif-plugged-20213688-43ed-4115-bd0d-bc74791d95c4 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9a1234c9-2716-4da9-9533-1f9299649264 req-dcb2ce76-1368-404b-9a03-226c41c65da7 service nova] Acquiring lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9a1234c9-2716-4da9-9533-1f9299649264 req-dcb2ce76-1368-404b-9a03-226c41c65da7 service nova] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9a1234c9-2716-4da9-9533-1f9299649264 req-dcb2ce76-1368-404b-9a03-226c41c65da7 service nova] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.compute.manager [req-9a1234c9-2716-4da9-9533-1f9299649264 req-dcb2ce76-1368-404b-9a03-226c41c65da7 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] No waiting events found dispatching network-vif-plugged-20213688-43ed-4115-bd0d-bc74791d95c4 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:42:17 user nova-compute[231753]: WARNING nova.compute.manager [req-9a1234c9-2716-4da9-9533-1f9299649264 req-dcb2ce76-1368-404b-9a03-226c41c65da7 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Received unexpected event network-vif-plugged-20213688-43ed-4115-bd0d-bc74791d95c4 for instance with vm_state active and task_state rescuing.
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.compute.manager [req-9a1234c9-2716-4da9-9533-1f9299649264 req-dcb2ce76-1368-404b-9a03-226c41c65da7 service nova] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Received event network-vif-unplugged-a19600e4-052d-44b1-87b3-73605975e810 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9a1234c9-2716-4da9-9533-1f9299649264 req-dcb2ce76-1368-404b-9a03-226c41c65da7 service nova] Acquiring lock "b67b98f8-a7b3-499e-ba32-9520bbced960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9a1234c9-2716-4da9-9533-1f9299649264 req-dcb2ce76-1368-404b-9a03-226c41c65da7 service nova] Lock "b67b98f8-a7b3-499e-ba32-9520bbced960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9a1234c9-2716-4da9-9533-1f9299649264 req-dcb2ce76-1368-404b-9a03-226c41c65da7 service nova] Lock "b67b98f8-a7b3-499e-ba32-9520bbced960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.compute.manager [req-9a1234c9-2716-4da9-9533-1f9299649264 req-dcb2ce76-1368-404b-9a03-226c41c65da7 service nova] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] No waiting events found dispatching network-vif-unplugged-a19600e4-052d-44b1-87b3-73605975e810 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.compute.manager [req-9a1234c9-2716-4da9-9533-1f9299649264 req-dcb2ce76-1368-404b-9a03-226c41c65da7 service nova] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Received event network-vif-unplugged-a19600e4-052d-44b1-87b3-73605975e810 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.compute.manager [req-9a1234c9-2716-4da9-9533-1f9299649264 req-dcb2ce76-1368-404b-9a03-226c41c65da7 service nova] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Received event network-vif-plugged-a19600e4-052d-44b1-87b3-73605975e810 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9a1234c9-2716-4da9-9533-1f9299649264 req-dcb2ce76-1368-404b-9a03-226c41c65da7 service nova] Acquiring lock "b67b98f8-a7b3-499e-ba32-9520bbced960-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9a1234c9-2716-4da9-9533-1f9299649264 req-dcb2ce76-1368-404b-9a03-226c41c65da7 service nova] Lock "b67b98f8-a7b3-499e-ba32-9520bbced960-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9a1234c9-2716-4da9-9533-1f9299649264 req-dcb2ce76-1368-404b-9a03-226c41c65da7 service nova] Lock "b67b98f8-a7b3-499e-ba32-9520bbced960-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.compute.manager [req-9a1234c9-2716-4da9-9533-1f9299649264 req-dcb2ce76-1368-404b-9a03-226c41c65da7 service nova] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] No waiting events found dispatching network-vif-plugged-a19600e4-052d-44b1-87b3-73605975e810 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:42:17 user nova-compute[231753]: WARNING nova.compute.manager [req-9a1234c9-2716-4da9-9533-1f9299649264 req-dcb2ce76-1368-404b-9a03-226c41c65da7 service nova] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Received unexpected event network-vif-plugged-a19600e4-052d-44b1-87b3-73605975e810 for instance with vm_state active and task_state deleting.
Jul 29 13:42:17 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Instance destroyed successfully.
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.objects.instance [None req-de778960-8bb2-4ce9-baad-c065b4ed89be tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lazy-loading 'resources' on Instance uuid b67b98f8-a7b3-499e-ba32-9520bbced960 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-de778960-8bb2-4ce9-baad-c065b4ed89be tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:33:20Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServersNegativeTestJSON-server-1305715448',display_name='tempest-ServersNegativeTestJSON-server-1305715448',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serversnegativetestjson-server-1305715448',id=5,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:33:35Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='35a6a49685124aaf93030ca59169dde5',ramdisk_id='',reservation_id='r-k1vh7jit',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServersNegativeTestJSON-1215130688',owner_user_name='tempest-ServersNegativeTestJSON-1215130688-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:33:36Z,user_data=None,user_id='0f99f3a73b4e4831b25e63b2ef8362c9',uuid=b67b98f8-a7b3-499e-ba32-9520bbced960,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a19600e4-052d-44b1-87b3-73605975e810", "address": "fa:16:3e:7a:6e:42", "network": {"id": "092d27a5-871f-4865-ac97-fbb701a5c807", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-907499567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a6a49685124aaf93030ca59169dde5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa19600e4-05", "ovs_interfaceid": "a19600e4-052d-44b1-87b3-73605975e810", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-de778960-8bb2-4ce9-baad-c065b4ed89be tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Converting VIF {"id": "a19600e4-052d-44b1-87b3-73605975e810", "address": "fa:16:3e:7a:6e:42", "network": {"id": "092d27a5-871f-4865-ac97-fbb701a5c807", "bridge": "br-int", "label": "tempest-ServersNegativeTestJSON-907499567-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "35a6a49685124aaf93030ca59169dde5", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa19600e4-05", "ovs_interfaceid": "a19600e4-052d-44b1-87b3-73605975e810", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-de778960-8bb2-4ce9-baad-c065b4ed89be tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:7a:6e:42,bridge_name='br-int',has_traffic_filtering=True,id=a19600e4-052d-44b1-87b3-73605975e810,network=Network(092d27a5-871f-4865-ac97-fbb701a5c807),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa19600e4-05') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG os_vif [None req-de778960-8bb2-4ce9-baad-c065b4ed89be tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:6e:42,bridge_name='br-int',has_traffic_filtering=True,id=a19600e4-052d-44b1-87b3-73605975e810,network=Network(092d27a5-871f-4865-ac97-fbb701a5c807),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa19600e4-05') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa19600e4-05, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:17 user nova-compute[231753]: INFO os_vif [None req-de778960-8bb2-4ce9-baad-c065b4ed89be tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:7a:6e:42,bridge_name='br-int',has_traffic_filtering=True,id=a19600e4-052d-44b1-87b3-73605975e810,network=Network(092d27a5-871f-4865-ac97-fbb701a5c807),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa19600e4-05')
Jul 29 13:42:17 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-de778960-8bb2-4ce9-baad-c065b4ed89be tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Deleting instance files /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960_del
Jul 29 13:42:17 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-de778960-8bb2-4ce9-baad-c065b4ed89be tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Deletion of /opt/stack/data/nova/instances/b67b98f8-a7b3-499e-ba32-9520bbced960_del complete
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b36958bdf95195f31a4363d7cb8f1566af6f65e.part --force-share --output=json" returned: 0 in 0.170s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.images [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] 23d88607-b66e-4182-99a4-7ca921556070 was qcow2, converting to raw {{(pid=231753) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.privsep.utils [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=231753) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7b36958bdf95195f31a4363d7cb8f1566af6f65e.part /opt/stack/data/nova/instances/_base/7b36958bdf95195f31a4363d7cb8f1566af6f65e.converted {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:17 user nova-compute[231753]: INFO nova.compute.manager [None req-de778960-8bb2-4ce9-baad-c065b4ed89be tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Took 1.71 seconds to destroy the instance on the hypervisor.
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-de778960-8bb2-4ce9-baad-c065b4ed89be tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/7b36958bdf95195f31a4363d7cb8f1566af6f65e.part /opt/stack/data/nova/instances/_base/7b36958bdf95195f31a4363d7cb8f1566af6f65e.converted" returned: 0 in 0.326s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b36958bdf95195f31a4363d7cb8f1566af6f65e.converted --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.compute.manager [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:42:17 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Creating image(s)
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Did not create local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Ensure instance console log exists: /opt/stack/data/nova/instances/f62c7904-d9d1-4bfc-bef8-9b1c241134f1/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Start _get_guest_xml network_info=[{"id": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "address": "fa:16:3e:ed:37:b6", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f751e1-b3", "ovs_interfaceid": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QWgPCtAU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'f62c7904-d9d1-4bfc-bef8-9b1c241134f1', 'attached_at': '', 'detached_at': '', 'volume_id': 'afa3c554-c497-4ad8-94dc-fbe61541e6ef', 'serial': 'afa3c554-c497-4ad8-94dc-fbe61541e6ef'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'attachment_id': 'dd1e7a91-76ec-4e2c-94a7-9290caacdecc', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b36958bdf95195f31a4363d7cb8f1566af6f65e.converted --force-share --output=json" returned: 0 in 0.181s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "7b36958bdf95195f31a4363d7cb8f1566af6f65e" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.027s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Acquiring lock "7b36958bdf95195f31a4363d7cb8f1566af6f65e" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "7b36958bdf95195f31a4363d7cb8f1566af6f65e" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b36958bdf95195f31a4363d7cb8f1566af6f65e --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.215s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:17 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:42:17 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QWgPCtAU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:42:17 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:42:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:42:17 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:42:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:42:17 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/7b36958bdf95195f31a4363d7cb8f1566af6f65e --force-share --output=json" returned: 0 in 0.150s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7b36958bdf95195f31a4363d7cb8f1566af6f65e,backing_fmt=raw /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk.rescue {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260" returned: 21 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[84556c12-b8e3-4d5d-97f7-492beca581ef]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:42:17 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/7b36958bdf95195f31a4363d7cb8f1566af6f65e,backing_fmt=raw /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk.rescue" returned: 0 in 0.060s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "7b36958bdf95195f31a4363d7cb8f1566af6f65e" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.213s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.objects.instance [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lazy-loading 'migration_context' on Instance uuid 55bfcd1f-2b51-4e10-84a3-e132b96111e3 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e57d5983-e821-40a1-a57b-4594ee75df59]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef] added
Jul 29 13:42:17 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Start _get_guest_xml network_info=[{"id": "20213688-43ed-4115-bd0d-bc74791d95c4", "address": "fa:16:3e:5b:23:7c", "network": {"id": "e8ad7fa5-6e98-46f4-8062-0b9eddaa76a6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-253010414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-253010414-network", "vif_mac": "fa:16:3e:5b:23:7c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b08b115e89482f9b81e621485c5eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20213688-43", "ovs_interfaceid": "20213688-43ed-4115-bd0d-bc74791d95c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '23d88607-b66e-4182-99a4-7ca921556070', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NVqGAIHZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, 'status': 'reserved', 'instance': '55bfcd1f-2b51-4e10-84a3-e132b96111e3', 'attached_at': '', 'detached_at': '', 'volume_id': '04a22034-ac5e-42aa-a4f1-4f6bcbee85ed', 'serial': '04a22034-ac5e-42aa-a4f1-4f6bcbee85ed'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '9644ee80-3b2f-4d99-ae26-5a4bdb5b2eaf', 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.objects.instance [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lazy-loading 'resources' on Instance uuid 55bfcd1f-2b51-4e10-84a3-e132b96111e3 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:42:17 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Took 0.68 seconds to deallocate network for instance.
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.045s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7535025c-e03d-4a3b-be7c-cd80e2848679]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.objects.instance [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lazy-loading 'numa_topology' on Instance uuid 55bfcd1f-2b51-4e10-84a3-e132b96111e3 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2c06ec0-72fb-4519-8ed8-c8d0fde723d5]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:17 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:42:17 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QWgPCtAU {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG nova.objects.instance [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lazy-loading 'vcpu_model' on Instance uuid 55bfcd1f-2b51-4e10-84a3-e132b96111e3 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-de778960-8bb2-4ce9-baad-c065b4ed89be tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-de778960-8bb2-4ce9-baad-c065b4ed89be tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QWgPCtAU" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d33a368-221d-414c-8b86-55b86e974181]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QWgPCtAU'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NVqGAIHZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:42:18 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:42:18 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.040s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[badcba95-80b8-4bab-8c0c-c78430853f85]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e861d1-8fa7-4067-81e8-b4fdcb88a934]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:42:18 user nova-compute[231753]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:42:18 user nova-compute[231753]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa (non-flash)
Jul 29 13:42:18 user nova-compute[231753]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)
Jul 29 13:42:18 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:42:18 user nova-compute[231753]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:42:18 user nova-compute[231753]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa (non-flash)
Jul 29 13:42:18 user nova-compute[231753]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)
Jul 29 13:42:18 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c64eb65-0587-4a90-89af-f5eeab82ea52]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef, portal: 172.16.0.220,3260]
Jul 29 13:42:18 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef, portal: 172.16.0.220,3260] successful.
Jul 29 13:42:18 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[91aa7c5f-707f-4998-893a-d109da4ea58d]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[30554d98-b13f-439a-b107-dcc128ada292]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:42:18 user nova-compute[231753]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:42:18 user nova-compute[231753]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa (non-flash)
Jul 29 13:42:18 user nova-compute[231753]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)
Jul 29 13:42:18 user nova-compute[231753]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:42:18 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:42:18 user nova-compute[231753]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:42:18 user nova-compute[231753]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa (non-flash)
Jul 29 13:42:18 user nova-compute[231753]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)
Jul 29 13:42:18 user nova-compute[231753]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:42:18 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.432s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] HCTL ('37', '-', '-', 0) found on session 27 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[38127c96-31b5-40eb-bb4e-8407638179b6]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Searching for a device in session 27 and hctl ['37', '*', '*', 0] yield: None {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-de778960-8bb2-4ce9-baad-c065b4ed89be tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-de778960-8bb2-4ce9-baad-c065b4ed89be tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-de778960-8bb2-4ce9-baad-c065b4ed89be tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.532s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:18 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-de778960-8bb2-4ce9-baad-c065b4ed89be tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Deleted allocations for instance b67b98f8-a7b3-499e-ba32-9520bbced960
Jul 29 13:42:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-de778960-8bb2-4ce9-baad-c065b4ed89be tempest-ServersNegativeTestJSON-1215130688 tempest-ServersNegativeTestJSON-1215130688-project-member] Lock "b67b98f8-a7b3-499e-ba32-9520bbced960" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.164s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG nova.compute.manager [req-6f717f48-5e23-4170-ad40-cd339e197d3b req-21f18fac-df87-430d-aaba-095c25bd2952 service nova] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Received event network-vif-deleted-a19600e4-052d-44b1-87b3-73605975e810 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "refresh_cache-7e2615c1-b03e-4076-bcd9-3585fb11b8ac" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquired lock "refresh_cache-7e2615c1-b03e-4076-bcd9-3585fb11b8ac" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:42:18 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Forcefully refreshing network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Searching for a device in session 27 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QWgPCtAU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.465s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] <== connect_volume: return (1467ms) {'type': 'block', 'scsi_wwn': '23632316232303066', 'path': '/dev/sdf'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632316232303066', 'path': '/dev/sdf'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.210s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:42:19 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:42:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:42:19 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:42:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:42:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-643824359',display_name='tempest-ServerActionsTestOtherA-server-643824359',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-643824359',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuWQgyAL1ZhtINiMb8bBadRX1/6ZehT6zfTT2DNFW6eh8iXvfW0Pq6raR1PDnzRXJlqkmjwTrVF+AwsdLN+yPf0k+X1yx9QfVmcJaO2ivlK/Orc5S8LFrDXUE7UuYGgdQ==',key_name='tempest-keypair-820646002',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='afff9d3d250643c58da9bc5cf5756d1e',ramdisk_id='',reservation_id='r-yz0wxii9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1666416634',owner_user_name='tempest-ServerActionsTestOtherA-1666416634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:42:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='748938c3fbfb4244ab946dcfe4762435',uuid=f62c7904-d9d1-4bfc-bef8-9b1c241134f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "address": "fa:16:3e:ed:37:b6", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f751e1-b3", "ovs_interfaceid": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Converting VIF {"id": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "address": "fa:16:3e:ed:37:b6", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f751e1-b3", "ovs_interfaceid": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:37:b6,bridge_name='br-int',has_traffic_filtering=True,id=50f751e1-b359-47f5-8e65-19f48fcf1f4a,network=Network(f99d9e39-7a5f-481e-905f-4d5a4e920b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f751e1-b3') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG nova.objects.instance [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lazy-loading 'pci_devices' on Instance uuid f62c7904-d9d1-4bfc-bef8-9b1c241134f1 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed -p 172.16.0.220:3260" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[69233454-f271-49ca-9e43-0e0ab5fd49b6]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = NVqGAIHZ\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 29 13:42:19 user nova-compute[231753]: node.name = iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed
Jul 29 13:42:19 user nova-compute[231753]: node.tpgt = -1
Jul 29 13:42:19 user nova-compute[231753]: node.startup = automatic
Jul 29 13:42:19 user nova-compute[231753]: node.leading_login = No
Jul 29 13:42:19 user nova-compute[231753]: iface.iscsi_ifacename = default
Jul 29 13:42:19 user nova-compute[231753]: iface.net_ifacename = <empty>
Jul 29 13:42:19 user nova-compute[231753]: iface.ipaddress = <empty>
Jul 29 13:42:19 user nova-compute[231753]: iface.prefix_len = 0
Jul 29 13:42:19 user nova-compute[231753]: iface.hwaddress = <empty>
Jul 29 13:42:19 user nova-compute[231753]: iface.transport_name = tcp
Jul 29 13:42:19 user nova-compute[231753]: iface.initiatorname = <empty>
Jul 29 13:42:19 user nova-compute[231753]: iface.state = <empty>
Jul 29 13:42:19 user nova-compute[231753]: iface.vlan_id = 0
Jul 29 13:42:19 user nova-compute[231753]: iface.vlan_priority = 0
Jul 29 13:42:19 user nova-compute[231753]: iface.vlan_state = <empty>
Jul 29 13:42:19 user nova-compute[231753]: iface.iface_num = 0
Jul 29 13:42:19 user nova-compute[231753]: iface.mtu = 0
Jul 29 13:42:19 user nova-compute[231753]: iface.port = 0
Jul 29 13:42:19 user nova-compute[231753]: iface.bootproto = <empty>
Jul 29 13:42:19 user nova-compute[231753]: iface.subnet_mask = <empty>
Jul 29 13:42:19 user nova-compute[231753]: iface.gateway = <empty>
Jul 29 13:42:19 user nova-compute[231753]: iface.dhcp_alt_client_id_state = <empty>
Jul 29 13:42:19 user nova-compute[231753]: iface.dhcp_alt_client_id = <empty>
Jul 29 13:42:19 user nova-compute[231753]: iface.dhcp_dns = <empty>
Jul 29 13:42:19 user nova-compute[231753]: iface.dhcp_learn_iqn = <empty>
Jul 29 13:42:19 user nova-compute[231753]: iface.dhcp_req_vendor_id_state = <empty>
Jul 29 13:42:19 user nova-compute[231753]: iface.dhcp_vendor_id_state = <empty>
Jul 29 13:42:19 user nova-compute[231753]: iface.dhcp_vendor_id = <empty>
Jul 29 13:42:19 user nova-compute[231753]: iface.dhcp_slp_da = <empty>
Jul 29 13:42:19 user nova-compute[231753]: iface.fragmentation = <empty>
Jul 29 13:42:19 user nova-compute[231753]: iface.gratuitous_arp = <empty>
Jul 29 13:42:19 user nova-compute[231753]: iface.incoming_forwarding = <empty>
Jul 29 13:42:19 user nova-compute[231753]: iface.tos_state = <empty>
Jul 29 13:42:19 user nova-compute[231753]: iface.tos = 0
Jul 29 13:42:19 user nova-compute[231753]: iface.ttl = 0
Jul 29 13:42:19 user nova-compute[231753]: iface.delayed_ack = <empty>
Jul 29 13:42:19 user nova-compute[231753]: iface.tcp_nagle = <empty>
Jul 29 13:42:19 user nova-compute[231753]: iface.tcp_wsf_state = <empty>
Jul 29 13:42:19 user nova-compute[231753]: iface.tcp_wsf = 0
Jul 29 13:42:19 user nova-compute[231753]: iface.tcp_timer_scale = 0
Jul 29 13:42:19 user nova-compute[231753]: iface.tcp_timestamp = <empty>
Jul 29 13:42:19 user nova-compute[231753]: iface.redirect = <empty>
Jul 29 13:42:19 user nova-compute[231753]: iface.def_task_mgmt_timeout = 0
Jul 29 13:42:19 user nova-compute[231753]: iface.header_digest = <empty>
Jul 29 13:42:19 user nova-compute[231753]: iface.data_digest = <empty>
Jul 29 13:42:19 user nova-compute[231753]: iface.immediate_data = <empty>
Jul 29 13:42:19 user nova-compute[231753]: iface.initial_r2t = <empty>
Jul 29 13:42:19 user nova-compute[231753]: iface.data_seq_inorder = <empty>
Jul 29 13:42:19 user nova-compute[231753]: iface.data_pdu_inorder = <empty>
Jul 29 13:42:19 user nova-compute[231753]: iface.erl = 0
Jul 29 13:42:19 user nova-compute[231753]: iface.max_receive_data_len = 0
Jul 29 13:42:19 user nova-compute[231753]: iface.first_burst_len = 0
Jul 29 13:42:19 user nova-compute[231753]: iface.max_outstanding_r2t = 0
Jul 29 13:42:19 user nova-compute[231753]: iface.max_burst_len = 0
Jul 29 13:42:19 user nova-compute[231753]: iface.chap_auth = <empty>
Jul 29 13:42:19 user nova-compute[231753]: iface.bidi_chap = <empty>
Jul 29 13:42:19 user nova-compute[231753]: iface.strict_login_compliance = <empty>
Jul 29 13:42:19 user nova-compute[231753]: iface.discovery_auth = <empty>
Jul 29 13:42:19 user nova-compute[231753]: iface.discovery_logout = <empty>
Jul 29 13:42:19 user nova-compute[231753]: node.discovery_address = <empty>
Jul 29 13:42:19 user nova-compute[231753]: node.discovery_port = 0
Jul 29 13:42:19 user nova-compute[231753]: node.discovery_type = static
Jul 29 13:42:19 user nova-compute[231753]: node.session.initial_cmdsn = 0
Jul 29 13:42:19 user nova-compute[231753]: node.session.initial_login_retry_max = 8
Jul 29 13:42:19 user nova-compute[231753]: node.session.xmit_thread_priority = -20
Jul 29 13:42:19 user nova-compute[231753]: node.session.cmds_max = 128
Jul 29 13:42:19 user nova-compute[231753]: node.session.queue_depth = 32
Jul 29 13:42:19 user nova-compute[231753]: node.session.nr_sessions = 1
Jul 29 13:42:19 user nova-compute[231753]: node.session.auth.authmethod = CHAP
Jul 29 13:42:19 user nova-compute[231753]: node.session.auth.username = NVqGAIHZ
Jul 29 13:42:19 user nova-compute[231753]: node.session.auth.password = ***
Jul 29 13:42:19 user nova-compute[231753]: node.session.auth.username_in = <empty>
Jul 29 13:42:19 user nova-compute[231753]: node.session.auth.password_in = <empty>
Jul 29 13:42:19 user nova-compute[231753]: node.session.auth.chap_algs = MD5
Jul 29 13:42:19 user nova-compute[231753]: node.session.timeo.replacement_timeout = 120
Jul 29 13:42:19 user nova-compute[231753]: node.session.err_timeo.abort_timeout = 15
Jul 29 13:42:19 user nova-compute[231753]: node.session.err_timeo.lu_reset_timeout = 30
Jul 29 13:42:19 user nova-compute[231753]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 29 13:42:19 user nova-compute[231753]: node.session.err_timeo.host_reset_timeout = 60
Jul 29 13:42:19 user nova-compute[231753]: node.session.iscsi.FastAbort = Yes
Jul 29 13:42:19 user nova-compute[231753]: node.session.iscsi.InitialR2T = No
Jul 29 13:42:19 user nova-compute[231753]: node.session.iscsi.ImmediateData = Yes
Jul 29 13:42:19 user nova-compute[231753]: node.session.iscsi.FirstBurstLength = 262144
Jul 29 13:42:19 user nova-compute[231753]: node.session.iscsi.MaxBurstLength = 16776192
Jul 29 13:42:19 user nova-compute[231753]: node.session.iscsi.DefaultTime2Retain = 0
Jul 29 13:42:19 user nova-compute[231753]: node.session.iscsi.DefaultTime2Wait = 2
Jul 29 13:42:19 user nova-compute[231753]: node.session.iscsi.MaxConnections = 1
Jul 29 13:42:19 user nova-compute[231753]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 29 13:42:19 user nova-compute[231753]: node.session.iscsi.ERL = 0
Jul 29 13:42:19 user nova-compute[231753]: node.session.scan = manual
Jul 29 13:42:19 user nova-compute[231753]: node.session.reopen_max = 0
Jul 29 13:42:19 user nova-compute[231753]: node.conn[0].address = 172.16.0.220
Jul 29 13:42:19 user nova-compute[231753]: node.conn[0].port = 3260
Jul 29 13:42:19 user nova-compute[231753]: node.conn[0].startup = manual
Jul 29 13:42:19 user nova-compute[231753]: node.conn[0].tcp.window_size = 524288
Jul 29 13:42:19 user nova-compute[231753]: node.conn[0].tcp.type_of_service = 0
Jul 29 13:42:19 user nova-compute[231753]: node.conn[0].timeo.logout_timeout = 15
Jul 29 13:42:19 user nova-compute[231753]: node.conn[0].timeo.login_timeout = 15
Jul 29 13:42:19 user nova-compute[231753]: node.conn[0].timeo.auth_timeout = 45
Jul 29 13:42:19 user nova-compute[231753]: node.conn[0].timeo.noop_out_interval = 5
Jul 29 13:42:19 user nova-compute[231753]: node.conn[0].timeo.noop_out_timeout = 5
Jul 29 13:42:19 user nova-compute[231753]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 29 13:42:19 user nova-compute[231753]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 29 13:42:19 user nova-compute[231753]: node.conn[0].iscsi.HeaderDigest = None
Jul 29 13:42:19 user nova-compute[231753]: node.conn[0].iscsi.DataDigest = None
Jul 29 13:42:19 user nova-compute[231753]: node.conn[0].iscsi.IFMarker = No
Jul 29 13:42:19 user nova-compute[231753]: node.conn[0].iscsi.OFMarker = No
Jul 29 13:42:19 user nova-compute[231753]: # END RECORD
Jul 29 13:42:19 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:42:19 user nova-compute[231753]:   <uuid>f62c7904-d9d1-4bfc-bef8-9b1c241134f1</uuid>
Jul 29 13:42:19 user nova-compute[231753]:   <name>instance-0000001a</name>
Jul 29 13:42:19 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:42:19 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:42:19 user nova-compute[231753]:   <metadata>
Jul 29 13:42:19 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:42:19 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:42:19 user nova-compute[231753]:       <nova:name>tempest-ServerActionsTestOtherA-server-643824359</nova:name>
Jul 29 13:42:19 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:42:17</nova:creationTime>
Jul 29 13:42:19 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:42:19 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:42:19 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:42:19 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:42:19 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:42:19 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:42:19 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:42:19 user nova-compute[231753]:       <nova:owner>
Jul 29 13:42:19 user nova-compute[231753]:         <nova:user uuid="748938c3fbfb4244ab946dcfe4762435">tempest-ServerActionsTestOtherA-1666416634-project-member</nova:user>
Jul 29 13:42:19 user nova-compute[231753]:         <nova:project uuid="afff9d3d250643c58da9bc5cf5756d1e">tempest-ServerActionsTestOtherA-1666416634</nova:project>
Jul 29 13:42:19 user nova-compute[231753]:       </nova:owner>
Jul 29 13:42:19 user nova-compute[231753]:       <nova:ports>
Jul 29 13:42:19 user nova-compute[231753]:         <nova:port uuid="50f751e1-b359-47f5-8e65-19f48fcf1f4a">
Jul 29 13:42:19 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 29 13:42:19 user nova-compute[231753]:         </nova:port>
Jul 29 13:42:19 user nova-compute[231753]:       </nova:ports>
Jul 29 13:42:19 user nova-compute[231753]:     </nova:instance>
Jul 29 13:42:19 user nova-compute[231753]:   </metadata>
Jul 29 13:42:19 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:42:19 user nova-compute[231753]:     <system>
Jul 29 13:42:19 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:42:19 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:42:19 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:42:19 user nova-compute[231753]:       <entry name="serial">f62c7904-d9d1-4bfc-bef8-9b1c241134f1</entry>
Jul 29 13:42:19 user nova-compute[231753]:       <entry name="uuid">f62c7904-d9d1-4bfc-bef8-9b1c241134f1</entry>
Jul 29 13:42:19 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:42:19 user nova-compute[231753]:     </system>
Jul 29 13:42:19 user nova-compute[231753]:   </sysinfo>
Jul 29 13:42:19 user nova-compute[231753]:   <os>
Jul 29 13:42:19 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:42:19 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:42:19 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:42:19 user nova-compute[231753]:   </os>
Jul 29 13:42:19 user nova-compute[231753]:   <features>
Jul 29 13:42:19 user nova-compute[231753]:     <acpi/>
Jul 29 13:42:19 user nova-compute[231753]:     <apic/>
Jul 29 13:42:19 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:42:19 user nova-compute[231753]:   </features>
Jul 29 13:42:19 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:42:19 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:42:19 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:42:19 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:42:19 user nova-compute[231753]:   </clock>
Jul 29 13:42:19 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:42:19 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:42:19 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:42:19 user nova-compute[231753]:   </cpu>
Jul 29 13:42:19 user nova-compute[231753]:   <devices>
Jul 29 13:42:19 user nova-compute[231753]:     <disk type="block" device="disk">
Jul 29 13:42:19 user nova-compute[231753]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:42:19 user nova-compute[231753]:       <source dev="/dev/sdf"/>
Jul 29 13:42:19 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:42:19 user nova-compute[231753]:       <serial>afa3c554-c497-4ad8-94dc-fbe61541e6ef</serial>
Jul 29 13:42:19 user nova-compute[231753]:     </disk>
Jul 29 13:42:19 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:42:19 user nova-compute[231753]:       <mac address="fa:16:3e:ed:37:b6"/>
Jul 29 13:42:19 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:42:19 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:42:19 user nova-compute[231753]:       <target dev="tap50f751e1-b3"/>
Jul 29 13:42:19 user nova-compute[231753]:     </interface>
Jul 29 13:42:19 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:42:19 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/f62c7904-d9d1-4bfc-bef8-9b1c241134f1/console.log" append="off"/>
Jul 29 13:42:19 user nova-compute[231753]:     </serial>
Jul 29 13:42:19 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:42:19 user nova-compute[231753]:     <video>
Jul 29 13:42:19 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:42:19 user nova-compute[231753]:     </video>
Jul 29 13:42:19 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:42:19 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:42:19 user nova-compute[231753]:     </rng>
Jul 29 13:42:19 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:42:19 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:42:19 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:42:19 user nova-compute[231753]:     </memballoon>
Jul 29 13:42:19 user nova-compute[231753]:   </devices>
Jul 29 13:42:19 user nova-compute[231753]: </domain>
Jul 29 13:42:19 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:42:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-643824359',display_name='tempest-ServerActionsTestOtherA-server-643824359',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-643824359',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuWQgyAL1ZhtINiMb8bBadRX1/6ZehT6zfTT2DNFW6eh8iXvfW0Pq6raR1PDnzRXJlqkmjwTrVF+AwsdLN+yPf0k+X1yx9QfVmcJaO2ivlK/Orc5S8LFrDXUE7UuYGgdQ==',key_name='tempest-keypair-820646002',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='afff9d3d250643c58da9bc5cf5756d1e',ramdisk_id='',reservation_id='r-yz0wxii9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherA-1666416634',owner_user_name='tempest-ServerActionsTestOtherA-1666416634-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:42:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='748938c3fbfb4244ab946dcfe4762435',uuid=f62c7904-d9d1-4bfc-bef8-9b1c241134f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "address": "fa:16:3e:ed:37:b6", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f751e1-b3", "ovs_interfaceid": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Converting VIF {"id": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "address": "fa:16:3e:ed:37:b6", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f751e1-b3", "ovs_interfaceid": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:37:b6,bridge_name='br-int',has_traffic_filtering=True,id=50f751e1-b359-47f5-8e65-19f48fcf1f4a,network=Network(f99d9e39-7a5f-481e-905f-4d5a4e920b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f751e1-b3') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG os_vif [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:37:b6,bridge_name='br-int',has_traffic_filtering=True,id=50f751e1-b359-47f5-8e65-19f48fcf1f4a,network=Network(f99d9e39-7a5f-481e-905f-4d5a4e920b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f751e1-b3') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Updating instance_info_cache with network_info: [{"id": "8c8e51fe-0d15-4a27-8215-dc512b6816f5", "address": "fa:16:3e:3e:10:27", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e51fe-0d", "ovs_interfaceid": "8c8e51fe-0d15-4a27-8215-dc512b6816f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a179c373-7113-4204-a3a5-d4395ec0a74b]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50f751e1-b3, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap50f751e1-b3, col_values=(('external_ids', {'iface-id': '50f751e1-b359-47f5-8e65-19f48fcf1f4a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:37:b6', 'vm-uuid': 'f62c7904-d9d1-4bfc-bef8-9b1c241134f1'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Releasing lock "refresh_cache-7e2615c1-b03e-4076-bcd9-3585fb11b8ac" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Updated the network info_cache for instance {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[61982487-66d9-4d00-bef5-af0a2695119e]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NVqGAIHZ {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:19 user nova-compute[231753]: INFO os_vif [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:37:b6,bridge_name='br-int',has_traffic_filtering=True,id=50f751e1-b359-47f5-8e65-19f48fcf1f4a,network=Network(f99d9e39-7a5f-481e-905f-4d5a4e920b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f751e1-b3')
Jul 29 13:42:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed -p 172.16.0.220:3260 --op update -n node.session.auth.username -v NVqGAIHZ" returned: 0 in 0.027s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad1551a9-d75d-433a-bf5a-a311b7de816d]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'NVqGAIHZ'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4ae0bd6-3360-4a70-96dd-80f325092087]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] No VIF found with MAC fa:16:3e:ed:37:b6, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c67732-1fd6-447e-be60-19edfea7c5c1]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:42:19 user nova-compute[231753]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:42:19 user nova-compute[231753]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa (non-flash)
Jul 29 13:42:19 user nova-compute[231753]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)
Jul 29 13:42:19 user nova-compute[231753]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:42:19 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:42:19 user nova-compute[231753]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:42:19 user nova-compute[231753]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa (non-flash)
Jul 29 13:42:19 user nova-compute[231753]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)
Jul 29 13:42:19 user nova-compute[231753]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:42:19 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.184s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] HCTL ('36', '0', '0', 0) found on session 26 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Scanning host 36 c: 0, t: 0, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.014s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3925a45-953e-4102-9c53-86474daa4f88]: (4, ('0 0 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Searching for a device in session 26 and hctl ('36', '0', '0', 0) yield: sde {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NVqGAIHZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.210s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] <== connect_volume: return (1419ms) {'type': 'block', 'scsi_wwn': '23036393238363034', 'path': '/dev/sde'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23036393238363034', 'path': '/dev/sde'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:38:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-822050220',display_name='tempest-ServerStableDeviceRescueTest-server-822050220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-822050220',id=18,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLyGCBaoHjvQRU5y6VqE87h4pGKr395VS9nv3boXPwLjzRxAJ8a8DweQMoJzuHlYTrldK2HJUMuE4Q1Aln3tvz5msHzQk2ShH+h/Nolt0WeNgGFtEEy1LahJXGP/vcc1rA==',key_name='tempest-keypair-1028300193',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:38:22Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12b08b115e89482f9b81e621485c5eb6',ramdisk_id='',reservation_id='r-80ua53lw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1348314180',owner_user_name='tempest-ServerStableDeviceRescueTest-1348314180-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:40:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f8f87b5aaeb4b18b013a85a579ac48b',uuid=55bfcd1f-2b51-4e10-84a3-e132b96111e3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20213688-43ed-4115-bd0d-bc74791d95c4", "address": "fa:16:3e:5b:23:7c", "network": {"id": "e8ad7fa5-6e98-46f4-8062-0b9eddaa76a6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-253010414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-253010414-network", "vif_mac": "fa:16:3e:5b:23:7c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b08b115e89482f9b81e621485c5eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20213688-43", "ovs_interfaceid": "20213688-43ed-4115-bd0d-bc74791d95c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Converting VIF {"id": "20213688-43ed-4115-bd0d-bc74791d95c4", "address": "fa:16:3e:5b:23:7c", "network": {"id": "e8ad7fa5-6e98-46f4-8062-0b9eddaa76a6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-253010414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerStableDeviceRescueTest-253010414-network", "vif_mac": "fa:16:3e:5b:23:7c"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b08b115e89482f9b81e621485c5eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20213688-43", "ovs_interfaceid": "20213688-43ed-4115-bd0d-bc74791d95c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:23:7c,bridge_name='br-int',has_traffic_filtering=True,id=20213688-43ed-4115-bd0d-bc74791d95c4,network=Network(e8ad7fa5-6e98-46f4-8062-0b9eddaa76a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20213688-43') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG nova.objects.instance [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lazy-loading 'pci_devices' on Instance uuid 55bfcd1f-2b51-4e10-84a3-e132b96111e3 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:42:19 user nova-compute[231753]:   <uuid>55bfcd1f-2b51-4e10-84a3-e132b96111e3</uuid>
Jul 29 13:42:19 user nova-compute[231753]:   <name>instance-00000012</name>
Jul 29 13:42:19 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:42:19 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:42:19 user nova-compute[231753]:   <metadata>
Jul 29 13:42:19 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:42:19 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:42:19 user nova-compute[231753]:       <nova:name>tempest-ServerStableDeviceRescueTest-server-822050220</nova:name>
Jul 29 13:42:19 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:42:17</nova:creationTime>
Jul 29 13:42:19 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:42:19 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:42:19 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:42:19 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:42:19 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:42:19 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:42:19 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:42:19 user nova-compute[231753]:       <nova:owner>
Jul 29 13:42:19 user nova-compute[231753]:         <nova:user uuid="7f8f87b5aaeb4b18b013a85a579ac48b">tempest-ServerStableDeviceRescueTest-1348314180-project-member</nova:user>
Jul 29 13:42:19 user nova-compute[231753]:         <nova:project uuid="12b08b115e89482f9b81e621485c5eb6">tempest-ServerStableDeviceRescueTest-1348314180</nova:project>
Jul 29 13:42:19 user nova-compute[231753]:       </nova:owner>
Jul 29 13:42:19 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:42:19 user nova-compute[231753]:       <nova:ports>
Jul 29 13:42:19 user nova-compute[231753]:         <nova:port uuid="20213688-43ed-4115-bd0d-bc74791d95c4">
Jul 29 13:42:19 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 29 13:42:19 user nova-compute[231753]:         </nova:port>
Jul 29 13:42:19 user nova-compute[231753]:       </nova:ports>
Jul 29 13:42:19 user nova-compute[231753]:     </nova:instance>
Jul 29 13:42:19 user nova-compute[231753]:   </metadata>
Jul 29 13:42:19 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:42:19 user nova-compute[231753]:     <system>
Jul 29 13:42:19 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:42:19 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:42:19 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:42:19 user nova-compute[231753]:       <entry name="serial">55bfcd1f-2b51-4e10-84a3-e132b96111e3</entry>
Jul 29 13:42:19 user nova-compute[231753]:       <entry name="uuid">55bfcd1f-2b51-4e10-84a3-e132b96111e3</entry>
Jul 29 13:42:19 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:42:19 user nova-compute[231753]:     </system>
Jul 29 13:42:19 user nova-compute[231753]:   </sysinfo>
Jul 29 13:42:19 user nova-compute[231753]:   <os>
Jul 29 13:42:19 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:42:19 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:42:19 user nova-compute[231753]:   </os>
Jul 29 13:42:19 user nova-compute[231753]:   <features>
Jul 29 13:42:19 user nova-compute[231753]:     <acpi/>
Jul 29 13:42:19 user nova-compute[231753]:     <apic/>
Jul 29 13:42:19 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:42:19 user nova-compute[231753]:   </features>
Jul 29 13:42:19 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:42:19 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:42:19 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:42:19 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:42:19 user nova-compute[231753]:   </clock>
Jul 29 13:42:19 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:42:19 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:42:19 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:42:19 user nova-compute[231753]:   </cpu>
Jul 29 13:42:19 user nova-compute[231753]:   <devices>
Jul 29 13:42:19 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:42:19 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:42:19 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk"/>
Jul 29 13:42:19 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:42:19 user nova-compute[231753]:     </disk>
Jul 29 13:42:19 user nova-compute[231753]:     <disk type="block" device="disk">
Jul 29 13:42:19 user nova-compute[231753]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:42:19 user nova-compute[231753]:       <source dev="/dev/sde"/>
Jul 29 13:42:19 user nova-compute[231753]:       <target dev="vdb" bus="virtio"/>
Jul 29 13:42:19 user nova-compute[231753]:       <serial>04a22034-ac5e-42aa-a4f1-4f6bcbee85ed</serial>
Jul 29 13:42:19 user nova-compute[231753]:     </disk>
Jul 29 13:42:19 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:42:19 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:42:19 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk.rescue"/>
Jul 29 13:42:19 user nova-compute[231753]:       <target dev="vdc" bus="virtio"/>
Jul 29 13:42:19 user nova-compute[231753]:       <boot order="1"/>
Jul 29 13:42:19 user nova-compute[231753]:     </disk>
Jul 29 13:42:19 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:42:19 user nova-compute[231753]:       <mac address="fa:16:3e:5b:23:7c"/>
Jul 29 13:42:19 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:42:19 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:42:19 user nova-compute[231753]:       <target dev="tap20213688-43"/>
Jul 29 13:42:19 user nova-compute[231753]:     </interface>
Jul 29 13:42:19 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:42:19 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/console.log" append="off"/>
Jul 29 13:42:19 user nova-compute[231753]:     </serial>
Jul 29 13:42:19 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:42:19 user nova-compute[231753]:     <video>
Jul 29 13:42:19 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:42:19 user nova-compute[231753]:     </video>
Jul 29 13:42:19 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:42:19 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:42:19 user nova-compute[231753]:     </rng>
Jul 29 13:42:19 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:42:19 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:42:19 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:42:19 user nova-compute[231753]:     </memballoon>
Jul 29 13:42:19 user nova-compute[231753]:   </devices>
Jul 29 13:42:19 user nova-compute[231753]: </domain>
Jul 29 13:42:19 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:42:19 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Instance destroyed successfully.
Jul 29 13:42:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] No BDM found with device name vdb, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] No BDM found with device name vdc, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:42:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] No VIF found with MAC fa:16:3e:5b:23:7c, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:42:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:22 user nova-compute[231753]: DEBUG nova.compute.manager [req-a5787d56-5c80-42ed-af02-daea29e8392b req-655c5130-51a5-475a-8dbf-99ca7d5a2c5f service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Received event network-vif-plugged-50f751e1-b359-47f5-8e65-19f48fcf1f4a {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:42:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a5787d56-5c80-42ed-af02-daea29e8392b req-655c5130-51a5-475a-8dbf-99ca7d5a2c5f service nova] Acquiring lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a5787d56-5c80-42ed-af02-daea29e8392b req-655c5130-51a5-475a-8dbf-99ca7d5a2c5f service nova] Lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a5787d56-5c80-42ed-af02-daea29e8392b req-655c5130-51a5-475a-8dbf-99ca7d5a2c5f service nova] Lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:22 user nova-compute[231753]: DEBUG nova.compute.manager [req-a5787d56-5c80-42ed-af02-daea29e8392b req-655c5130-51a5-475a-8dbf-99ca7d5a2c5f service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] No waiting events found dispatching network-vif-plugged-50f751e1-b359-47f5-8e65-19f48fcf1f4a {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:42:22 user nova-compute[231753]: WARNING nova.compute.manager [req-a5787d56-5c80-42ed-af02-daea29e8392b req-655c5130-51a5-475a-8dbf-99ca7d5a2c5f service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Received unexpected event network-vif-plugged-50f751e1-b359-47f5-8e65-19f48fcf1f4a for instance with vm_state building and task_state spawning.
Jul 29 13:42:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:22 user nova-compute[231753]: DEBUG nova.compute.manager [req-5c251062-6e8f-44af-a045-08105a5d5d66 req-15ba6475-7593-4b4c-8bc5-e87261b757ee service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Received event network-vif-plugged-20213688-43ed-4115-bd0d-bc74791d95c4 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:42:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5c251062-6e8f-44af-a045-08105a5d5d66 req-15ba6475-7593-4b4c-8bc5-e87261b757ee service nova] Acquiring lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5c251062-6e8f-44af-a045-08105a5d5d66 req-15ba6475-7593-4b4c-8bc5-e87261b757ee service nova] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5c251062-6e8f-44af-a045-08105a5d5d66 req-15ba6475-7593-4b4c-8bc5-e87261b757ee service nova] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:22 user nova-compute[231753]: DEBUG nova.compute.manager [req-5c251062-6e8f-44af-a045-08105a5d5d66 req-15ba6475-7593-4b4c-8bc5-e87261b757ee service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] No waiting events found dispatching network-vif-plugged-20213688-43ed-4115-bd0d-bc74791d95c4 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:42:22 user nova-compute[231753]: WARNING nova.compute.manager [req-5c251062-6e8f-44af-a045-08105a5d5d66 req-15ba6475-7593-4b4c-8bc5-e87261b757ee service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Received unexpected event network-vif-plugged-20213688-43ed-4115-bd0d-bc74791d95c4 for instance with vm_state active and task_state rescuing.
Jul 29 13:42:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:24 user nova-compute[231753]: DEBUG nova.compute.manager [req-ab4c4de4-11eb-4abb-9fa4-895fc8265d11 req-a0f802e2-3053-4290-ae68-7b054ccffe80 service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Received event network-vif-plugged-50f751e1-b359-47f5-8e65-19f48fcf1f4a {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:42:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ab4c4de4-11eb-4abb-9fa4-895fc8265d11 req-a0f802e2-3053-4290-ae68-7b054ccffe80 service nova] Acquiring lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ab4c4de4-11eb-4abb-9fa4-895fc8265d11 req-a0f802e2-3053-4290-ae68-7b054ccffe80 service nova] Lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ab4c4de4-11eb-4abb-9fa4-895fc8265d11 req-a0f802e2-3053-4290-ae68-7b054ccffe80 service nova] Lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:24 user nova-compute[231753]: DEBUG nova.compute.manager [req-ab4c4de4-11eb-4abb-9fa4-895fc8265d11 req-a0f802e2-3053-4290-ae68-7b054ccffe80 service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] No waiting events found dispatching network-vif-plugged-50f751e1-b359-47f5-8e65-19f48fcf1f4a {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:42:24 user nova-compute[231753]: WARNING nova.compute.manager [req-ab4c4de4-11eb-4abb-9fa4-895fc8265d11 req-a0f802e2-3053-4290-ae68-7b054ccffe80 service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Received unexpected event network-vif-plugged-50f751e1-b359-47f5-8e65-19f48fcf1f4a for instance with vm_state building and task_state spawning.
Jul 29 13:42:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:24 user nova-compute[231753]: DEBUG nova.compute.manager [req-84b3169f-e214-49a6-9e76-904f7a2fb98f req-0838f61d-403d-4ba1-9ebd-91980bd244fa service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Received event network-vif-plugged-20213688-43ed-4115-bd0d-bc74791d95c4 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:42:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-84b3169f-e214-49a6-9e76-904f7a2fb98f req-0838f61d-403d-4ba1-9ebd-91980bd244fa service nova] Acquiring lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-84b3169f-e214-49a6-9e76-904f7a2fb98f req-0838f61d-403d-4ba1-9ebd-91980bd244fa service nova] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-84b3169f-e214-49a6-9e76-904f7a2fb98f req-0838f61d-403d-4ba1-9ebd-91980bd244fa service nova] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:24 user nova-compute[231753]: DEBUG nova.compute.manager [req-84b3169f-e214-49a6-9e76-904f7a2fb98f req-0838f61d-403d-4ba1-9ebd-91980bd244fa service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] No waiting events found dispatching network-vif-plugged-20213688-43ed-4115-bd0d-bc74791d95c4 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:42:24 user nova-compute[231753]: WARNING nova.compute.manager [req-84b3169f-e214-49a6-9e76-904f7a2fb98f req-0838f61d-403d-4ba1-9ebd-91980bd244fa service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Received unexpected event network-vif-plugged-20213688-43ed-4115-bd0d-bc74791d95c4 for instance with vm_state active and task_state rescuing.
Jul 29 13:42:24 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638144.7209654, f62c7904-d9d1-4bfc-bef8-9b1c241134f1 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:42:24 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] VM Resumed (Lifecycle Event)
Jul 29 13:42:24 user nova-compute[231753]: DEBUG nova.compute.manager [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:42:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:42:24 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Instance spawned successfully.
Jul 29 13:42:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:42:24 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:42:24 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:42:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:42:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:42:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:42:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:42:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:42:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:42:24 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:42:24 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638144.7211943, f62c7904-d9d1-4bfc-bef8-9b1c241134f1 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:42:24 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] VM Started (Lifecycle Event)
Jul 29 13:42:24 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:42:24 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:42:24 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ab270674-28bd-4027-8e0d-630a22e19e24 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:42:24 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:42:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Removed pending event for 55bfcd1f-2b51-4e10-84a3-e132b96111e3 due to event {{(pid=231753) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 29 13:42:24 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638144.8177702, 55bfcd1f-2b51-4e10-84a3-e132b96111e3 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:42:24 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] VM Resumed (Lifecycle Event)
Jul 29 13:42:24 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:42:24 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:42:24 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 29 13:42:24 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638144.818925, 55bfcd1f-2b51-4e10-84a3-e132b96111e3 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:42:24 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] VM Started (Lifecycle Event)
Jul 29 13:42:24 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:42:24 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:42:24 user nova-compute[231753]: INFO nova.compute.manager [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Took 7.31 seconds to spawn the instance on the hypervisor.
Jul 29 13:42:24 user nova-compute[231753]: DEBUG nova.compute.manager [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:42:25 user nova-compute[231753]: INFO nova.compute.manager [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Took 17.99 seconds to build instance.
Jul 29 13:42:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e48a1bc2-c07f-4cf6-8003-b077f267d8fa tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.097s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:28 user nova-compute[231753]: DEBUG nova.compute.manager [req-21f8e4ef-5924-46be-be86-66f05096f041 req-d91d195a-e053-4c2a-82f6-d568c58f401e service nova] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Received event network-changed-89a6c6db-c40f-428c-8739-3f780154f935 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:42:28 user nova-compute[231753]: DEBUG nova.compute.manager [req-21f8e4ef-5924-46be-be86-66f05096f041 req-d91d195a-e053-4c2a-82f6-d568c58f401e service nova] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Refreshing instance network info cache due to event network-changed-89a6c6db-c40f-428c-8739-3f780154f935. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:42:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-21f8e4ef-5924-46be-be86-66f05096f041 req-d91d195a-e053-4c2a-82f6-d568c58f401e service nova] Acquiring lock "refresh_cache-576f5002-4e4d-4236-8b0f-9b8788246de2" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:42:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-21f8e4ef-5924-46be-be86-66f05096f041 req-d91d195a-e053-4c2a-82f6-d568c58f401e service nova] Acquired lock "refresh_cache-576f5002-4e4d-4236-8b0f-9b8788246de2" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:42:28 user nova-compute[231753]: DEBUG nova.network.neutron [req-21f8e4ef-5924-46be-be86-66f05096f041 req-d91d195a-e053-4c2a-82f6-d568c58f401e service nova] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Refreshing network info cache for port 89a6c6db-c40f-428c-8739-3f780154f935 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:42:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:29 user nova-compute[231753]: DEBUG nova.network.neutron [req-21f8e4ef-5924-46be-be86-66f05096f041 req-d91d195a-e053-4c2a-82f6-d568c58f401e service nova] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Updated VIF entry in instance network info cache for port 89a6c6db-c40f-428c-8739-3f780154f935. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:42:29 user nova-compute[231753]: DEBUG nova.network.neutron [req-21f8e4ef-5924-46be-be86-66f05096f041 req-d91d195a-e053-4c2a-82f6-d568c58f401e service nova] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Updating instance_info_cache with network_info: [{"id": "89a6c6db-c40f-428c-8739-3f780154f935", "address": "fa:16:3e:73:e5:d2", "network": {"id": "c8ebc7da-3ffe-45a0-b7f5-bb85261852ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1496462371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876fbcda354d47c197ce14ca4ed7ead6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a6c6db-c4", "ovs_interfaceid": "89a6c6db-c40f-428c-8739-3f780154f935", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:42:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-21f8e4ef-5924-46be-be86-66f05096f041 req-d91d195a-e053-4c2a-82f6-d568c58f401e service nova] Releasing lock "refresh_cache-576f5002-4e4d-4236-8b0f-9b8788246de2" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:42:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:31 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690638136.314367, b67b98f8-a7b3-499e-ba32-9520bbced960 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:42:31 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] VM Stopped (Lifecycle Event)
Jul 29 13:42:32 user nova-compute[231753]: DEBUG nova.compute.manager [None req-982a3610-3917-4617-9495-faad4c98fbb7 None None] [instance: b67b98f8-a7b3-499e-ba32-9520bbced960] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:42:32 user nova-compute[231753]: DEBUG nova.compute.manager [req-2d40e7a0-b20a-4b62-b914-56e0551682e7 req-e7c7b842-4a66-4661-9045-a1e756d82f19 service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Received event network-changed-7066a691-9911-48c6-a50c-de2e25f08f1d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:42:32 user nova-compute[231753]: DEBUG nova.compute.manager [req-2d40e7a0-b20a-4b62-b914-56e0551682e7 req-e7c7b842-4a66-4661-9045-a1e756d82f19 service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Refreshing instance network info cache due to event network-changed-7066a691-9911-48c6-a50c-de2e25f08f1d. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:42:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-2d40e7a0-b20a-4b62-b914-56e0551682e7 req-e7c7b842-4a66-4661-9045-a1e756d82f19 service nova] Acquiring lock "refresh_cache-16097b06-976f-4fcd-a449-7b1ec8f739d1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:42:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-2d40e7a0-b20a-4b62-b914-56e0551682e7 req-e7c7b842-4a66-4661-9045-a1e756d82f19 service nova] Acquired lock "refresh_cache-16097b06-976f-4fcd-a449-7b1ec8f739d1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:42:32 user nova-compute[231753]: DEBUG nova.network.neutron [req-2d40e7a0-b20a-4b62-b914-56e0551682e7 req-e7c7b842-4a66-4661-9045-a1e756d82f19 service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Refreshing network info cache for port 7066a691-9911-48c6-a50c-de2e25f08f1d {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:42:33 user nova-compute[231753]: DEBUG nova.network.neutron [req-2d40e7a0-b20a-4b62-b914-56e0551682e7 req-e7c7b842-4a66-4661-9045-a1e756d82f19 service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Updated VIF entry in instance network info cache for port 7066a691-9911-48c6-a50c-de2e25f08f1d. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:42:33 user nova-compute[231753]: DEBUG nova.network.neutron [req-2d40e7a0-b20a-4b62-b914-56e0551682e7 req-e7c7b842-4a66-4661-9045-a1e756d82f19 service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Updating instance_info_cache with network_info: [{"id": "7066a691-9911-48c6-a50c-de2e25f08f1d", "address": "fa:16:3e:33:c2:0b", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7066a691-99", "ovs_interfaceid": "7066a691-9911-48c6-a50c-de2e25f08f1d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:42:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-2d40e7a0-b20a-4b62-b914-56e0551682e7 req-e7c7b842-4a66-4661-9045-a1e756d82f19 service nova] Releasing lock "refresh_cache-16097b06-976f-4fcd-a449-7b1ec8f739d1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:42:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5cd9486d-0720-44e0-9244-ac167860a84b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "16097b06-976f-4fcd-a449-7b1ec8f739d1" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5cd9486d-0720-44e0-9244-ac167860a84b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "16097b06-976f-4fcd-a449-7b1ec8f739d1" acquired by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:37 user nova-compute[231753]: INFO nova.compute.manager [None req-5cd9486d-0720-44e0-9244-ac167860a84b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Shelving
Jul 29 13:42:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:37 user nova-compute[231753]: DEBUG nova.compute.manager [req-8f5c3045-c3bd-4063-9dca-122736587f57 req-3dbb558a-d019-4489-99d4-f61edc833311 service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Received event network-vif-unplugged-7066a691-9911-48c6-a50c-de2e25f08f1d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:42:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8f5c3045-c3bd-4063-9dca-122736587f57 req-3dbb558a-d019-4489-99d4-f61edc833311 service nova] Acquiring lock "16097b06-976f-4fcd-a449-7b1ec8f739d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8f5c3045-c3bd-4063-9dca-122736587f57 req-3dbb558a-d019-4489-99d4-f61edc833311 service nova] Lock "16097b06-976f-4fcd-a449-7b1ec8f739d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8f5c3045-c3bd-4063-9dca-122736587f57 req-3dbb558a-d019-4489-99d4-f61edc833311 service nova] Lock "16097b06-976f-4fcd-a449-7b1ec8f739d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:37 user nova-compute[231753]: DEBUG nova.compute.manager [req-8f5c3045-c3bd-4063-9dca-122736587f57 req-3dbb558a-d019-4489-99d4-f61edc833311 service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] No waiting events found dispatching network-vif-unplugged-7066a691-9911-48c6-a50c-de2e25f08f1d {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:42:37 user nova-compute[231753]: WARNING nova.compute.manager [req-8f5c3045-c3bd-4063-9dca-122736587f57 req-3dbb558a-d019-4489-99d4-f61edc833311 service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Received unexpected event network-vif-unplugged-7066a691-9911-48c6-a50c-de2e25f08f1d for instance with vm_state active and task_state shelving.
Jul 29 13:42:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-406e370d-c8cd-4ae8-826c-2814e9a53dbc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Acquiring lock "aa8c3210-37e5-4e33-8ea4-98a70fa9800b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-406e370d-c8cd-4ae8-826c-2814e9a53dbc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "aa8c3210-37e5-4e33-8ea4-98a70fa9800b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:38 user nova-compute[231753]: INFO nova.compute.manager [None req-406e370d-c8cd-4ae8-826c-2814e9a53dbc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Detaching volume 047fcc1e-d73e-40f1-b51c-eb5d5d009aaa
Jul 29 13:42:38 user nova-compute[231753]: INFO nova.virt.block_device [None req-406e370d-c8cd-4ae8-826c-2814e9a53dbc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Attempting to driver detach volume 047fcc1e-d73e-40f1-b51c-eb5d5d009aaa from mountpoint /dev/vdb
Jul 29 13:42:38 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-406e370d-c8cd-4ae8-826c-2814e9a53dbc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Attempting to detach device vdb from instance aa8c3210-37e5-4e33-8ea4-98a70fa9800b from the persistent domain config. {{(pid=231753) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-406e370d-c8cd-4ae8-826c-2814e9a53dbc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:42:38 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:42:38 user nova-compute[231753]:   <source dev="/dev/sdb"/>
Jul 29 13:42:38 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:42:38 user nova-compute[231753]:   <serial>047fcc1e-d73e-40f1-b51c-eb5d5d009aaa</serial>
Jul 29 13:42:38 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 13:42:38 user nova-compute[231753]: </disk>
Jul 29 13:42:38 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:42:38 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-406e370d-c8cd-4ae8-826c-2814e9a53dbc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Successfully detached device vdb from instance aa8c3210-37e5-4e33-8ea4-98a70fa9800b from the persistent domain config.
Jul 29 13:42:38 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-406e370d-c8cd-4ae8-826c-2814e9a53dbc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance aa8c3210-37e5-4e33-8ea4-98a70fa9800b from the live domain config. {{(pid=231753) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-406e370d-c8cd-4ae8-826c-2814e9a53dbc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:42:38 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:42:38 user nova-compute[231753]:   <source dev="/dev/sdb"/>
Jul 29 13:42:38 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:42:38 user nova-compute[231753]:   <serial>047fcc1e-d73e-40f1-b51c-eb5d5d009aaa</serial>
Jul 29 13:42:38 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 13:42:38 user nova-compute[231753]: </disk>
Jul 29 13:42:38 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Acquiring lock "aa8c3210-37e5-4e33-8ea4-98a70fa9800b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Acquiring lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG nova.compute.manager [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:42:38 user nova-compute[231753]: INFO nova.compute.claims [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Claim successful on node user
Jul 29 13:42:38 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Received event <DeviceRemovedEvent: 1690638158.6849885, aa8c3210-37e5-4e33-8ea4-98a70fa9800b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=231753) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-406e370d-c8cd-4ae8-826c-2814e9a53dbc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance aa8c3210-37e5-4e33-8ea4-98a70fa9800b {{(pid=231753) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 13:42:38 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-406e370d-c8cd-4ae8-826c-2814e9a53dbc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Successfully detached device vdb from instance aa8c3210-37e5-4e33-8ea4-98a70fa9800b from the live domain config.
Jul 29 13:42:38 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Instance destroyed successfully.
Jul 29 13:42:38 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-406e370d-c8cd-4ae8-826c-2814e9a53dbc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-406e370d-c8cd-4ae8-826c-2814e9a53dbc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fvxtHElB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:42:38 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-406e370d-c8cd-4ae8-826c-2814e9a53dbc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:42:38 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-406e370d-c8cd-4ae8-826c-2814e9a53dbc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-406e370d-c8cd-4ae8-826c-2814e9a53dbc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c8f7d9-2172-469c-846f-7ef5e228f666]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-406e370d-c8cd-4ae8-826c-2814e9a53dbc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:42:38 user nova-compute[231753]: No targets found.
Jul 29 13:42:38 user nova-compute[231753]: iSNS:
Jul 29 13:42:38 user nova-compute[231753]: No targets found.
Jul 29 13:42:38 user nova-compute[231753]: STATIC:
Jul 29 13:42:38 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea
Jul 29 13:42:38 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:42:38 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:42:38 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0
Jul 29 13:42:38 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:42:38 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:42:38 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed
Jul 29 13:42:38 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:42:38 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:42:38 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa
Jul 29 13:42:38 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:42:38 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:42:38 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef
Jul 29 13:42:38 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:42:38 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:42:38 user nova-compute[231753]: FIRMWARE:
Jul 29 13:42:38 user nova-compute[231753]: No targets found.
Jul 29 13:42:38 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-406e370d-c8cd-4ae8-826c-2814e9a53dbc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:42:38 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:42:38 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-406e370d-c8cd-4ae8-826c-2814e9a53dbc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d5a870-18b7-4c60-878b-315732f03bf7]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:38 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-5cd9486d-0720-44e0-9244-ac167860a84b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Beginning cold snapshot process
Jul 29 13:42:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[98436019-13c3-4e8e-9525-602674fc4bc2]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-406e370d-c8cd-4ae8-826c-2814e9a53dbc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:42:38 user nova-compute[231753]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:42:38 user nova-compute[231753]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa (non-flash)
Jul 29 13:42:38 user nova-compute[231753]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)
Jul 29 13:42:38 user nova-compute[231753]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:42:38 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-406e370d-c8cd-4ae8-826c-2814e9a53dbc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:42:38 user nova-compute[231753]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:42:38 user nova-compute[231753]: tcp: [25] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa (non-flash)
Jul 29 13:42:38 user nova-compute[231753]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)
Jul 29 13:42:38 user nova-compute[231753]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:42:38 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-406e370d-c8cd-4ae8-826c-2814e9a53dbc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c983aee60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa'): ({'sdb'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-406e370d-c8cd-4ae8-826c-2814e9a53dbc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Removing single pathed devices sdb {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[039251d6-dcf5-416d-b15f-c4a2c33831b4]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.030s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d84e0d66-5209-494c-88d7-0b33050dc281]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-406e370d-c8cd-4ae8-826c-2814e9a53dbc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Flushing IO for device /dev/sdb {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f700dd-33ba-4124-94b2-6ee60252afa3]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-406e370d-c8cd-4ae8-826c-2814e9a53dbc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcc0bee-aff2-4175-a476-bb4d9bf0b679]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-406e370d-c8cd-4ae8-826c-2814e9a53dbc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-406e370d-c8cd-4ae8-826c-2814e9a53dbc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] SCSI volumes sdb have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-406e370d-c8cd-4ae8-826c-2814e9a53dbc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d4c0894-bfe0-4d2f-91b5-388133579125]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-406e370d-c8cd-4ae8-826c-2814e9a53dbc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG nova.privsep.utils [None req-5cd9486d-0720-44e0-9244-ac167860a84b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=231753) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-5cd9486d-0720-44e0-9244-ac167860a84b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/disk /opt/stack/data/nova/instances/snapshots/tmpsl4_j6wf/915f27b3f9e0443fb2b4ccfdf81bc620 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa -p 172.16.0.220:3260 --logout" returned: 0 in 0.130s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[060668f6-44d0-4cc2-bbaf-3377b71b0d08]: (4, ('Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa, portal: 172.16.0.220,3260]\nLogout of [sid: 25, target: iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-406e370d-c8cd-4ae8-826c-2814e9a53dbc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa, portal: 172.16.0.220,3260]
Jul 29 13:42:39 user nova-compute[231753]: Logout of [sid: 25, target: iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa, portal: 172.16.0.220,3260] successful.
Jul 29 13:42:39 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[77b1038e-eafa-4c92-8e2e-cd12fac53dd1]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-406e370d-c8cd-4ae8-826c-2814e9a53dbc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-406e370d-c8cd-4ae8-826c-2814e9a53dbc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.455s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-406e370d-c8cd-4ae8-826c-2814e9a53dbc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] <== disconnect_volume: return (456ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-406e370d-c8cd-4ae8-826c-2814e9a53dbc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.801s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG nova.compute.manager [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-5cd9486d-0720-44e0-9244-ac167860a84b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/disk /opt/stack/data/nova/instances/snapshots/tmpsl4_j6wf/915f27b3f9e0443fb2b4ccfdf81bc620" returned: 0 in 0.438s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:39 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-5cd9486d-0720-44e0-9244-ac167860a84b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Snapshot extracted, beginning image upload
Jul 29 13:42:39 user nova-compute[231753]: DEBUG nova.compute.manager [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG nova.network.neutron [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:42:39 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:42:39 user nova-compute[231753]: DEBUG nova.compute.manager [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG nova.policy [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3330125060d64234bce343af655e58e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '876fbcda354d47c197ce14ca4ed7ead6', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:42:39 user nova-compute[231753]: INFO nova.virt.block_device [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Booting with volume ab44b913-5e3b-47fc-bd32-bd84e4d88f93 at /dev/vda
Jul 29 13:42:39 user nova-compute[231753]: DEBUG os_brick.utils [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea572dbc-ee9e-44db-9f64-de146bbc6eb5]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5df3cf6-80bf-40cc-8d2b-390b1a030944]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3279e8-76c9-42df-979c-636c299ad0f3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[48af91a1-e4a6-433a-b743-149fdb2e9430]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:42:39 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:42:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2184fcf-c460-40bd-be08-5101f339ae77]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG os_brick.utils [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] <== get_connector_properties: return (150ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Updating existing volume attachment record: e90c575b-6caf-4005-b93a-35a207e97c41 {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:42:39 user nova-compute[231753]: DEBUG nova.objects.instance [None req-406e370d-c8cd-4ae8-826c-2814e9a53dbc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lazy-loading 'flavor' on Instance uuid aa8c3210-37e5-4e33-8ea4-98a70fa9800b {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG nova.compute.manager [req-dcdaf578-00c5-4586-9612-15886c4aa6a0 req-5474c739-6b98-48a3-a3d4-88f2759bb9e1 service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Received event network-vif-plugged-7066a691-9911-48c6-a50c-de2e25f08f1d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-dcdaf578-00c5-4586-9612-15886c4aa6a0 req-5474c739-6b98-48a3-a3d4-88f2759bb9e1 service nova] Acquiring lock "16097b06-976f-4fcd-a449-7b1ec8f739d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-dcdaf578-00c5-4586-9612-15886c4aa6a0 req-5474c739-6b98-48a3-a3d4-88f2759bb9e1 service nova] Lock "16097b06-976f-4fcd-a449-7b1ec8f739d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-dcdaf578-00c5-4586-9612-15886c4aa6a0 req-5474c739-6b98-48a3-a3d4-88f2759bb9e1 service nova] Lock "16097b06-976f-4fcd-a449-7b1ec8f739d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG nova.compute.manager [req-dcdaf578-00c5-4586-9612-15886c4aa6a0 req-5474c739-6b98-48a3-a3d4-88f2759bb9e1 service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] No waiting events found dispatching network-vif-plugged-7066a691-9911-48c6-a50c-de2e25f08f1d {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:42:40 user nova-compute[231753]: WARNING nova.compute.manager [req-dcdaf578-00c5-4586-9612-15886c4aa6a0 req-5474c739-6b98-48a3-a3d4-88f2759bb9e1 service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Received unexpected event network-vif-plugged-7066a691-9911-48c6-a50c-de2e25f08f1d for instance with vm_state active and task_state shelving_image_uploading.
Jul 29 13:42:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-406e370d-c8cd-4ae8-826c-2814e9a53dbc tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "aa8c3210-37e5-4e33-8ea4-98a70fa9800b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.021s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "aa8c3210-37e5-4e33-8ea4-98a70fa9800b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 1.849s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Acquiring lock "aa8c3210-37e5-4e33-8ea4-98a70fa9800b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "aa8c3210-37e5-4e33-8ea4-98a70fa9800b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "aa8c3210-37e5-4e33-8ea4-98a70fa9800b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:40 user nova-compute[231753]: INFO nova.compute.manager [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Terminating instance
Jul 29 13:42:40 user nova-compute[231753]: DEBUG nova.compute.manager [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG nova.compute.manager [req-f5fc3e34-5802-4d44-b8d8-eae9beeacbe2 req-c5980f6d-2839-4d02-881e-35876792cfa1 service nova] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Received event network-vif-unplugged-980d6903-8cea-4a60-bd44-e8a7343d991f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-f5fc3e34-5802-4d44-b8d8-eae9beeacbe2 req-c5980f6d-2839-4d02-881e-35876792cfa1 service nova] Acquiring lock "aa8c3210-37e5-4e33-8ea4-98a70fa9800b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-f5fc3e34-5802-4d44-b8d8-eae9beeacbe2 req-c5980f6d-2839-4d02-881e-35876792cfa1 service nova] Lock "aa8c3210-37e5-4e33-8ea4-98a70fa9800b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-f5fc3e34-5802-4d44-b8d8-eae9beeacbe2 req-c5980f6d-2839-4d02-881e-35876792cfa1 service nova] Lock "aa8c3210-37e5-4e33-8ea4-98a70fa9800b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG nova.compute.manager [req-f5fc3e34-5802-4d44-b8d8-eae9beeacbe2 req-c5980f6d-2839-4d02-881e-35876792cfa1 service nova] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] No waiting events found dispatching network-vif-unplugged-980d6903-8cea-4a60-bd44-e8a7343d991f {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG nova.compute.manager [req-f5fc3e34-5802-4d44-b8d8-eae9beeacbe2 req-c5980f6d-2839-4d02-881e-35876792cfa1 service nova] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Received event network-vif-unplugged-980d6903-8cea-4a60-bd44-e8a7343d991f for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG nova.network.neutron [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Successfully created port: 78884930-2bc7-430e-b250-851ff726d5f8 {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:42:40 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Instance destroyed successfully.
Jul 29 13:42:40 user nova-compute[231753]: DEBUG nova.objects.instance [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lazy-loading 'resources' on Instance uuid aa8c3210-37e5-4e33-8ea4-98a70fa9800b {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:40:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesSnapshotTestJSON-instance-1060977057',display_name='tempest-VolumesSnapshotTestJSON-instance-1060977057',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumessnapshottestjson-instance-1060977057',id=20,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBK72fRD2cqAPSvA5XiNDr1lxjVQKMvhlOvHhfISOLK83tuEudjB4A/hWe/vBqZXOvLTBkh3iGnIhJSWaaSCuYKvHYaAInH4YbOXjMaDe/evl7Bi6Fp3oKm5Pw/2TRBlYlw==',key_name='tempest-keypair-1719847082',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:40:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='cdd0f16e49ef48ff99752b6aec718358',ramdisk_id='',reservation_id='r-anwqckf9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesSnapshotTestJSON-563591119',owner_user_name='tempest-VolumesSnapshotTestJSON-563591119-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:40:16Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a2c57d05306648e786200a93a121966e',uuid=aa8c3210-37e5-4e33-8ea4-98a70fa9800b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "980d6903-8cea-4a60-bd44-e8a7343d991f", "address": "fa:16:3e:e7:5e:eb", "network": {"id": "7f0a516e-a6d1-4198-b7f7-d1eef96625cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-408682612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd0f16e49ef48ff99752b6aec718358", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap980d6903-8c", "ovs_interfaceid": "980d6903-8cea-4a60-bd44-e8a7343d991f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Converting VIF {"id": "980d6903-8cea-4a60-bd44-e8a7343d991f", "address": "fa:16:3e:e7:5e:eb", "network": {"id": "7f0a516e-a6d1-4198-b7f7-d1eef96625cd", "bridge": "br-int", "label": "tempest-VolumesSnapshotTestJSON-408682612-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.240", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "cdd0f16e49ef48ff99752b6aec718358", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap980d6903-8c", "ovs_interfaceid": "980d6903-8cea-4a60-bd44-e8a7343d991f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:e7:5e:eb,bridge_name='br-int',has_traffic_filtering=True,id=980d6903-8cea-4a60-bd44-e8a7343d991f,network=Network(7f0a516e-a6d1-4198-b7f7-d1eef96625cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap980d6903-8c') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG os_vif [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:5e:eb,bridge_name='br-int',has_traffic_filtering=True,id=980d6903-8cea-4a60-bd44-e8a7343d991f,network=Network(7f0a516e-a6d1-4198-b7f7-d1eef96625cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap980d6903-8c') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap980d6903-8c, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:40 user nova-compute[231753]: INFO os_vif [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:e7:5e:eb,bridge_name='br-int',has_traffic_filtering=True,id=980d6903-8cea-4a60-bd44-e8a7343d991f,network=Network(7f0a516e-a6d1-4198-b7f7-d1eef96625cd),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap980d6903-8c')
Jul 29 13:42:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'fvxtHElB', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:42:40 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:42:40 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7636aac6-a773-4bef-99b2-7c903fadb0c2]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:42:40 user nova-compute[231753]: No targets found.
Jul 29 13:42:40 user nova-compute[231753]: iSNS:
Jul 29 13:42:40 user nova-compute[231753]: No targets found.
Jul 29 13:42:40 user nova-compute[231753]: STATIC:
Jul 29 13:42:40 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea
Jul 29 13:42:40 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:42:40 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:42:40 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0
Jul 29 13:42:40 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:42:40 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:42:40 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed
Jul 29 13:42:40 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:42:40 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:42:40 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef
Jul 29 13:42:40 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:42:40 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:42:40 user nova-compute[231753]: FIRMWARE:
Jul 29 13:42:40 user nova-compute[231753]: No targets found.
Jul 29 13:42:40 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:42:40 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:42:40 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:047fcc1e-d73e-40f1-b51c-eb5d5d009aaa', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:42:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:41 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:41 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5af9b896-f4cb-4fe0-8a01-3c63199adcf8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:41 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:41 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:41 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f6413a2-d741-45f9-b5b1-d277049291e2]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:41 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:42:41 user nova-compute[231753]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:42:41 user nova-compute[231753]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)
Jul 29 13:42:41 user nova-compute[231753]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:42:41 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:42:41 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:42:41 user nova-compute[231753]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:42:41 user nova-compute[231753]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)
Jul 29 13:42:41 user nova-compute[231753]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:42:41 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:42:41 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c9828cee0>, {}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:42:41 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Disconnecting from: [] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:42:41 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.085s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:42:41 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] <== disconnect_volume: return (86ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:42:41 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:42:41 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Deleting instance files /opt/stack/data/nova/instances/aa8c3210-37e5-4e33-8ea4-98a70fa9800b_del
Jul 29 13:42:41 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Deletion of /opt/stack/data/nova/instances/aa8c3210-37e5-4e33-8ea4-98a70fa9800b_del complete
Jul 29 13:42:41 user nova-compute[231753]: INFO nova.compute.manager [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Took 1.05 seconds to destroy the instance on the hypervisor.
Jul 29 13:42:41 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:42:41 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:42:41 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:42:41 user nova-compute[231753]: DEBUG nova.network.neutron [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Successfully updated port: 78884930-2bc7-430e-b250-851ff726d5f8 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:42:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Acquiring lock "refresh_cache-37fbc873-537c-4bbc-a57b-2c44e47ecf30" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:42:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Acquired lock "refresh_cache-37fbc873-537c-4bbc-a57b-2c44e47ecf30" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:42:41 user nova-compute[231753]: DEBUG nova.network.neutron [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:42:41 user nova-compute[231753]: DEBUG nova.network.neutron [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:42:41 user nova-compute[231753]: DEBUG nova.network.neutron [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Updating instance_info_cache with network_info: [{"id": "78884930-2bc7-430e-b250-851ff726d5f8", "address": "fa:16:3e:0e:5d:f8", "network": {"id": "c8ebc7da-3ffe-45a0-b7f5-bb85261852ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1496462371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876fbcda354d47c197ce14ca4ed7ead6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78884930-2b", "ovs_interfaceid": "78884930-2bc7-430e-b250-851ff726d5f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:42:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Releasing lock "refresh_cache-37fbc873-537c-4bbc-a57b-2c44e47ecf30" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:42:41 user nova-compute[231753]: DEBUG nova.compute.manager [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Instance network_info: |[{"id": "78884930-2bc7-430e-b250-851ff726d5f8", "address": "fa:16:3e:0e:5d:f8", "network": {"id": "c8ebc7da-3ffe-45a0-b7f5-bb85261852ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1496462371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876fbcda354d47c197ce14ca4ed7ead6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78884930-2b", "ovs_interfaceid": "78884930-2bc7-430e-b250-851ff726d5f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:42:42 user nova-compute[231753]: DEBUG nova.compute.manager [req-61b5bdb1-353d-4071-a284-386dc8a8143e req-9504ec3d-df24-4d4b-94e1-6c21a8d5e45b service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Received event network-changed-78884930-2bc7-430e-b250-851ff726d5f8 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:42:42 user nova-compute[231753]: DEBUG nova.compute.manager [req-61b5bdb1-353d-4071-a284-386dc8a8143e req-9504ec3d-df24-4d4b-94e1-6c21a8d5e45b service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Refreshing instance network info cache due to event network-changed-78884930-2bc7-430e-b250-851ff726d5f8. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:42:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-61b5bdb1-353d-4071-a284-386dc8a8143e req-9504ec3d-df24-4d4b-94e1-6c21a8d5e45b service nova] Acquiring lock "refresh_cache-37fbc873-537c-4bbc-a57b-2c44e47ecf30" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:42:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-61b5bdb1-353d-4071-a284-386dc8a8143e req-9504ec3d-df24-4d4b-94e1-6c21a8d5e45b service nova] Acquired lock "refresh_cache-37fbc873-537c-4bbc-a57b-2c44e47ecf30" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:42:42 user nova-compute[231753]: DEBUG nova.network.neutron [req-61b5bdb1-353d-4071-a284-386dc8a8143e req-9504ec3d-df24-4d4b-94e1-6c21a8d5e45b service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Refreshing network info cache for port 78884930-2bc7-430e-b250-851ff726d5f8 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:42:42 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:42:42 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Took 1.03 seconds to deallocate network for instance.
Jul 29 13:42:42 user nova-compute[231753]: DEBUG nova.compute.manager [req-2a175d8b-15d5-47a1-859c-26422c6667a3 req-b79ee8c5-ef6e-4cc6-a224-747085692911 service nova] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Received event network-vif-deleted-980d6903-8cea-4a60-bd44-e8a7343d991f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:42:42 user nova-compute[231753]: WARNING nova.volume.cinder [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Attachment 40619e47-615d-4a8f-b26d-db76d1812ed6 does not exist. Ignoring.: cinderclient.exceptions.NotFound: Volume attachment could not be found with filter: attachment_id = 40619e47-615d-4a8f-b26d-db76d1812ed6. (HTTP 404) (Request-ID: req-e690a50b-3595-43ae-b5b5-9429bb21325e)
Jul 29 13:42:42 user nova-compute[231753]: INFO nova.compute.manager [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Took 0.03 seconds to detach 1 volumes for instance.
Jul 29 13:42:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:42 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-5cd9486d-0720-44e0-9244-ac167860a84b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Snapshot image upload complete
Jul 29 13:42:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-5cd9486d-0720-44e0-9244-ac167860a84b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:42:42 user nova-compute[231753]: DEBUG nova.compute.manager [req-b652a9e7-f89a-4e2b-bc25-3d2db503ab6c req-87188c0d-cdcc-4a90-9dc6-ed6c61efe4bd service nova] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Received event network-vif-plugged-980d6903-8cea-4a60-bd44-e8a7343d991f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:42:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b652a9e7-f89a-4e2b-bc25-3d2db503ab6c req-87188c0d-cdcc-4a90-9dc6-ed6c61efe4bd service nova] Acquiring lock "aa8c3210-37e5-4e33-8ea4-98a70fa9800b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b652a9e7-f89a-4e2b-bc25-3d2db503ab6c req-87188c0d-cdcc-4a90-9dc6-ed6c61efe4bd service nova] Lock "aa8c3210-37e5-4e33-8ea4-98a70fa9800b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b652a9e7-f89a-4e2b-bc25-3d2db503ab6c req-87188c0d-cdcc-4a90-9dc6-ed6c61efe4bd service nova] Lock "aa8c3210-37e5-4e33-8ea4-98a70fa9800b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:42 user nova-compute[231753]: DEBUG nova.compute.manager [req-b652a9e7-f89a-4e2b-bc25-3d2db503ab6c req-87188c0d-cdcc-4a90-9dc6-ed6c61efe4bd service nova] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] No waiting events found dispatching network-vif-plugged-980d6903-8cea-4a60-bd44-e8a7343d991f {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:42:42 user nova-compute[231753]: WARNING nova.compute.manager [req-b652a9e7-f89a-4e2b-bc25-3d2db503ab6c req-87188c0d-cdcc-4a90-9dc6-ed6c61efe4bd service nova] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Received unexpected event network-vif-plugged-980d6903-8cea-4a60-bd44-e8a7343d991f for instance with vm_state deleted and task_state None.
Jul 29 13:42:42 user nova-compute[231753]: INFO nova.compute.manager [None req-5cd9486d-0720-44e0-9244-ac167860a84b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Shelve offloading
Jul 29 13:42:42 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Instance destroyed successfully.
Jul 29 13:42:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-5cd9486d-0720-44e0-9244-ac167860a84b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:42:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5cd9486d-0720-44e0-9244-ac167860a84b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "refresh_cache-16097b06-976f-4fcd-a449-7b1ec8f739d1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:42:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5cd9486d-0720-44e0-9244-ac167860a84b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquired lock "refresh_cache-16097b06-976f-4fcd-a449-7b1ec8f739d1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:42:42 user nova-compute[231753]: DEBUG nova.network.neutron [None req-5cd9486d-0720-44e0-9244-ac167860a84b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:42:42 user nova-compute[231753]: DEBUG nova.network.neutron [req-61b5bdb1-353d-4071-a284-386dc8a8143e req-9504ec3d-df24-4d4b-94e1-6c21a8d5e45b service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Updated VIF entry in instance network info cache for port 78884930-2bc7-430e-b250-851ff726d5f8. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:42:42 user nova-compute[231753]: DEBUG nova.network.neutron [req-61b5bdb1-353d-4071-a284-386dc8a8143e req-9504ec3d-df24-4d4b-94e1-6c21a8d5e45b service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Updating instance_info_cache with network_info: [{"id": "78884930-2bc7-430e-b250-851ff726d5f8", "address": "fa:16:3e:0e:5d:f8", "network": {"id": "c8ebc7da-3ffe-45a0-b7f5-bb85261852ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1496462371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876fbcda354d47c197ce14ca4ed7ead6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78884930-2b", "ovs_interfaceid": "78884930-2bc7-430e-b250-851ff726d5f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:42:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-61b5bdb1-353d-4071-a284-386dc8a8143e req-9504ec3d-df24-4d4b-94e1-6c21a8d5e45b service nova] Releasing lock "refresh_cache-37fbc873-537c-4bbc-a57b-2c44e47ecf30" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:42:42 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:42:42 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:42:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.593s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:42 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Deleted allocations for instance aa8c3210-37e5-4e33-8ea4-98a70fa9800b
Jul 29 13:42:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6ceb2747-8eee-4326-a9a4-1652382852ee tempest-VolumesSnapshotTestJSON-563591119 tempest-VolumesSnapshotTestJSON-563591119-project-member] Lock "aa8c3210-37e5-4e33-8ea4-98a70fa9800b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.939s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:43 user nova-compute[231753]: DEBUG nova.network.neutron [None req-5cd9486d-0720-44e0-9244-ac167860a84b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Updating instance_info_cache with network_info: [{"id": "7066a691-9911-48c6-a50c-de2e25f08f1d", "address": "fa:16:3e:33:c2:0b", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7066a691-99", "ovs_interfaceid": "7066a691-9911-48c6-a50c-de2e25f08f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:42:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5cd9486d-0720-44e0-9244-ac167860a84b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Releasing lock "refresh_cache-16097b06-976f-4fcd-a449-7b1ec8f739d1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:42:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:43 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Instance destroyed successfully.
Jul 29 13:42:43 user nova-compute[231753]: DEBUG nova.objects.instance [None req-5cd9486d-0720-44e0-9244-ac167860a84b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lazy-loading 'resources' on Instance uuid 16097b06-976f-4fcd-a449-7b1ec8f739d1 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:42:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-5cd9486d-0720-44e0-9244-ac167860a84b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:40:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1785686519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1785686519',id=22,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIltVyANnBLQo5ZkaO2rhyJWlvJIw2quOPh0zhPSCEV5HqmmGHMXccTyUpnsRkyvdMtse0ovY8hkA/H4UxPyXE0wALQj07YRnF9pVYigWhQcgRInlw5MXYbG0KJZyckXbw==',key_name='tempest-keypair-1407725312',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:40:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='d53ebbb5f2e440dfa0cf3950232b4853',ramdisk_id='',reservation_id='r-u7dl5zqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-460717858',owner_user_name='tempest-AttachVolumeShelveTestJSON-460717858-project-member',shelved_at='2023-07-29T13:42:42.425459',shelved_host='user',shelved_image_id='86c962bf-36a6-4f61-873a-c2c030b9350f'},tags=<?>,task_state='shelving_offloading',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:42:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='932b5bd757f94be29d52035fd9f70293',uuid=16097b06-976f-4fcd-a449-7b1ec8f739d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "7066a691-9911-48c6-a50c-de2e25f08f1d", "address": "fa:16:3e:33:c2:0b", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7066a691-99", "ovs_interfaceid": "7066a691-9911-48c6-a50c-de2e25f08f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:42:43 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-5cd9486d-0720-44e0-9244-ac167860a84b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Converting VIF {"id": "7066a691-9911-48c6-a50c-de2e25f08f1d", "address": "fa:16:3e:33:c2:0b", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7066a691-99", "ovs_interfaceid": "7066a691-9911-48c6-a50c-de2e25f08f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:42:43 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-5cd9486d-0720-44e0-9244-ac167860a84b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:c2:0b,bridge_name='br-int',has_traffic_filtering=True,id=7066a691-9911-48c6-a50c-de2e25f08f1d,network=Network(9be19067-cc29-4c67-95a0-cf37f95f9fc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7066a691-99') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:42:43 user nova-compute[231753]: DEBUG os_vif [None req-5cd9486d-0720-44e0-9244-ac167860a84b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:c2:0b,bridge_name='br-int',has_traffic_filtering=True,id=7066a691-9911-48c6-a50c-de2e25f08f1d,network=Network(9be19067-cc29-4c67-95a0-cf37f95f9fc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7066a691-99') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:42:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7066a691-99, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:42:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:42:43 user nova-compute[231753]: INFO os_vif [None req-5cd9486d-0720-44e0-9244-ac167860a84b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:c2:0b,bridge_name='br-int',has_traffic_filtering=True,id=7066a691-9911-48c6-a50c-de2e25f08f1d,network=Network(9be19067-cc29-4c67-95a0-cf37f95f9fc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7066a691-99')
Jul 29 13:42:43 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-5cd9486d-0720-44e0-9244-ac167860a84b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Deleting instance files /opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1_del
Jul 29 13:42:43 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-5cd9486d-0720-44e0-9244-ac167860a84b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Deletion of /opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1_del complete
Jul 29 13:42:43 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-5cd9486d-0720-44e0-9244-ac167860a84b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Deleted allocations for instance 16097b06-976f-4fcd-a449-7b1ec8f739d1
Jul 29 13:42:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5cd9486d-0720-44e0-9244-ac167860a84b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5cd9486d-0720-44e0-9244-ac167860a84b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:44 user nova-compute[231753]: DEBUG nova.objects.instance [None req-5cd9486d-0720-44e0-9244-ac167860a84b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lazy-loading 'numa_topology' on Instance uuid 16097b06-976f-4fcd-a449-7b1ec8f739d1 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:42:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-eea75771-4bd2-471e-ae7f-77f1e636494a req-747c7a5c-1711-4669-99a2-eca1bba8b75c service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Received event network-changed-7066a691-9911-48c6-a50c-de2e25f08f1d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:42:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-eea75771-4bd2-471e-ae7f-77f1e636494a req-747c7a5c-1711-4669-99a2-eca1bba8b75c service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Refreshing instance network info cache due to event network-changed-7066a691-9911-48c6-a50c-de2e25f08f1d. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:42:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-eea75771-4bd2-471e-ae7f-77f1e636494a req-747c7a5c-1711-4669-99a2-eca1bba8b75c service nova] Acquiring lock "refresh_cache-16097b06-976f-4fcd-a449-7b1ec8f739d1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:42:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-eea75771-4bd2-471e-ae7f-77f1e636494a req-747c7a5c-1711-4669-99a2-eca1bba8b75c service nova] Acquired lock "refresh_cache-16097b06-976f-4fcd-a449-7b1ec8f739d1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:42:44 user nova-compute[231753]: DEBUG nova.network.neutron [req-eea75771-4bd2-471e-ae7f-77f1e636494a req-747c7a5c-1711-4669-99a2-eca1bba8b75c service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Refreshing network info cache for port 7066a691-9911-48c6-a50c-de2e25f08f1d {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:42:44 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-5cd9486d-0720-44e0-9244-ac167860a84b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:42:44 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-5cd9486d-0720-44e0-9244-ac167860a84b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:42:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5cd9486d-0720-44e0-9244-ac167860a84b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.461s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5cd9486d-0720-44e0-9244-ac167860a84b tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "16097b06-976f-4fcd-a449-7b1ec8f739d1" "released" by "nova.compute.manager.ComputeManager.shelve_instance.<locals>.do_shelve_instance" :: held 6.986s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:44 user nova-compute[231753]: DEBUG nova.network.neutron [req-eea75771-4bd2-471e-ae7f-77f1e636494a req-747c7a5c-1711-4669-99a2-eca1bba8b75c service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Updated VIF entry in instance network info cache for port 7066a691-9911-48c6-a50c-de2e25f08f1d. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:42:44 user nova-compute[231753]: DEBUG nova.network.neutron [req-eea75771-4bd2-471e-ae7f-77f1e636494a req-747c7a5c-1711-4669-99a2-eca1bba8b75c service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Updating instance_info_cache with network_info: [{"id": "7066a691-9911-48c6-a50c-de2e25f08f1d", "address": "fa:16:3e:33:c2:0b", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap7066a691-99", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:42:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-eea75771-4bd2-471e-ae7f-77f1e636494a req-747c7a5c-1711-4669-99a2-eca1bba8b75c service nova] Releasing lock "refresh_cache-16097b06-976f-4fcd-a449-7b1ec8f739d1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG nova.compute.manager [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:42:48 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Creating image(s)
Jul 29 13:42:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Did not create local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Ensure instance console log exists: /opt/stack/data/nova/instances/37fbc873-537c-4bbc-a57b-2c44e47ecf30/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Start _get_guest_xml network_info=[{"id": "78884930-2bc7-430e-b250-851ff726d5f8", "address": "fa:16:3e:0e:5d:f8", "network": {"id": "c8ebc7da-3ffe-45a0-b7f5-bb85261852ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1496462371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876fbcda354d47c197ce14ca4ed7ead6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78884930-2b", "ovs_interfaceid": "78884930-2bc7-430e-b250-851ff726d5f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ogpdWmcA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '37fbc873-537c-4bbc-a57b-2c44e47ecf30', 'attached_at': '', 'detached_at': '', 'volume_id': 'ab44b913-5e3b-47fc-bd32-bd84e4d88f93', 'serial': 'ab44b913-5e3b-47fc-bd32-bd84e4d88f93'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'attachment_id': 'e90c575b-6caf-4005-b93a-35a207e97c41', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:42:48 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:42:48 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:42:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ogpdWmcA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:42:48 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:42:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:42:48 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:42:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:42:48 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:42:48 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bb89092-7a27-45cc-a656-63239d3ebd9a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:42:48 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b7652f-550e-426c-bbfd-4c1805f172d8]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93] added
Jul 29 13:42:48 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.117s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b9a904f-1e3c-4dc9-8417-1410dd6886b8]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.032s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[63eca0cd-8a13-4571-b0c6-701f399bb11e]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ogpdWmcA {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ogpdWmcA" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d509993-07c9-447b-8629-646d086ce363]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ogpdWmcA'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f43f28f-d297-45d5-b313-71f86f814ca8]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c9667f-3862-4759-a0f2-b1b28ceaeb52]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:42:48 user nova-compute[231753]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:42:48 user nova-compute[231753]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)
Jul 29 13:42:48 user nova-compute[231753]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:42:48 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:42:48 user nova-compute[231753]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:42:48 user nova-compute[231753]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)
Jul 29 13:42:48 user nova-compute[231753]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:42:48 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[44866c33-b643-44b4-92af-d23714aedf01]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93, portal: 172.16.0.220,3260]
Jul 29 13:42:48 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93, portal: 172.16.0.220,3260] successful.
Jul 29 13:42:48 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[1309b64a-9a77-4855-868b-eb7824bfb3f6]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ffd5b2c-db6a-42da-a49b-1c4fe2048e21]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:42:48 user nova-compute[231753]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:42:48 user nova-compute[231753]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)
Jul 29 13:42:48 user nova-compute[231753]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:42:48 user nova-compute[231753]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)
Jul 29 13:42:48 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:42:48 user nova-compute[231753]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:42:48 user nova-compute[231753]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)
Jul 29 13:42:48 user nova-compute[231753]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:42:48 user nova-compute[231753]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)
Jul 29 13:42:48 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.426s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] HCTL ('33', '-', '-', 0) found on session 28 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a28a7364-8227-43e4-ad67-ae32d2e8adb3]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Searching for a device in session 28 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ogpdWmcA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:42:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:49 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.479s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:42:49 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] <== connect_volume: return (1481ms) {'type': 'block', 'scsi_wwn': '23063303462343935', 'path': '/dev/sdb'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:42:49 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063303462343935', 'path': '/dev/sdb'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:42:49 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:42:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1951457883',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1951457883',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDc03FdfB1WkJMQ+OFlTQGDyqI+vnX8r38QSC1X3+I46SKYhhpq2ELYDYwCr+yT2E/7oa4VZ/8HKFoV3Qq+q1XdXsiLTiNzAVeDrjcozJkO0FAkqdQDw0IZWfQrN8WwQag==',key_name='tempest-keypair-386440795',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='876fbcda354d47c197ce14ca4ed7ead6',ramdisk_id='',reservation_id='r-8m5l27cs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1385583979',owner_user_name='tempest-ServerActionsV293TestJSON-1385583979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:42:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3330125060d64234bce343af655e58e3',uuid=37fbc873-537c-4bbc-a57b-2c44e47ecf30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78884930-2bc7-430e-b250-851ff726d5f8", "address": "fa:16:3e:0e:5d:f8", "network": {"id": "c8ebc7da-3ffe-45a0-b7f5-bb85261852ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1496462371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876fbcda354d47c197ce14ca4ed7ead6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78884930-2b", "ovs_interfaceid": "78884930-2bc7-430e-b250-851ff726d5f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:42:49 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Converting VIF {"id": "78884930-2bc7-430e-b250-851ff726d5f8", "address": "fa:16:3e:0e:5d:f8", "network": {"id": "c8ebc7da-3ffe-45a0-b7f5-bb85261852ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1496462371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876fbcda354d47c197ce14ca4ed7ead6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78884930-2b", "ovs_interfaceid": "78884930-2bc7-430e-b250-851ff726d5f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:42:49 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:5d:f8,bridge_name='br-int',has_traffic_filtering=True,id=78884930-2bc7-430e-b250-851ff726d5f8,network=Network(c8ebc7da-3ffe-45a0-b7f5-bb85261852ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78884930-2b') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:42:49 user nova-compute[231753]: DEBUG nova.objects.instance [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lazy-loading 'pci_devices' on Instance uuid 37fbc873-537c-4bbc-a57b-2c44e47ecf30 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:42:49 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:42:49 user nova-compute[231753]:   <uuid>37fbc873-537c-4bbc-a57b-2c44e47ecf30</uuid>
Jul 29 13:42:49 user nova-compute[231753]:   <name>instance-0000001b</name>
Jul 29 13:42:49 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:42:49 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:42:49 user nova-compute[231753]:   <metadata>
Jul 29 13:42:49 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:42:49 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:42:49 user nova-compute[231753]:       <nova:name>tempest-ServerActionsV293TestJSON-server-1951457883</nova:name>
Jul 29 13:42:49 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:42:48</nova:creationTime>
Jul 29 13:42:49 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:42:49 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:42:49 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:42:49 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:42:49 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:42:49 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:42:49 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:42:49 user nova-compute[231753]:       <nova:owner>
Jul 29 13:42:49 user nova-compute[231753]:         <nova:user uuid="3330125060d64234bce343af655e58e3">tempest-ServerActionsV293TestJSON-1385583979-project-member</nova:user>
Jul 29 13:42:49 user nova-compute[231753]:         <nova:project uuid="876fbcda354d47c197ce14ca4ed7ead6">tempest-ServerActionsV293TestJSON-1385583979</nova:project>
Jul 29 13:42:49 user nova-compute[231753]:       </nova:owner>
Jul 29 13:42:49 user nova-compute[231753]:       <nova:ports>
Jul 29 13:42:49 user nova-compute[231753]:         <nova:port uuid="78884930-2bc7-430e-b250-851ff726d5f8">
Jul 29 13:42:49 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 29 13:42:49 user nova-compute[231753]:         </nova:port>
Jul 29 13:42:49 user nova-compute[231753]:       </nova:ports>
Jul 29 13:42:49 user nova-compute[231753]:     </nova:instance>
Jul 29 13:42:49 user nova-compute[231753]:   </metadata>
Jul 29 13:42:49 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:42:49 user nova-compute[231753]:     <system>
Jul 29 13:42:49 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:42:49 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:42:49 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:42:49 user nova-compute[231753]:       <entry name="serial">37fbc873-537c-4bbc-a57b-2c44e47ecf30</entry>
Jul 29 13:42:49 user nova-compute[231753]:       <entry name="uuid">37fbc873-537c-4bbc-a57b-2c44e47ecf30</entry>
Jul 29 13:42:49 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:42:49 user nova-compute[231753]:     </system>
Jul 29 13:42:49 user nova-compute[231753]:   </sysinfo>
Jul 29 13:42:49 user nova-compute[231753]:   <os>
Jul 29 13:42:49 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:42:49 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:42:49 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:42:49 user nova-compute[231753]:   </os>
Jul 29 13:42:49 user nova-compute[231753]:   <features>
Jul 29 13:42:49 user nova-compute[231753]:     <acpi/>
Jul 29 13:42:49 user nova-compute[231753]:     <apic/>
Jul 29 13:42:49 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:42:49 user nova-compute[231753]:   </features>
Jul 29 13:42:49 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:42:49 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:42:49 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:42:49 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:42:49 user nova-compute[231753]:   </clock>
Jul 29 13:42:49 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:42:49 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:42:49 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:42:49 user nova-compute[231753]:   </cpu>
Jul 29 13:42:49 user nova-compute[231753]:   <devices>
Jul 29 13:42:49 user nova-compute[231753]:     <disk type="block" device="disk">
Jul 29 13:42:49 user nova-compute[231753]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:42:49 user nova-compute[231753]:       <source dev="/dev/sdb"/>
Jul 29 13:42:49 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:42:49 user nova-compute[231753]:       <serial>ab44b913-5e3b-47fc-bd32-bd84e4d88f93</serial>
Jul 29 13:42:49 user nova-compute[231753]:     </disk>
Jul 29 13:42:49 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:42:49 user nova-compute[231753]:       <mac address="fa:16:3e:0e:5d:f8"/>
Jul 29 13:42:49 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:42:49 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:42:49 user nova-compute[231753]:       <target dev="tap78884930-2b"/>
Jul 29 13:42:49 user nova-compute[231753]:     </interface>
Jul 29 13:42:49 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:42:49 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/37fbc873-537c-4bbc-a57b-2c44e47ecf30/console.log" append="off"/>
Jul 29 13:42:49 user nova-compute[231753]:     </serial>
Jul 29 13:42:49 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:42:49 user nova-compute[231753]:     <video>
Jul 29 13:42:49 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:42:49 user nova-compute[231753]:     </video>
Jul 29 13:42:49 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:42:49 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:42:49 user nova-compute[231753]:     </rng>
Jul 29 13:42:49 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:42:49 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:42:49 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:42:49 user nova-compute[231753]:     </memballoon>
Jul 29 13:42:49 user nova-compute[231753]:   </devices>
Jul 29 13:42:49 user nova-compute[231753]: </domain>
Jul 29 13:42:49 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:42:49 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:42:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1951457883',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1951457883',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDc03FdfB1WkJMQ+OFlTQGDyqI+vnX8r38QSC1X3+I46SKYhhpq2ELYDYwCr+yT2E/7oa4VZ/8HKFoV3Qq+q1XdXsiLTiNzAVeDrjcozJkO0FAkqdQDw0IZWfQrN8WwQag==',key_name='tempest-keypair-386440795',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='876fbcda354d47c197ce14ca4ed7ead6',ramdisk_id='',reservation_id='r-8m5l27cs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1385583979',owner_user_name='tempest-ServerActionsV293TestJSON-1385583979-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:42:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3330125060d64234bce343af655e58e3',uuid=37fbc873-537c-4bbc-a57b-2c44e47ecf30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "78884930-2bc7-430e-b250-851ff726d5f8", "address": "fa:16:3e:0e:5d:f8", "network": {"id": "c8ebc7da-3ffe-45a0-b7f5-bb85261852ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1496462371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876fbcda354d47c197ce14ca4ed7ead6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78884930-2b", "ovs_interfaceid": "78884930-2bc7-430e-b250-851ff726d5f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:42:49 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Converting VIF {"id": "78884930-2bc7-430e-b250-851ff726d5f8", "address": "fa:16:3e:0e:5d:f8", "network": {"id": "c8ebc7da-3ffe-45a0-b7f5-bb85261852ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1496462371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876fbcda354d47c197ce14ca4ed7ead6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78884930-2b", "ovs_interfaceid": "78884930-2bc7-430e-b250-851ff726d5f8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:42:49 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:5d:f8,bridge_name='br-int',has_traffic_filtering=True,id=78884930-2bc7-430e-b250-851ff726d5f8,network=Network(c8ebc7da-3ffe-45a0-b7f5-bb85261852ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78884930-2b') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:42:49 user nova-compute[231753]: DEBUG os_vif [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:5d:f8,bridge_name='br-int',has_traffic_filtering=True,id=78884930-2bc7-430e-b250-851ff726d5f8,network=Network(c8ebc7da-3ffe-45a0-b7f5-bb85261852ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78884930-2b') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:42:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:42:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:42:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78884930-2b, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:42:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap78884930-2b, col_values=(('external_ids', {'iface-id': '78884930-2bc7-430e-b250-851ff726d5f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:5d:f8', 'vm-uuid': '37fbc873-537c-4bbc-a57b-2c44e47ecf30'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:42:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:42:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:49 user nova-compute[231753]: INFO os_vif [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:5d:f8,bridge_name='br-int',has_traffic_filtering=True,id=78884930-2bc7-430e-b250-851ff726d5f8,network=Network(c8ebc7da-3ffe-45a0-b7f5-bb85261852ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78884930-2b')
Jul 29 13:42:49 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:42:49 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] No VIF found with MAC fa:16:3e:0e:5d:f8, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:42:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:51 user nova-compute[231753]: DEBUG nova.compute.manager [req-6d17a0e5-bb9a-4996-bef9-419584d6dbd5 req-aa799042-a6bb-4dbe-abee-eaa80ee78653 service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Received event network-vif-plugged-78884930-2bc7-430e-b250-851ff726d5f8 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:42:51 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6d17a0e5-bb9a-4996-bef9-419584d6dbd5 req-aa799042-a6bb-4dbe-abee-eaa80ee78653 service nova] Acquiring lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:51 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6d17a0e5-bb9a-4996-bef9-419584d6dbd5 req-aa799042-a6bb-4dbe-abee-eaa80ee78653 service nova] Lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:51 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6d17a0e5-bb9a-4996-bef9-419584d6dbd5 req-aa799042-a6bb-4dbe-abee-eaa80ee78653 service nova] Lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:51 user nova-compute[231753]: DEBUG nova.compute.manager [req-6d17a0e5-bb9a-4996-bef9-419584d6dbd5 req-aa799042-a6bb-4dbe-abee-eaa80ee78653 service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] No waiting events found dispatching network-vif-plugged-78884930-2bc7-430e-b250-851ff726d5f8 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:42:51 user nova-compute[231753]: WARNING nova.compute.manager [req-6d17a0e5-bb9a-4996-bef9-419584d6dbd5 req-aa799042-a6bb-4dbe-abee-eaa80ee78653 service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Received unexpected event network-vif-plugged-78884930-2bc7-430e-b250-851ff726d5f8 for instance with vm_state building and task_state spawning.
Jul 29 13:42:53 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638173.3886147, 37fbc873-537c-4bbc-a57b-2c44e47ecf30 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:42:53 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] VM Resumed (Lifecycle Event)
Jul 29 13:42:53 user nova-compute[231753]: DEBUG nova.compute.manager [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:42:53 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:42:53 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Instance spawned successfully.
Jul 29 13:42:53 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:42:53 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:42:53 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:42:53 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:42:53 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:42:53 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:42:53 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:42:53 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:42:53 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:42:53 user nova-compute[231753]: DEBUG nova.compute.manager [req-c7d6f21a-6e46-4aac-a600-5a7747f4d9b1 req-2784f322-5b88-41cd-a939-46e5d0f1fd1e service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Received event network-vif-plugged-78884930-2bc7-430e-b250-851ff726d5f8 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:42:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c7d6f21a-6e46-4aac-a600-5a7747f4d9b1 req-2784f322-5b88-41cd-a939-46e5d0f1fd1e service nova] Acquiring lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c7d6f21a-6e46-4aac-a600-5a7747f4d9b1 req-2784f322-5b88-41cd-a939-46e5d0f1fd1e service nova] Lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c7d6f21a-6e46-4aac-a600-5a7747f4d9b1 req-2784f322-5b88-41cd-a939-46e5d0f1fd1e service nova] Lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:53 user nova-compute[231753]: DEBUG nova.compute.manager [req-c7d6f21a-6e46-4aac-a600-5a7747f4d9b1 req-2784f322-5b88-41cd-a939-46e5d0f1fd1e service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] No waiting events found dispatching network-vif-plugged-78884930-2bc7-430e-b250-851ff726d5f8 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:42:53 user nova-compute[231753]: WARNING nova.compute.manager [req-c7d6f21a-6e46-4aac-a600-5a7747f4d9b1 req-2784f322-5b88-41cd-a939-46e5d0f1fd1e service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Received unexpected event network-vif-plugged-78884930-2bc7-430e-b250-851ff726d5f8 for instance with vm_state building and task_state spawning.
Jul 29 13:42:53 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:42:53 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638173.39351, 37fbc873-537c-4bbc-a57b-2c44e47ecf30 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:42:53 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] VM Started (Lifecycle Event)
Jul 29 13:42:53 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:42:53 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:42:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:53 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:42:53 user nova-compute[231753]: INFO nova.compute.manager [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Took 5.48 seconds to spawn the instance on the hypervisor.
Jul 29 13:42:53 user nova-compute[231753]: DEBUG nova.compute.manager [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:42:53 user nova-compute[231753]: INFO nova.compute.manager [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Took 15.04 seconds to build instance.
Jul 29 13:42:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-db50c455-5ec6-4666-94ff-f1a381eab209 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 15.138s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:53 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690638158.6861656, 16097b06-976f-4fcd-a449-7b1ec8f739d1 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:42:53 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] VM Stopped (Lifecycle Event)
Jul 29 13:42:53 user nova-compute[231753]: DEBUG nova.compute.manager [None req-07bdc3ab-c464-4d52-8a3c-5c5b25011c27 None None] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:42:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:55 user nova-compute[231753]: DEBUG nova.compute.manager [req-95b521b8-318b-4289-a43f-4d0423ebc3e3 req-dd6a396f-4899-44dd-87fc-fd263b1e0738 service nova] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Received event network-changed-a734ebff-155c-4861-ae71-26ab6a2b794f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:42:55 user nova-compute[231753]: DEBUG nova.compute.manager [req-95b521b8-318b-4289-a43f-4d0423ebc3e3 req-dd6a396f-4899-44dd-87fc-fd263b1e0738 service nova] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Refreshing instance network info cache due to event network-changed-a734ebff-155c-4861-ae71-26ab6a2b794f. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:42:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-95b521b8-318b-4289-a43f-4d0423ebc3e3 req-dd6a396f-4899-44dd-87fc-fd263b1e0738 service nova] Acquiring lock "refresh_cache-627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:42:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-95b521b8-318b-4289-a43f-4d0423ebc3e3 req-dd6a396f-4899-44dd-87fc-fd263b1e0738 service nova] Acquired lock "refresh_cache-627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:42:55 user nova-compute[231753]: DEBUG nova.network.neutron [req-95b521b8-318b-4289-a43f-4d0423ebc3e3 req-dd6a396f-4899-44dd-87fc-fd263b1e0738 service nova] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Refreshing network info cache for port a734ebff-155c-4861-ae71-26ab6a2b794f {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:42:55 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690638160.8983278, aa8c3210-37e5-4e33-8ea4-98a70fa9800b => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:42:55 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] VM Stopped (Lifecycle Event)
Jul 29 13:42:55 user nova-compute[231753]: DEBUG nova.compute.manager [None req-9ebf373e-72dd-4465-b2b5-38dfa5547513 None None] [instance: aa8c3210-37e5-4e33-8ea4-98a70fa9800b] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:42:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5895d680-41fb-4272-b4c6-fadbfc970015 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5895d680-41fb-4272-b4c6-fadbfc970015 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5895d680-41fb-4272-b4c6-fadbfc970015 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5895d680-41fb-4272-b4c6-fadbfc970015 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5895d680-41fb-4272-b4c6-fadbfc970015 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:56 user nova-compute[231753]: INFO nova.compute.manager [None req-5895d680-41fb-4272-b4c6-fadbfc970015 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Terminating instance
Jul 29 13:42:56 user nova-compute[231753]: DEBUG nova.compute.manager [None req-5895d680-41fb-4272-b4c6-fadbfc970015 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:42:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:56 user nova-compute[231753]: DEBUG nova.compute.manager [req-4a19b7a1-d705-4a3b-811d-7ee1ee76ee16 req-e6e6f3dd-6135-40a9-a6f7-3f837b6f9c12 service nova] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Received event network-vif-unplugged-a734ebff-155c-4861-ae71-26ab6a2b794f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:42:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4a19b7a1-d705-4a3b-811d-7ee1ee76ee16 req-e6e6f3dd-6135-40a9-a6f7-3f837b6f9c12 service nova] Acquiring lock "627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4a19b7a1-d705-4a3b-811d-7ee1ee76ee16 req-e6e6f3dd-6135-40a9-a6f7-3f837b6f9c12 service nova] Lock "627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4a19b7a1-d705-4a3b-811d-7ee1ee76ee16 req-e6e6f3dd-6135-40a9-a6f7-3f837b6f9c12 service nova] Lock "627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:56 user nova-compute[231753]: DEBUG nova.compute.manager [req-4a19b7a1-d705-4a3b-811d-7ee1ee76ee16 req-e6e6f3dd-6135-40a9-a6f7-3f837b6f9c12 service nova] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] No waiting events found dispatching network-vif-unplugged-a734ebff-155c-4861-ae71-26ab6a2b794f {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:42:56 user nova-compute[231753]: DEBUG nova.compute.manager [req-4a19b7a1-d705-4a3b-811d-7ee1ee76ee16 req-e6e6f3dd-6135-40a9-a6f7-3f837b6f9c12 service nova] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Received event network-vif-unplugged-a734ebff-155c-4861-ae71-26ab6a2b794f for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:42:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:56 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Instance destroyed successfully.
Jul 29 13:42:56 user nova-compute[231753]: DEBUG nova.objects.instance [None req-5895d680-41fb-4272-b4c6-fadbfc970015 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lazy-loading 'resources' on Instance uuid 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:42:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-5895d680-41fb-4272-b4c6-fadbfc970015 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:41:03Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-278113094',display_name='tempest-AttachVolumeNegativeTest-server-278113094',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-278113094',id=23,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCw+nln1PMAQSc3mEp48EwaUKF1xqasXXy9+La1d4yOKfsTSxlR+P7FbTXFFiuDVLV+SoXac5JlLoARhkFgmhltTSKNnY1uI3tUcqgGZ5b/WLkfx1TGIRB45PUjU8ko+4w==',key_name='tempest-keypair-470099786',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:41:10Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f3122196c4504a82a2a01774ab60406a',ramdisk_id='',reservation_id='r-cg7hfqig',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1031975907',owner_user_name='tempest-AttachVolumeNegativeTest-1031975907-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:41:11Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a09de75c8ab742fe951604b612ea5839',uuid=627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a734ebff-155c-4861-ae71-26ab6a2b794f", "address": "fa:16:3e:28:dc:4c", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa734ebff-15", "ovs_interfaceid": "a734ebff-155c-4861-ae71-26ab6a2b794f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:42:56 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-5895d680-41fb-4272-b4c6-fadbfc970015 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Converting VIF {"id": "a734ebff-155c-4861-ae71-26ab6a2b794f", "address": "fa:16:3e:28:dc:4c", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa734ebff-15", "ovs_interfaceid": "a734ebff-155c-4861-ae71-26ab6a2b794f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:42:56 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-5895d680-41fb-4272-b4c6-fadbfc970015 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:28:dc:4c,bridge_name='br-int',has_traffic_filtering=True,id=a734ebff-155c-4861-ae71-26ab6a2b794f,network=Network(1ff03660-77ea-4ec6-8eeb-55df7e78096b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa734ebff-15') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:42:56 user nova-compute[231753]: DEBUG os_vif [None req-5895d680-41fb-4272-b4c6-fadbfc970015 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:dc:4c,bridge_name='br-int',has_traffic_filtering=True,id=a734ebff-155c-4861-ae71-26ab6a2b794f,network=Network(1ff03660-77ea-4ec6-8eeb-55df7e78096b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa734ebff-15') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:42:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa734ebff-15, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:42:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:42:56 user nova-compute[231753]: INFO os_vif [None req-5895d680-41fb-4272-b4c6-fadbfc970015 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:28:dc:4c,bridge_name='br-int',has_traffic_filtering=True,id=a734ebff-155c-4861-ae71-26ab6a2b794f,network=Network(1ff03660-77ea-4ec6-8eeb-55df7e78096b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa734ebff-15')
Jul 29 13:42:56 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-5895d680-41fb-4272-b4c6-fadbfc970015 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Deleting instance files /opt/stack/data/nova/instances/627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb_del
Jul 29 13:42:56 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-5895d680-41fb-4272-b4c6-fadbfc970015 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Deletion of /opt/stack/data/nova/instances/627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb_del complete
Jul 29 13:42:56 user nova-compute[231753]: INFO nova.compute.manager [None req-5895d680-41fb-4272-b4c6-fadbfc970015 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Took 0.91 seconds to destroy the instance on the hypervisor.
Jul 29 13:42:56 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-5895d680-41fb-4272-b4c6-fadbfc970015 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:42:56 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:42:56 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:42:57 user nova-compute[231753]: DEBUG nova.network.neutron [req-95b521b8-318b-4289-a43f-4d0423ebc3e3 req-dd6a396f-4899-44dd-87fc-fd263b1e0738 service nova] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Updated VIF entry in instance network info cache for port a734ebff-155c-4861-ae71-26ab6a2b794f. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:42:57 user nova-compute[231753]: DEBUG nova.network.neutron [req-95b521b8-318b-4289-a43f-4d0423ebc3e3 req-dd6a396f-4899-44dd-87fc-fd263b1e0738 service nova] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Updating instance_info_cache with network_info: [{"id": "a734ebff-155c-4861-ae71-26ab6a2b794f", "address": "fa:16:3e:28:dc:4c", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.83", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa734ebff-15", "ovs_interfaceid": "a734ebff-155c-4861-ae71-26ab6a2b794f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:42:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-95b521b8-318b-4289-a43f-4d0423ebc3e3 req-dd6a396f-4899-44dd-87fc-fd263b1e0738 service nova] Releasing lock "refresh_cache-627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:42:57 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:42:57 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Took 1.04 seconds to deallocate network for instance.
Jul 29 13:42:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5895d680-41fb-4272-b4c6-fadbfc970015 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5895d680-41fb-4272-b4c6-fadbfc970015 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:58 user nova-compute[231753]: DEBUG nova.compute.manager [req-0156b803-752b-4c94-b55c-74113fc4e7e7 req-a744a293-b8ca-47b8-825b-e7af6236e74b service nova] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Received event network-vif-plugged-a734ebff-155c-4861-ae71-26ab6a2b794f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:42:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0156b803-752b-4c94-b55c-74113fc4e7e7 req-a744a293-b8ca-47b8-825b-e7af6236e74b service nova] Acquiring lock "627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:42:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0156b803-752b-4c94-b55c-74113fc4e7e7 req-a744a293-b8ca-47b8-825b-e7af6236e74b service nova] Lock "627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:42:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0156b803-752b-4c94-b55c-74113fc4e7e7 req-a744a293-b8ca-47b8-825b-e7af6236e74b service nova] Lock "627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:58 user nova-compute[231753]: DEBUG nova.compute.manager [req-0156b803-752b-4c94-b55c-74113fc4e7e7 req-a744a293-b8ca-47b8-825b-e7af6236e74b service nova] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] No waiting events found dispatching network-vif-plugged-a734ebff-155c-4861-ae71-26ab6a2b794f {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:42:58 user nova-compute[231753]: WARNING nova.compute.manager [req-0156b803-752b-4c94-b55c-74113fc4e7e7 req-a744a293-b8ca-47b8-825b-e7af6236e74b service nova] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Received unexpected event network-vif-plugged-a734ebff-155c-4861-ae71-26ab6a2b794f for instance with vm_state deleted and task_state None.
Jul 29 13:42:58 user nova-compute[231753]: DEBUG nova.compute.manager [req-0156b803-752b-4c94-b55c-74113fc4e7e7 req-a744a293-b8ca-47b8-825b-e7af6236e74b service nova] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Received event network-vif-deleted-a734ebff-155c-4861-ae71-26ab6a2b794f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:42:58 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-5895d680-41fb-4272-b4c6-fadbfc970015 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:42:58 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-5895d680-41fb-4272-b4c6-fadbfc970015 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:42:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5895d680-41fb-4272-b4c6-fadbfc970015 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.389s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:58 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-5895d680-41fb-4272-b4c6-fadbfc970015 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Deleted allocations for instance 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb
Jul 29 13:42:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5895d680-41fb-4272-b4c6-fadbfc970015 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.601s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:42:58 user nova-compute[231753]: INFO nova.compute.manager [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Rescuing
Jul 29 13:42:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "refresh_cache-b99a72ba-73e2-4be7-b52b-7797351daa5f" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:42:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquired lock "refresh_cache-b99a72ba-73e2-4be7-b52b-7797351daa5f" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:42:58 user nova-compute[231753]: DEBUG nova.network.neutron [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:42:59 user nova-compute[231753]: DEBUG nova.network.neutron [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Updating instance_info_cache with network_info: [{"id": "d145cf59-908e-42c4-ba8e-ce5abe640639", "address": "fa:16:3e:25:37:92", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd145cf59-90", "ovs_interfaceid": "d145cf59-908e-42c4-ba8e-ce5abe640639", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:42:59 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Releasing lock "refresh_cache-b99a72ba-73e2-4be7-b52b-7797351daa5f" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:42:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:42:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:00 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:00 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:00 user nova-compute[231753]: DEBUG nova.compute.manager [req-9d25079a-dd54-48ff-9185-c4a467268b46 req-12e426c1-0775-4ae1-a8f4-5895cf2b55e7 service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Received event network-vif-unplugged-d145cf59-908e-42c4-ba8e-ce5abe640639 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:43:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9d25079a-dd54-48ff-9185-c4a467268b46 req-12e426c1-0775-4ae1-a8f4-5895cf2b55e7 service nova] Acquiring lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:43:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9d25079a-dd54-48ff-9185-c4a467268b46 req-12e426c1-0775-4ae1-a8f4-5895cf2b55e7 service nova] Lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:43:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9d25079a-dd54-48ff-9185-c4a467268b46 req-12e426c1-0775-4ae1-a8f4-5895cf2b55e7 service nova] Lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:43:00 user nova-compute[231753]: DEBUG nova.compute.manager [req-9d25079a-dd54-48ff-9185-c4a467268b46 req-12e426c1-0775-4ae1-a8f4-5895cf2b55e7 service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] No waiting events found dispatching network-vif-unplugged-d145cf59-908e-42c4-ba8e-ce5abe640639 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:43:00 user nova-compute[231753]: WARNING nova.compute.manager [req-9d25079a-dd54-48ff-9185-c4a467268b46 req-12e426c1-0775-4ae1-a8f4-5895cf2b55e7 service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Received unexpected event network-vif-unplugged-d145cf59-908e-42c4-ba8e-ce5abe640639 for instance with vm_state active and task_state rescuing.
Jul 29 13:43:00 user nova-compute[231753]: DEBUG nova.compute.manager [req-9d25079a-dd54-48ff-9185-c4a467268b46 req-12e426c1-0775-4ae1-a8f4-5895cf2b55e7 service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Received event network-vif-plugged-d145cf59-908e-42c4-ba8e-ce5abe640639 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:43:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9d25079a-dd54-48ff-9185-c4a467268b46 req-12e426c1-0775-4ae1-a8f4-5895cf2b55e7 service nova] Acquiring lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:43:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9d25079a-dd54-48ff-9185-c4a467268b46 req-12e426c1-0775-4ae1-a8f4-5895cf2b55e7 service nova] Lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:43:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9d25079a-dd54-48ff-9185-c4a467268b46 req-12e426c1-0775-4ae1-a8f4-5895cf2b55e7 service nova] Lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:43:00 user nova-compute[231753]: DEBUG nova.compute.manager [req-9d25079a-dd54-48ff-9185-c4a467268b46 req-12e426c1-0775-4ae1-a8f4-5895cf2b55e7 service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] No waiting events found dispatching network-vif-plugged-d145cf59-908e-42c4-ba8e-ce5abe640639 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:43:00 user nova-compute[231753]: WARNING nova.compute.manager [req-9d25079a-dd54-48ff-9185-c4a467268b46 req-12e426c1-0775-4ae1-a8f4-5895cf2b55e7 service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Received unexpected event network-vif-plugged-d145cf59-908e-42c4-ba8e-ce5abe640639 for instance with vm_state active and task_state rescuing.
Jul 29 13:43:00 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Instance destroyed successfully.
Jul 29 13:43:00 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Attempting a stable device rescue
Jul 29 13:43:00 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=231753) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 29 13:43:00 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Instance directory exists: not creating {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 29 13:43:00 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Creating image(s)
Jul 29 13:43:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "/opt/stack/data/nova/instances/b99a72ba-73e2-4be7-b52b-7797351daa5f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:43:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "/opt/stack/data/nova/instances/b99a72ba-73e2-4be7-b52b-7797351daa5f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:43:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "/opt/stack/data/nova/instances/b99a72ba-73e2-4be7-b52b-7797351daa5f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:43:00 user nova-compute[231753]: DEBUG nova.objects.instance [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lazy-loading 'trusted_certs' on Instance uuid b99a72ba-73e2-4be7-b52b-7797351daa5f {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:43:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "f1b8f05d11fd588b37811ff4d1d138e60d1a9ced" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:43:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "f1b8f05d11fd588b37811ff4d1d138e60d1a9ced" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:43:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1b8f05d11fd588b37811ff4d1d138e60d1a9ced.part --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1b8f05d11fd588b37811ff4d1d138e60d1a9ced.part --force-share --output=json" returned: 0 in 0.139s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:01 user nova-compute[231753]: DEBUG nova.virt.images [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] 270d782c-1f0a-4217-ba58-1b87f930a393 was qcow2, converting to raw {{(pid=231753) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 29 13:43:01 user nova-compute[231753]: DEBUG nova.privsep.utils [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=231753) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 29 13:43:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f1b8f05d11fd588b37811ff4d1d138e60d1a9ced.part /opt/stack/data/nova/instances/_base/f1b8f05d11fd588b37811ff4d1d138e60d1a9ced.converted {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:01 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/f1b8f05d11fd588b37811ff4d1d138e60d1a9ced.part /opt/stack/data/nova/instances/_base/f1b8f05d11fd588b37811ff4d1d138e60d1a9ced.converted" returned: 0 in 0.386s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1b8f05d11fd588b37811ff4d1d138e60d1a9ced.converted --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1b8f05d11fd588b37811ff4d1d138e60d1a9ced.converted --force-share --output=json" returned: 0 in 0.134s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "f1b8f05d11fd588b37811ff4d1d138e60d1a9ced" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.643s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "f1b8f05d11fd588b37811ff4d1d138e60d1a9ced" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "f1b8f05d11fd588b37811ff4d1d138e60d1a9ced" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1b8f05d11fd588b37811ff4d1d138e60d1a9ced --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/f1b8f05d11fd588b37811ff4d1d138e60d1a9ced --force-share --output=json" returned: 0 in 0.137s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f1b8f05d11fd588b37811ff4d1d138e60d1a9ced,backing_fmt=raw /opt/stack/data/nova/instances/b99a72ba-73e2-4be7-b52b-7797351daa5f/disk.rescue {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/f1b8f05d11fd588b37811ff4d1d138e60d1a9ced,backing_fmt=raw /opt/stack/data/nova/instances/b99a72ba-73e2-4be7-b52b-7797351daa5f/disk.rescue" returned: 0 in 0.058s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "f1b8f05d11fd588b37811ff4d1d138e60d1a9ced" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.201s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG nova.objects.instance [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lazy-loading 'migration_context' on Instance uuid b99a72ba-73e2-4be7-b52b-7797351daa5f {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Start _get_guest_xml network_info=[{"id": "d145cf59-908e-42c4-ba8e-ce5abe640639", "address": "fa:16:3e:25:37:92", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "vif_mac": "fa:16:3e:25:37:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd145cf59-90", "ovs_interfaceid": "d145cf59-908e-42c4-ba8e-ce5abe640639", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '270d782c-1f0a-4217-ba58-1b87f930a393', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pxcjmHFe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, 'status': 'reserved', 'instance': 'b99a72ba-73e2-4be7-b52b-7797351daa5f', 'attached_at': '', 'detached_at': '', 'volume_id': 'fda4c8ca-fe57-4522-b8bf-0086825e92ea', 'serial': 'fda4c8ca-fe57-4522-b8bf-0086825e92ea'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '0a783884-c888-464f-bbe9-87fd369f7dbd', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG nova.objects.instance [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lazy-loading 'resources' on Instance uuid b99a72ba-73e2-4be7-b52b-7797351daa5f {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG nova.objects.instance [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lazy-loading 'numa_topology' on Instance uuid b99a72ba-73e2-4be7-b52b-7797351daa5f {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:43:02 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:43:02 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:43:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG nova.objects.instance [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lazy-loading 'vcpu_model' on Instance uuid b99a72ba-73e2-4be7-b52b-7797351daa5f {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pxcjmHFe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:43:02 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:43:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:43:02 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:43:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:43:02 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:43:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0690abee-e1ad-49a4-bd54-791221367577]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = pxcjmHFe\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 29 13:43:02 user nova-compute[231753]: node.name = iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea
Jul 29 13:43:02 user nova-compute[231753]: node.tpgt = -1
Jul 29 13:43:02 user nova-compute[231753]: node.startup = automatic
Jul 29 13:43:02 user nova-compute[231753]: node.leading_login = No
Jul 29 13:43:02 user nova-compute[231753]: iface.iscsi_ifacename = default
Jul 29 13:43:02 user nova-compute[231753]: iface.net_ifacename = <empty>
Jul 29 13:43:02 user nova-compute[231753]: iface.ipaddress = <empty>
Jul 29 13:43:02 user nova-compute[231753]: iface.prefix_len = 0
Jul 29 13:43:02 user nova-compute[231753]: iface.hwaddress = <empty>
Jul 29 13:43:02 user nova-compute[231753]: iface.transport_name = tcp
Jul 29 13:43:02 user nova-compute[231753]: iface.initiatorname = <empty>
Jul 29 13:43:02 user nova-compute[231753]: iface.state = <empty>
Jul 29 13:43:02 user nova-compute[231753]: iface.vlan_id = 0
Jul 29 13:43:02 user nova-compute[231753]: iface.vlan_priority = 0
Jul 29 13:43:02 user nova-compute[231753]: iface.vlan_state = <empty>
Jul 29 13:43:02 user nova-compute[231753]: iface.iface_num = 0
Jul 29 13:43:02 user nova-compute[231753]: iface.mtu = 0
Jul 29 13:43:02 user nova-compute[231753]: iface.port = 0
Jul 29 13:43:02 user nova-compute[231753]: iface.bootproto = <empty>
Jul 29 13:43:02 user nova-compute[231753]: iface.subnet_mask = <empty>
Jul 29 13:43:02 user nova-compute[231753]: iface.gateway = <empty>
Jul 29 13:43:02 user nova-compute[231753]: iface.dhcp_alt_client_id_state = <empty>
Jul 29 13:43:02 user nova-compute[231753]: iface.dhcp_alt_client_id = <empty>
Jul 29 13:43:02 user nova-compute[231753]: iface.dhcp_dns = <empty>
Jul 29 13:43:02 user nova-compute[231753]: iface.dhcp_learn_iqn = <empty>
Jul 29 13:43:02 user nova-compute[231753]: iface.dhcp_req_vendor_id_state = <empty>
Jul 29 13:43:02 user nova-compute[231753]: iface.dhcp_vendor_id_state = <empty>
Jul 29 13:43:02 user nova-compute[231753]: iface.dhcp_vendor_id = <empty>
Jul 29 13:43:02 user nova-compute[231753]: iface.dhcp_slp_da = <empty>
Jul 29 13:43:02 user nova-compute[231753]: iface.fragmentation = <empty>
Jul 29 13:43:02 user nova-compute[231753]: iface.gratuitous_arp = <empty>
Jul 29 13:43:02 user nova-compute[231753]: iface.incoming_forwarding = <empty>
Jul 29 13:43:02 user nova-compute[231753]: iface.tos_state = <empty>
Jul 29 13:43:02 user nova-compute[231753]: iface.tos = 0
Jul 29 13:43:02 user nova-compute[231753]: iface.ttl = 0
Jul 29 13:43:02 user nova-compute[231753]: iface.delayed_ack = <empty>
Jul 29 13:43:02 user nova-compute[231753]: iface.tcp_nagle = <empty>
Jul 29 13:43:02 user nova-compute[231753]: iface.tcp_wsf_state = <empty>
Jul 29 13:43:02 user nova-compute[231753]: iface.tcp_wsf = 0
Jul 29 13:43:02 user nova-compute[231753]: iface.tcp_timer_scale = 0
Jul 29 13:43:02 user nova-compute[231753]: iface.tcp_timestamp = <empty>
Jul 29 13:43:02 user nova-compute[231753]: iface.redirect = <empty>
Jul 29 13:43:02 user nova-compute[231753]: iface.def_task_mgmt_timeout = 0
Jul 29 13:43:02 user nova-compute[231753]: iface.header_digest = <empty>
Jul 29 13:43:02 user nova-compute[231753]: iface.data_digest = <empty>
Jul 29 13:43:02 user nova-compute[231753]: iface.immediate_data = <empty>
Jul 29 13:43:02 user nova-compute[231753]: iface.initial_r2t = <empty>
Jul 29 13:43:02 user nova-compute[231753]: iface.data_seq_inorder = <empty>
Jul 29 13:43:02 user nova-compute[231753]: iface.data_pdu_inorder = <empty>
Jul 29 13:43:02 user nova-compute[231753]: iface.erl = 0
Jul 29 13:43:02 user nova-compute[231753]: iface.max_receive_data_len = 0
Jul 29 13:43:02 user nova-compute[231753]: iface.first_burst_len = 0
Jul 29 13:43:02 user nova-compute[231753]: iface.max_outstanding_r2t = 0
Jul 29 13:43:02 user nova-compute[231753]: iface.max_burst_len = 0
Jul 29 13:43:02 user nova-compute[231753]: iface.chap_auth = <empty>
Jul 29 13:43:02 user nova-compute[231753]: iface.bidi_chap = <empty>
Jul 29 13:43:02 user nova-compute[231753]: iface.strict_login_compliance = <empty>
Jul 29 13:43:02 user nova-compute[231753]: iface.discovery_auth = <empty>
Jul 29 13:43:02 user nova-compute[231753]: iface.discovery_logout = <empty>
Jul 29 13:43:02 user nova-compute[231753]: node.discovery_address = <empty>
Jul 29 13:43:02 user nova-compute[231753]: node.discovery_port = 0
Jul 29 13:43:02 user nova-compute[231753]: node.discovery_type = static
Jul 29 13:43:02 user nova-compute[231753]: node.session.initial_cmdsn = 0
Jul 29 13:43:02 user nova-compute[231753]: node.session.initial_login_retry_max = 8
Jul 29 13:43:02 user nova-compute[231753]: node.session.xmit_thread_priority = -20
Jul 29 13:43:02 user nova-compute[231753]: node.session.cmds_max = 128
Jul 29 13:43:02 user nova-compute[231753]: node.session.queue_depth = 32
Jul 29 13:43:02 user nova-compute[231753]: node.session.nr_sessions = 1
Jul 29 13:43:02 user nova-compute[231753]: node.session.auth.authmethod = CHAP
Jul 29 13:43:02 user nova-compute[231753]: node.session.auth.username = pxcjmHFe
Jul 29 13:43:02 user nova-compute[231753]: node.session.auth.password = ***
Jul 29 13:43:02 user nova-compute[231753]: node.session.auth.username_in = <empty>
Jul 29 13:43:02 user nova-compute[231753]: node.session.auth.password_in = <empty>
Jul 29 13:43:02 user nova-compute[231753]: node.session.auth.chap_algs = MD5
Jul 29 13:43:02 user nova-compute[231753]: node.session.timeo.replacement_timeout = 120
Jul 29 13:43:02 user nova-compute[231753]: node.session.err_timeo.abort_timeout = 15
Jul 29 13:43:02 user nova-compute[231753]: node.session.err_timeo.lu_reset_timeout = 30
Jul 29 13:43:02 user nova-compute[231753]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 29 13:43:02 user nova-compute[231753]: node.session.err_timeo.host_reset_timeout = 60
Jul 29 13:43:02 user nova-compute[231753]: node.session.iscsi.FastAbort = Yes
Jul 29 13:43:02 user nova-compute[231753]: node.session.iscsi.InitialR2T = No
Jul 29 13:43:02 user nova-compute[231753]: node.session.iscsi.ImmediateData = Yes
Jul 29 13:43:02 user nova-compute[231753]: node.session.iscsi.FirstBurstLength = 262144
Jul 29 13:43:02 user nova-compute[231753]: node.session.iscsi.MaxBurstLength = 16776192
Jul 29 13:43:02 user nova-compute[231753]: node.session.iscsi.DefaultTime2Retain = 0
Jul 29 13:43:02 user nova-compute[231753]: node.session.iscsi.DefaultTime2Wait = 2
Jul 29 13:43:02 user nova-compute[231753]: node.session.iscsi.MaxConnections = 1
Jul 29 13:43:02 user nova-compute[231753]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 29 13:43:02 user nova-compute[231753]: node.session.iscsi.ERL = 0
Jul 29 13:43:02 user nova-compute[231753]: node.session.scan = manual
Jul 29 13:43:02 user nova-compute[231753]: node.session.reopen_max = 0
Jul 29 13:43:02 user nova-compute[231753]: node.conn[0].address = 172.16.0.220
Jul 29 13:43:02 user nova-compute[231753]: node.conn[0].port = 3260
Jul 29 13:43:02 user nova-compute[231753]: node.conn[0].startup = manual
Jul 29 13:43:02 user nova-compute[231753]: node.conn[0].tcp.window_size = 524288
Jul 29 13:43:02 user nova-compute[231753]: node.conn[0].tcp.type_of_service = 0
Jul 29 13:43:02 user nova-compute[231753]: node.conn[0].timeo.logout_timeout = 15
Jul 29 13:43:02 user nova-compute[231753]: node.conn[0].timeo.login_timeout = 15
Jul 29 13:43:02 user nova-compute[231753]: node.conn[0].timeo.auth_timeout = 45
Jul 29 13:43:02 user nova-compute[231753]: node.conn[0].timeo.noop_out_interval = 5
Jul 29 13:43:02 user nova-compute[231753]: node.conn[0].timeo.noop_out_timeout = 5
Jul 29 13:43:02 user nova-compute[231753]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 29 13:43:02 user nova-compute[231753]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 29 13:43:02 user nova-compute[231753]: node.conn[0].iscsi.HeaderDigest = None
Jul 29 13:43:02 user nova-compute[231753]: node.conn[0].iscsi.DataDigest = None
Jul 29 13:43:02 user nova-compute[231753]: node.conn[0].iscsi.IFMarker = No
Jul 29 13:43:02 user nova-compute[231753]: node.conn[0].iscsi.OFMarker = No
Jul 29 13:43:02 user nova-compute[231753]: # END RECORD
Jul 29 13:43:02 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[14226642-0e4b-4b02-8e6c-db9d3679e0ce]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf06e110-0445-4e23-9952-d54a038bbc3d]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pxcjmHFe {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea -p 172.16.0.220:3260 --op update -n node.session.auth.username -v pxcjmHFe" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cf59c78-5204-4152-bfde-9214eaa43ca0]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'pxcjmHFe'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[701eb885-1cfa-455d-9009-a2743932fcc1]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1df18c-c979-4ea0-b695-de29c9f1b8c7]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:43:02 user nova-compute[231753]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:43:02 user nova-compute[231753]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)
Jul 29 13:43:02 user nova-compute[231753]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:43:02 user nova-compute[231753]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)
Jul 29 13:43:02 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:43:02 user nova-compute[231753]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:43:02 user nova-compute[231753]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)
Jul 29 13:43:02 user nova-compute[231753]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:43:02 user nova-compute[231753]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)
Jul 29 13:43:02 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.165s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] HCTL ('35', '0', '0', 0) found on session 24 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Scanning host 35 c: 0, t: 0, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.014s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc75be8d-5716-4d27-a9e1-7b90e7602dbc]: (4, ('0 0 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Searching for a device in session 24 and hctl ('35', '0', '0', 0) yield: sdd {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pxcjmHFe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.197s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] <== connect_volume: return (199ms) {'type': 'block', 'scsi_wwn': '23133363730373866', 'path': '/dev/sdd'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23133363730373866', 'path': '/dev/sdd'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:41:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-697372546',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-697372546',id=24,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:41:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c01165e83a3143ad83f050790f2b63fe',ramdisk_id='',reservation_id='r-9hzwg4i4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-93506270',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:41:28Z,user_data=None,user_id='618ce2d56c3c4ee8ace871d308ca45fb',uuid=b99a72ba-73e2-4be7-b52b-7797351daa5f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d145cf59-908e-42c4-ba8e-ce5abe640639", "address": "fa:16:3e:25:37:92", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "vif_mac": "fa:16:3e:25:37:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd145cf59-90", "ovs_interfaceid": "d145cf59-908e-42c4-ba8e-ce5abe640639", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Converting VIF {"id": "d145cf59-908e-42c4-ba8e-ce5abe640639", "address": "fa:16:3e:25:37:92", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "vif_mac": "fa:16:3e:25:37:92"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd145cf59-90", "ovs_interfaceid": "d145cf59-908e-42c4-ba8e-ce5abe640639", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:37:92,bridge_name='br-int',has_traffic_filtering=True,id=d145cf59-908e-42c4-ba8e-ce5abe640639,network=Network(03362fcb-afd6-4b0a-af44-a54a848c59f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd145cf59-90') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG nova.objects.instance [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lazy-loading 'pci_devices' on Instance uuid b99a72ba-73e2-4be7-b52b-7797351daa5f {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:43:02 user nova-compute[231753]:   <uuid>b99a72ba-73e2-4be7-b52b-7797351daa5f</uuid>
Jul 29 13:43:02 user nova-compute[231753]:   <name>instance-00000018</name>
Jul 29 13:43:02 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:43:02 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:43:02 user nova-compute[231753]:   <metadata>
Jul 29 13:43:02 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:43:02 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:43:02 user nova-compute[231753]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-697372546</nova:name>
Jul 29 13:43:02 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:43:02</nova:creationTime>
Jul 29 13:43:02 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:43:02 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:43:02 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:43:02 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:43:02 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:43:02 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:43:02 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:43:02 user nova-compute[231753]:       <nova:owner>
Jul 29 13:43:02 user nova-compute[231753]:         <nova:user uuid="618ce2d56c3c4ee8ace871d308ca45fb">tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member</nova:user>
Jul 29 13:43:02 user nova-compute[231753]:         <nova:project uuid="c01165e83a3143ad83f050790f2b63fe">tempest-ServerBootFromVolumeStableRescueTest-93506270</nova:project>
Jul 29 13:43:02 user nova-compute[231753]:       </nova:owner>
Jul 29 13:43:02 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:43:02 user nova-compute[231753]:       <nova:ports>
Jul 29 13:43:02 user nova-compute[231753]:         <nova:port uuid="d145cf59-908e-42c4-ba8e-ce5abe640639">
Jul 29 13:43:02 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 29 13:43:02 user nova-compute[231753]:         </nova:port>
Jul 29 13:43:02 user nova-compute[231753]:       </nova:ports>
Jul 29 13:43:02 user nova-compute[231753]:     </nova:instance>
Jul 29 13:43:02 user nova-compute[231753]:   </metadata>
Jul 29 13:43:02 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:43:02 user nova-compute[231753]:     <system>
Jul 29 13:43:02 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:43:02 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:43:02 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:43:02 user nova-compute[231753]:       <entry name="serial">b99a72ba-73e2-4be7-b52b-7797351daa5f</entry>
Jul 29 13:43:02 user nova-compute[231753]:       <entry name="uuid">b99a72ba-73e2-4be7-b52b-7797351daa5f</entry>
Jul 29 13:43:02 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:43:02 user nova-compute[231753]:     </system>
Jul 29 13:43:02 user nova-compute[231753]:   </sysinfo>
Jul 29 13:43:02 user nova-compute[231753]:   <os>
Jul 29 13:43:02 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:43:02 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:43:02 user nova-compute[231753]:   </os>
Jul 29 13:43:02 user nova-compute[231753]:   <features>
Jul 29 13:43:02 user nova-compute[231753]:     <acpi/>
Jul 29 13:43:02 user nova-compute[231753]:     <apic/>
Jul 29 13:43:02 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:43:02 user nova-compute[231753]:   </features>
Jul 29 13:43:02 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:43:02 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:43:02 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:43:02 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:43:02 user nova-compute[231753]:   </clock>
Jul 29 13:43:02 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:43:02 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:43:02 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:43:02 user nova-compute[231753]:   </cpu>
Jul 29 13:43:02 user nova-compute[231753]:   <devices>
Jul 29 13:43:02 user nova-compute[231753]:     <disk type="block" device="disk">
Jul 29 13:43:02 user nova-compute[231753]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:43:02 user nova-compute[231753]:       <source dev="/dev/sdd"/>
Jul 29 13:43:02 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:43:02 user nova-compute[231753]:       <serial>fda4c8ca-fe57-4522-b8bf-0086825e92ea</serial>
Jul 29 13:43:02 user nova-compute[231753]:     </disk>
Jul 29 13:43:02 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:43:02 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:43:02 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/b99a72ba-73e2-4be7-b52b-7797351daa5f/disk.rescue"/>
Jul 29 13:43:02 user nova-compute[231753]:       <target dev="vdb" bus="virtio"/>
Jul 29 13:43:02 user nova-compute[231753]:       <boot order="1"/>
Jul 29 13:43:02 user nova-compute[231753]:     </disk>
Jul 29 13:43:02 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:43:02 user nova-compute[231753]:       <mac address="fa:16:3e:25:37:92"/>
Jul 29 13:43:02 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:43:02 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:43:02 user nova-compute[231753]:       <target dev="tapd145cf59-90"/>
Jul 29 13:43:02 user nova-compute[231753]:     </interface>
Jul 29 13:43:02 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:43:02 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/b99a72ba-73e2-4be7-b52b-7797351daa5f/console.log" append="off"/>
Jul 29 13:43:02 user nova-compute[231753]:     </serial>
Jul 29 13:43:02 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:43:02 user nova-compute[231753]:     <video>
Jul 29 13:43:02 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:43:02 user nova-compute[231753]:     </video>
Jul 29 13:43:02 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:43:02 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:43:02 user nova-compute[231753]:     </rng>
Jul 29 13:43:02 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:43:02 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:43:02 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:43:02 user nova-compute[231753]:     </memballoon>
Jul 29 13:43:02 user nova-compute[231753]:   </devices>
Jul 29 13:43:02 user nova-compute[231753]: </domain>
Jul 29 13:43:02 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:43:02 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Instance destroyed successfully.
Jul 29 13:43:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] No BDM found with device name vdb, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:43:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] No VIF found with MAC fa:16:3e:25:37:92, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:43:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:04 user nova-compute[231753]: DEBUG nova.compute.manager [req-2c24bc7c-0ce4-4142-b068-2de8d45e3e30 req-edd59978-4681-42c6-bac4-b136c6c0688f service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Received event network-vif-plugged-d145cf59-908e-42c4-ba8e-ce5abe640639 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:43:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-2c24bc7c-0ce4-4142-b068-2de8d45e3e30 req-edd59978-4681-42c6-bac4-b136c6c0688f service nova] Acquiring lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:43:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-2c24bc7c-0ce4-4142-b068-2de8d45e3e30 req-edd59978-4681-42c6-bac4-b136c6c0688f service nova] Lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:43:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-2c24bc7c-0ce4-4142-b068-2de8d45e3e30 req-edd59978-4681-42c6-bac4-b136c6c0688f service nova] Lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:43:04 user nova-compute[231753]: DEBUG nova.compute.manager [req-2c24bc7c-0ce4-4142-b068-2de8d45e3e30 req-edd59978-4681-42c6-bac4-b136c6c0688f service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] No waiting events found dispatching network-vif-plugged-d145cf59-908e-42c4-ba8e-ce5abe640639 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:43:04 user nova-compute[231753]: WARNING nova.compute.manager [req-2c24bc7c-0ce4-4142-b068-2de8d45e3e30 req-edd59978-4681-42c6-bac4-b136c6c0688f service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Received unexpected event network-vif-plugged-d145cf59-908e-42c4-ba8e-ce5abe640639 for instance with vm_state active and task_state rescuing.
Jul 29 13:43:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Removed pending event for b99a72ba-73e2-4be7-b52b-7797351daa5f due to event {{(pid=231753) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 29 13:43:06 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638186.3489714, b99a72ba-73e2-4be7-b52b-7797351daa5f => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:43:06 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] VM Resumed (Lifecycle Event)
Jul 29 13:43:06 user nova-compute[231753]: DEBUG nova.compute.manager [None req-974d7955-dda8-470b-bec6-b6086fa3cf11 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:43:06 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:43:06 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:43:06 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 29 13:43:06 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638186.351922, b99a72ba-73e2-4be7-b52b-7797351daa5f => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:43:06 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] VM Started (Lifecycle Event)
Jul 29 13:43:06 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:43:06 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:43:06 user nova-compute[231753]: DEBUG nova.compute.manager [req-3eca0986-4fe9-444f-b317-d7b89696504f req-65a8cff6-0e9a-40b9-adb0-1f27f428da39 service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Received event network-vif-plugged-d145cf59-908e-42c4-ba8e-ce5abe640639 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:43:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3eca0986-4fe9-444f-b317-d7b89696504f req-65a8cff6-0e9a-40b9-adb0-1f27f428da39 service nova] Acquiring lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:43:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3eca0986-4fe9-444f-b317-d7b89696504f req-65a8cff6-0e9a-40b9-adb0-1f27f428da39 service nova] Lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:43:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3eca0986-4fe9-444f-b317-d7b89696504f req-65a8cff6-0e9a-40b9-adb0-1f27f428da39 service nova] Lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:43:06 user nova-compute[231753]: DEBUG nova.compute.manager [req-3eca0986-4fe9-444f-b317-d7b89696504f req-65a8cff6-0e9a-40b9-adb0-1f27f428da39 service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] No waiting events found dispatching network-vif-plugged-d145cf59-908e-42c4-ba8e-ce5abe640639 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:43:06 user nova-compute[231753]: WARNING nova.compute.manager [req-3eca0986-4fe9-444f-b317-d7b89696504f req-65a8cff6-0e9a-40b9-adb0-1f27f428da39 service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Received unexpected event network-vif-plugged-d145cf59-908e-42c4-ba8e-ce5abe640639 for instance with vm_state rescued and task_state None.
Jul 29 13:43:06 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:08 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:43:08 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 13:43:08 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:08 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:09 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:43:09 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:43:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:43:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:43:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:43:09 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 13:43:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:43:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:43:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk --force-share --output=json" returned: 0 in 0.180s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk.rescue --force-share --output=json" returned: 0 in 0.172s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk.rescue --force-share --output=json" returned: 0 in 0.159s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json" returned: 0 in 0.156s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json" returned: 0 in 0.160s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:11 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690638176.847708, 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:43:11 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] VM Stopped (Lifecycle Event)
Jul 29 13:43:11 user nova-compute[231753]: DEBUG nova.compute.manager [None req-e444ab4b-e87c-4125-b134-2364da6ac448 None None] [instance: 627b7a4c-11c1-4fd9-b13a-8cde22d1ccfb] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:43:11 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:43:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b99a72ba-73e2-4be7-b52b-7797351daa5f/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b99a72ba-73e2-4be7-b52b-7797351daa5f/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b99a72ba-73e2-4be7-b52b-7797351daa5f/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b99a72ba-73e2-4be7-b52b-7797351daa5f/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:43:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:43:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk.rescue --force-share --output=json" returned: 0 in 0.138s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:13 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:14 user nova-compute[231753]: DEBUG nova.compute.manager [req-31c1c392-d3c1-4148-9085-9476e1b6e064 req-6979c020-f0f6-4038-8a8a-a9e7438dbeff service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Received event network-changed-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:43:14 user nova-compute[231753]: DEBUG nova.compute.manager [req-31c1c392-d3c1-4148-9085-9476e1b6e064 req-6979c020-f0f6-4038-8a8a-a9e7438dbeff service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Refreshing instance network info cache due to event network-changed-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:43:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-31c1c392-d3c1-4148-9085-9476e1b6e064 req-6979c020-f0f6-4038-8a8a-a9e7438dbeff service nova] Acquiring lock "refresh_cache-8dd26572-fe6a-40fd-8c58-6af862b340c4" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:43:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-31c1c392-d3c1-4148-9085-9476e1b6e064 req-6979c020-f0f6-4038-8a8a-a9e7438dbeff service nova] Acquired lock "refresh_cache-8dd26572-fe6a-40fd-8c58-6af862b340c4" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:43:14 user nova-compute[231753]: DEBUG nova.network.neutron [req-31c1c392-d3c1-4148-9085-9476e1b6e064 req-6979c020-f0f6-4038-8a8a-a9e7438dbeff service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Refreshing network info cache for port ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:43:14 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:43:14 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:43:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=7115MB free_disk=25.098342895507812GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 13:43:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:43:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:43:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:43:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 7e2615c1-b03e-4076-bcd9-3585fb11b8ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:43:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8ea52d41-7ec3-44d7-8421-133000ee887b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:43:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance cf326e80-7293-4764-9411-ed05a5aeba23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:43:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 55bfcd1f-2b51-4e10-84a3-e132b96111e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:43:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 481435b2-4319-4caf-aa5b-5c986a747258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:43:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 576f5002-4e4d-4236-8b0f-9b8788246de2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:43:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b99a72ba-73e2-4be7-b52b-7797351daa5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:43:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8dd26572-fe6a-40fd-8c58-6af862b340c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:43:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance f62c7904-d9d1-4bfc-bef8-9b1c241134f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:43:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 37fbc873-537c-4bbc-a57b-2c44e47ecf30 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:43:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 13:43:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 13:43:14 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:43:14 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:43:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 13:43:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.759s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:43:15 user nova-compute[231753]: DEBUG nova.network.neutron [req-31c1c392-d3c1-4148-9085-9476e1b6e064 req-6979c020-f0f6-4038-8a8a-a9e7438dbeff service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Updated VIF entry in instance network info cache for port ef3e2ca8-6228-4cd8-b815-d06cf34e15e0. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:43:15 user nova-compute[231753]: DEBUG nova.network.neutron [req-31c1c392-d3c1-4148-9085-9476e1b6e064 req-6979c020-f0f6-4038-8a8a-a9e7438dbeff service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Updating instance_info_cache with network_info: [{"id": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "address": "fa:16:3e:a7:22:05", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3e2ca8-62", "ovs_interfaceid": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:43:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-31c1c392-d3c1-4148-9085-9476e1b6e064 req-6979c020-f0f6-4038-8a8a-a9e7438dbeff service nova] Releasing lock "refresh_cache-8dd26572-fe6a-40fd-8c58-6af862b340c4" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:43:15 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:43:15 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:43:15 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 13:43:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "refresh_cache-8ea52d41-7ec3-44d7-8421-133000ee887b" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:43:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquired lock "refresh_cache-8ea52d41-7ec3-44d7-8421-133000ee887b" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:43:16 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Forcefully refreshing network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 13:43:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:16 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Updating instance_info_cache with network_info: [{"id": "4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b", "address": "fa:16:3e:33:76:ce", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed7b5c5-f0", "ovs_interfaceid": "4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:43:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Releasing lock "refresh_cache-8ea52d41-7ec3-44d7-8421-133000ee887b" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:43:16 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Updated the network info_cache for instance {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 13:43:16 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:43:16 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:43:16 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:43:16 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:43:16 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:43:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:18 user nova-compute[231753]: INFO nova.compute.manager [None req-900acd97-b9f7-441c-bff4-0047b67374a6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Unrescuing
Jul 29 13:43:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-900acd97-b9f7-441c-bff4-0047b67374a6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "refresh_cache-7e2615c1-b03e-4076-bcd9-3585fb11b8ac" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:43:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-900acd97-b9f7-441c-bff4-0047b67374a6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquired lock "refresh_cache-7e2615c1-b03e-4076-bcd9-3585fb11b8ac" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:43:18 user nova-compute[231753]: DEBUG nova.network.neutron [None req-900acd97-b9f7-441c-bff4-0047b67374a6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG nova.network.neutron [None req-900acd97-b9f7-441c-bff4-0047b67374a6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Updating instance_info_cache with network_info: [{"id": "8c8e51fe-0d15-4a27-8215-dc512b6816f5", "address": "fa:16:3e:3e:10:27", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e51fe-0d", "ovs_interfaceid": "8c8e51fe-0d15-4a27-8215-dc512b6816f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-900acd97-b9f7-441c-bff4-0047b67374a6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Releasing lock "refresh_cache-7e2615c1-b03e-4076-bcd9-3585fb11b8ac" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG nova.objects.instance [None req-900acd97-b9f7-441c-bff4-0047b67374a6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lazy-loading 'flavor' on Instance uuid 7e2615c1-b03e-4076-bcd9-3585fb11b8ac {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "8dd26572-fe6a-40fd-8c58-6af862b340c4" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG nova.objects.instance [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lazy-loading 'flavor' on Instance uuid 8dd26572-fe6a-40fd-8c58-6af862b340c4 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.096s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "8dd26572-fe6a-40fd-8c58-6af862b340c4" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:43:19 user nova-compute[231753]: INFO nova.compute.manager [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Attaching volume c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 to /dev/vdb
Jul 29 13:43:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG os_brick.utils [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ed080c-2f09-488d-9b16-0323a578b62e]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[61b3d93b-ebb0-45b8-bced-1e4a9cae1930]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2f1e13-999f-41b2-9cdf-b8a9443d4811]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[11205f58-99e4-4ef1-9e05-a713a57f09be]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:43:19 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:43:19 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e64b0bbe-0aee-474e-bb08-98ea0408d508]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG os_brick.utils [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Updating existing volume attachment record: 5a381ed7-603e-446f-a10e-18b6668519f0 {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG nova.compute.manager [req-974f9613-2b25-47a1-b5b5-2b4385ab72e9 req-2c9a8713-dd8e-46dd-a995-2a72ccccf650 service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Received event network-vif-unplugged-8c8e51fe-0d15-4a27-8215-dc512b6816f5 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-974f9613-2b25-47a1-b5b5-2b4385ab72e9 req-2c9a8713-dd8e-46dd-a995-2a72ccccf650 service nova] Acquiring lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-974f9613-2b25-47a1-b5b5-2b4385ab72e9 req-2c9a8713-dd8e-46dd-a995-2a72ccccf650 service nova] Lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-974f9613-2b25-47a1-b5b5-2b4385ab72e9 req-2c9a8713-dd8e-46dd-a995-2a72ccccf650 service nova] Lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:43:19 user nova-compute[231753]: DEBUG nova.compute.manager [req-974f9613-2b25-47a1-b5b5-2b4385ab72e9 req-2c9a8713-dd8e-46dd-a995-2a72ccccf650 service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] No waiting events found dispatching network-vif-unplugged-8c8e51fe-0d15-4a27-8215-dc512b6816f5 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:43:19 user nova-compute[231753]: WARNING nova.compute.manager [req-974f9613-2b25-47a1-b5b5-2b4385ab72e9 req-2c9a8713-dd8e-46dd-a995-2a72ccccf650 service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Received unexpected event network-vif-unplugged-8c8e51fe-0d15-4a27-8215-dc512b6816f5 for instance with vm_state rescued and task_state unrescuing.
Jul 29 13:43:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:20 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Instance destroyed successfully.
Jul 29 13:43:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:21 user nova-compute[231753]: DEBUG nova.compute.manager [req-5c45aba2-2e33-4c59-bb5d-86cddce6c142 req-1b3fd9d8-9448-4e8f-99b9-00b374e6a476 service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Received event network-vif-plugged-8c8e51fe-0d15-4a27-8215-dc512b6816f5 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:43:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5c45aba2-2e33-4c59-bb5d-86cddce6c142 req-1b3fd9d8-9448-4e8f-99b9-00b374e6a476 service nova] Acquiring lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:43:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5c45aba2-2e33-4c59-bb5d-86cddce6c142 req-1b3fd9d8-9448-4e8f-99b9-00b374e6a476 service nova] Lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:43:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5c45aba2-2e33-4c59-bb5d-86cddce6c142 req-1b3fd9d8-9448-4e8f-99b9-00b374e6a476 service nova] Lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:43:21 user nova-compute[231753]: DEBUG nova.compute.manager [req-5c45aba2-2e33-4c59-bb5d-86cddce6c142 req-1b3fd9d8-9448-4e8f-99b9-00b374e6a476 service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] No waiting events found dispatching network-vif-plugged-8c8e51fe-0d15-4a27-8215-dc512b6816f5 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:43:21 user nova-compute[231753]: WARNING nova.compute.manager [req-5c45aba2-2e33-4c59-bb5d-86cddce6c142 req-1b3fd9d8-9448-4e8f-99b9-00b374e6a476 service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Received unexpected event network-vif-plugged-8c8e51fe-0d15-4a27-8215-dc512b6816f5 for instance with vm_state rescued and task_state unrescuing.
Jul 29 13:43:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Removed pending event for 7e2615c1-b03e-4076-bcd9-3585fb11b8ac due to event {{(pid=231753) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 29 13:43:23 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638203.5464938, 7e2615c1-b03e-4076-bcd9-3585fb11b8ac => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:43:23 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] VM Resumed (Lifecycle Event)
Jul 29 13:43:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-900acd97-b9f7-441c-bff4-0047b67374a6 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:43:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:43:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:43:23 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 29 13:43:23 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638203.5512152, 7e2615c1-b03e-4076-bcd9-3585fb11b8ac => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:43:23 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] VM Started (Lifecycle Event)
Jul 29 13:43:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:43:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:43:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:24 user nova-compute[231753]: DEBUG nova.compute.manager [req-c30a808e-dc7b-4553-8fa2-9e63f84e690a req-1c9454c7-18a1-4b99-bbba-2d490fdd723a service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Received event network-vif-plugged-8c8e51fe-0d15-4a27-8215-dc512b6816f5 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:43:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c30a808e-dc7b-4553-8fa2-9e63f84e690a req-1c9454c7-18a1-4b99-bbba-2d490fdd723a service nova] Acquiring lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:43:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c30a808e-dc7b-4553-8fa2-9e63f84e690a req-1c9454c7-18a1-4b99-bbba-2d490fdd723a service nova] Lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:43:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c30a808e-dc7b-4553-8fa2-9e63f84e690a req-1c9454c7-18a1-4b99-bbba-2d490fdd723a service nova] Lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:43:24 user nova-compute[231753]: DEBUG nova.compute.manager [req-c30a808e-dc7b-4553-8fa2-9e63f84e690a req-1c9454c7-18a1-4b99-bbba-2d490fdd723a service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] No waiting events found dispatching network-vif-plugged-8c8e51fe-0d15-4a27-8215-dc512b6816f5 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:43:24 user nova-compute[231753]: WARNING nova.compute.manager [req-c30a808e-dc7b-4553-8fa2-9e63f84e690a req-1c9454c7-18a1-4b99-bbba-2d490fdd723a service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Received unexpected event network-vif-plugged-8c8e51fe-0d15-4a27-8215-dc512b6816f5 for instance with vm_state active and task_state None.
Jul 29 13:43:24 user nova-compute[231753]: DEBUG nova.compute.manager [req-c30a808e-dc7b-4553-8fa2-9e63f84e690a req-1c9454c7-18a1-4b99-bbba-2d490fdd723a service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Received event network-vif-plugged-8c8e51fe-0d15-4a27-8215-dc512b6816f5 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:43:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c30a808e-dc7b-4553-8fa2-9e63f84e690a req-1c9454c7-18a1-4b99-bbba-2d490fdd723a service nova] Acquiring lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:43:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c30a808e-dc7b-4553-8fa2-9e63f84e690a req-1c9454c7-18a1-4b99-bbba-2d490fdd723a service nova] Lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:43:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c30a808e-dc7b-4553-8fa2-9e63f84e690a req-1c9454c7-18a1-4b99-bbba-2d490fdd723a service nova] Lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:43:24 user nova-compute[231753]: DEBUG nova.compute.manager [req-c30a808e-dc7b-4553-8fa2-9e63f84e690a req-1c9454c7-18a1-4b99-bbba-2d490fdd723a service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] No waiting events found dispatching network-vif-plugged-8c8e51fe-0d15-4a27-8215-dc512b6816f5 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:43:24 user nova-compute[231753]: WARNING nova.compute.manager [req-c30a808e-dc7b-4553-8fa2-9e63f84e690a req-1c9454c7-18a1-4b99-bbba-2d490fdd723a service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Received unexpected event network-vif-plugged-8c8e51fe-0d15-4a27-8215-dc512b6816f5 for instance with vm_state active and task_state None.
Jul 29 13:43:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QAgBpCbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:43:29 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:43:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:43:29 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:43:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:43:29 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:43:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[98af03fd-dec9-42e4-a490-12ba4165afa2]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:43:29 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[600b2b2d-6209-43c6-bd44-9adbb6646c53]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5] added
Jul 29 13:43:29 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[171344e2-26dd-4c54-b428-e12a18989a2e]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b12a7a1e-6c49-4c97-ab6a-6c8f499715d1]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QAgBpCbc {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QAgBpCbc" returned: 0 in 0.035s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d24da30-44e1-4129-87a6-a8cf5aa50715]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QAgBpCbc'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[38d7755a-5981-46ad-a853-5df6f5e165f7]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3a70fce-f228-4386-8c7e-e455cb7cfd06]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:43:29 user nova-compute[231753]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:43:29 user nova-compute[231753]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)
Jul 29 13:43:29 user nova-compute[231753]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:43:29 user nova-compute[231753]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)
Jul 29 13:43:29 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:43:29 user nova-compute[231753]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:43:29 user nova-compute[231753]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)
Jul 29 13:43:29 user nova-compute[231753]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:43:29 user nova-compute[231753]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)
Jul 29 13:43:29 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --login" returned: 0 in 0.104s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[da0eafcd-0f49-44f3-9e16-0b36fb25f96a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5, portal: 172.16.0.220,3260]
Jul 29 13:43:29 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5, portal: 172.16.0.220,3260] successful.
Jul 29 13:43:29 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[324e7170-58ae-45e8-86cd-fe6fe5969a23]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[74cd24ff-8f75-4c4b-8494-f42dd65bbc1e]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:43:29 user nova-compute[231753]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:43:29 user nova-compute[231753]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)
Jul 29 13:43:29 user nova-compute[231753]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:43:29 user nova-compute[231753]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)
Jul 29 13:43:29 user nova-compute[231753]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)
Jul 29 13:43:29 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:43:29 user nova-compute[231753]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:43:29 user nova-compute[231753]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)
Jul 29 13:43:29 user nova-compute[231753]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:43:29 user nova-compute[231753]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)
Jul 29 13:43:29 user nova-compute[231753]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)
Jul 29 13:43:29 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.376s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] HCTL ('38', '-', '-', 0) found on session 29 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3cf8f99-2917-483f-ad90-e73c2e4f3fed]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Searching for a device in session 29 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:43:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QAgBpCbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:43:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.420s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:43:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] <== connect_volume: return (1421ms) {'type': 'block', 'scsi_wwn': '23437353263336462', 'path': '/dev/sdg'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:43:30 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437353263336462', 'path': '/dev/sdg'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:43:30 user nova-compute[231753]: DEBUG nova.objects.instance [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lazy-loading 'flavor' on Instance uuid 8dd26572-fe6a-40fd-8c58-6af862b340c4 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:43:30 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 13:43:30 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:43:30 user nova-compute[231753]:   <source dev="/dev/sdg"/>
Jul 29 13:43:30 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:43:30 user nova-compute[231753]:   <serial>c520bfb3-fffc-4de5-91c1-a2d62e91c2b5</serial>
Jul 29 13:43:30 user nova-compute[231753]: </disk>
Jul 29 13:43:30 user nova-compute[231753]:  {{(pid=231753) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 13:43:31 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:43:31 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] No BDM found with device name vdb, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:43:31 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] No VIF found with MAC fa:16:3e:a7:22:05, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:43:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1f9abd8f-1dbb-4d83-8779-c5522509811b tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.083s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:43:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-84195afb-020a-4ce8-945c-cdc7accd9c5e tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "8dd26572-fe6a-40fd-8c58-6af862b340c4" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:43:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-84195afb-020a-4ce8-945c-cdc7accd9c5e tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:43:32 user nova-compute[231753]: DEBUG nova.compute.manager [None req-84195afb-020a-4ce8-945c-cdc7accd9c5e tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:43:32 user nova-compute[231753]: DEBUG nova.compute.manager [None req-84195afb-020a-4ce8-945c-cdc7accd9c5e tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=231753) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Jul 29 13:43:32 user nova-compute[231753]: DEBUG nova.objects.instance [None req-84195afb-020a-4ce8-945c-cdc7accd9c5e tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lazy-loading 'flavor' on Instance uuid 8dd26572-fe6a-40fd-8c58-6af862b340c4 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:43:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:33 user nova-compute[231753]: DEBUG nova.compute.manager [req-08523204-8334-4ab1-b3c5-539586de32d2 req-76381b6b-34b8-476b-8fa2-b1f9fdeddbab service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Received event network-vif-unplugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:43:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-08523204-8334-4ab1-b3c5-539586de32d2 req-76381b6b-34b8-476b-8fa2-b1f9fdeddbab service nova] Acquiring lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:43:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-08523204-8334-4ab1-b3c5-539586de32d2 req-76381b6b-34b8-476b-8fa2-b1f9fdeddbab service nova] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:43:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-08523204-8334-4ab1-b3c5-539586de32d2 req-76381b6b-34b8-476b-8fa2-b1f9fdeddbab service nova] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:43:33 user nova-compute[231753]: DEBUG nova.compute.manager [req-08523204-8334-4ab1-b3c5-539586de32d2 req-76381b6b-34b8-476b-8fa2-b1f9fdeddbab service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] No waiting events found dispatching network-vif-unplugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:43:33 user nova-compute[231753]: WARNING nova.compute.manager [req-08523204-8334-4ab1-b3c5-539586de32d2 req-76381b6b-34b8-476b-8fa2-b1f9fdeddbab service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Received unexpected event network-vif-unplugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 for instance with vm_state active and task_state powering-off.
Jul 29 13:43:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Acquiring lock "91a2fb70-1fc7-475b-af56-6cff04794ef7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:43:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Lock "91a2fb70-1fc7-475b-af56-6cff04794ef7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:43:33 user nova-compute[231753]: DEBUG nova.compute.manager [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:43:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:43:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:43:33 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:43:33 user nova-compute[231753]: INFO nova.compute.claims [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Claim successful on node user
Jul 29 13:43:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:33 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Instance destroyed successfully.
Jul 29 13:43:33 user nova-compute[231753]: DEBUG nova.compute.manager [None req-84195afb-020a-4ce8-945c-cdc7accd9c5e tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:43:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-84195afb-020a-4ce8-945c-cdc7accd9c5e tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 0.971s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:43:34 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:43:34 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:43:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.572s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:43:34 user nova-compute[231753]: DEBUG nova.compute.manager [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:43:34 user nova-compute[231753]: DEBUG nova.compute.manager [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:43:34 user nova-compute[231753]: DEBUG nova.network.neutron [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:43:34 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:43:34 user nova-compute[231753]: DEBUG nova.compute.manager [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:43:34 user nova-compute[231753]: DEBUG nova.policy [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'cc6d5982e15c447c8fb846d125948a3b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2cf21430995e4002851510b0a609b32e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:43:34 user nova-compute[231753]: DEBUG nova.compute.manager [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:43:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:43:34 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Creating image(s)
Jul 29 13:43:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Acquiring lock "/opt/stack/data/nova/instances/91a2fb70-1fc7-475b-af56-6cff04794ef7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:43:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Lock "/opt/stack/data/nova/instances/91a2fb70-1fc7-475b-af56-6cff04794ef7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:43:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Lock "/opt/stack/data/nova/instances/91a2fb70-1fc7-475b-af56-6cff04794ef7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:43:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.149s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:43:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:43:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.165s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/91a2fb70-1fc7-475b-af56-6cff04794ef7/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/91a2fb70-1fc7-475b-af56-6cff04794ef7/disk 1073741824" returned: 0 in 0.059s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.236s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:43:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.199s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:34 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Checking if we can resize image /opt/stack/data/nova/instances/91a2fb70-1fc7-475b-af56-6cff04794ef7/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:43:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a2fb70-1fc7-475b-af56-6cff04794ef7/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:35 user nova-compute[231753]: DEBUG nova.network.neutron [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Successfully created port: c517e924-5a02-4b05-8e1e-ae1ff75e6d82 {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:43:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a2fb70-1fc7-475b-af56-6cff04794ef7/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:35 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Cannot resize image /opt/stack/data/nova/instances/91a2fb70-1fc7-475b-af56-6cff04794ef7/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:43:35 user nova-compute[231753]: DEBUG nova.objects.instance [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Lazy-loading 'migration_context' on Instance uuid 91a2fb70-1fc7-475b-af56-6cff04794ef7 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:43:35 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:43:35 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Ensure instance console log exists: /opt/stack/data/nova/instances/91a2fb70-1fc7-475b-af56-6cff04794ef7/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:43:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:43:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:43:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:43:35 user nova-compute[231753]: DEBUG nova.compute.manager [req-0fd1e38a-92c0-441d-a6b2-05f58494d41e req-93119bdb-99fb-4acc-8c50-ca1c9ca6ee34 service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Received event network-vif-plugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:43:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0fd1e38a-92c0-441d-a6b2-05f58494d41e req-93119bdb-99fb-4acc-8c50-ca1c9ca6ee34 service nova] Acquiring lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:43:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0fd1e38a-92c0-441d-a6b2-05f58494d41e req-93119bdb-99fb-4acc-8c50-ca1c9ca6ee34 service nova] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:43:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0fd1e38a-92c0-441d-a6b2-05f58494d41e req-93119bdb-99fb-4acc-8c50-ca1c9ca6ee34 service nova] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:43:35 user nova-compute[231753]: DEBUG nova.compute.manager [req-0fd1e38a-92c0-441d-a6b2-05f58494d41e req-93119bdb-99fb-4acc-8c50-ca1c9ca6ee34 service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] No waiting events found dispatching network-vif-plugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:43:35 user nova-compute[231753]: WARNING nova.compute.manager [req-0fd1e38a-92c0-441d-a6b2-05f58494d41e req-93119bdb-99fb-4acc-8c50-ca1c9ca6ee34 service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Received unexpected event network-vif-plugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 for instance with vm_state stopped and task_state None.
Jul 29 13:43:36 user nova-compute[231753]: DEBUG nova.network.neutron [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Successfully updated port: c517e924-5a02-4b05-8e1e-ae1ff75e6d82 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Acquiring lock "refresh_cache-91a2fb70-1fc7-475b-af56-6cff04794ef7" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Acquired lock "refresh_cache-91a2fb70-1fc7-475b-af56-6cff04794ef7" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG nova.network.neutron [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG nova.compute.manager [req-7dd55f01-f6b9-4655-8491-0b905cda32c6 req-225fa158-b66a-4b19-a2c9-0895970f1cd8 service nova] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Received event network-changed-c517e924-5a02-4b05-8e1e-ae1ff75e6d82 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG nova.compute.manager [req-7dd55f01-f6b9-4655-8491-0b905cda32c6 req-225fa158-b66a-4b19-a2c9-0895970f1cd8 service nova] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Refreshing instance network info cache due to event network-changed-c517e924-5a02-4b05-8e1e-ae1ff75e6d82. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7dd55f01-f6b9-4655-8491-0b905cda32c6 req-225fa158-b66a-4b19-a2c9-0895970f1cd8 service nova] Acquiring lock "refresh_cache-91a2fb70-1fc7-475b-af56-6cff04794ef7" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG nova.network.neutron [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG nova.network.neutron [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Updating instance_info_cache with network_info: [{"id": "c517e924-5a02-4b05-8e1e-ae1ff75e6d82", "address": "fa:16:3e:5b:0f:36", "network": {"id": "0a5ae49f-57e8-4915-b0ce-78599a8fecd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1637833367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cf21430995e4002851510b0a609b32e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc517e924-5a", "ovs_interfaceid": "c517e924-5a02-4b05-8e1e-ae1ff75e6d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Releasing lock "refresh_cache-91a2fb70-1fc7-475b-af56-6cff04794ef7" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG nova.compute.manager [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Instance network_info: |[{"id": "c517e924-5a02-4b05-8e1e-ae1ff75e6d82", "address": "fa:16:3e:5b:0f:36", "network": {"id": "0a5ae49f-57e8-4915-b0ce-78599a8fecd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1637833367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cf21430995e4002851510b0a609b32e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc517e924-5a", "ovs_interfaceid": "c517e924-5a02-4b05-8e1e-ae1ff75e6d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7dd55f01-f6b9-4655-8491-0b905cda32c6 req-225fa158-b66a-4b19-a2c9-0895970f1cd8 service nova] Acquired lock "refresh_cache-91a2fb70-1fc7-475b-af56-6cff04794ef7" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG nova.network.neutron [req-7dd55f01-f6b9-4655-8491-0b905cda32c6 req-225fa158-b66a-4b19-a2c9-0895970f1cd8 service nova] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Refreshing network info cache for port c517e924-5a02-4b05-8e1e-ae1ff75e6d82 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Start _get_guest_xml network_info=[{"id": "c517e924-5a02-4b05-8e1e-ae1ff75e6d82", "address": "fa:16:3e:5b:0f:36", "network": {"id": "0a5ae49f-57e8-4915-b0ce-78599a8fecd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1637833367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cf21430995e4002851510b0a609b32e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc517e924-5a", "ovs_interfaceid": "c517e924-5a02-4b05-8e1e-ae1ff75e6d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:43:36 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:43:36 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:43:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:43:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1108088075',display_name='tempest-VolumesActionsTest-instance-1108088075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1108088075',id=28,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2cf21430995e4002851510b0a609b32e',ramdisk_id='',reservation_id='r-lfvh6npi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-984220826',owner_user_name='tempest-VolumesActionsTest-984220826-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:43:34Z,user_data=None,user_id='cc6d5982e15c447c8fb846d125948a3b',uuid=91a2fb70-1fc7-475b-af56-6cff04794ef7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c517e924-5a02-4b05-8e1e-ae1ff75e6d82", "address": "fa:16:3e:5b:0f:36", "network": {"id": "0a5ae49f-57e8-4915-b0ce-78599a8fecd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1637833367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cf21430995e4002851510b0a609b32e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc517e924-5a", "ovs_interfaceid": "c517e924-5a02-4b05-8e1e-ae1ff75e6d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Converting VIF {"id": "c517e924-5a02-4b05-8e1e-ae1ff75e6d82", "address": "fa:16:3e:5b:0f:36", "network": {"id": "0a5ae49f-57e8-4915-b0ce-78599a8fecd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1637833367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cf21430995e4002851510b0a609b32e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc517e924-5a", "ovs_interfaceid": "c517e924-5a02-4b05-8e1e-ae1ff75e6d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:0f:36,bridge_name='br-int',has_traffic_filtering=True,id=c517e924-5a02-4b05-8e1e-ae1ff75e6d82,network=Network(0a5ae49f-57e8-4915-b0ce-78599a8fecd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc517e924-5a') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG nova.objects.instance [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Lazy-loading 'pci_devices' on Instance uuid 91a2fb70-1fc7-475b-af56-6cff04794ef7 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:43:36 user nova-compute[231753]:   <uuid>91a2fb70-1fc7-475b-af56-6cff04794ef7</uuid>
Jul 29 13:43:36 user nova-compute[231753]:   <name>instance-0000001c</name>
Jul 29 13:43:36 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:43:36 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:43:36 user nova-compute[231753]:   <metadata>
Jul 29 13:43:36 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:43:36 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:43:36 user nova-compute[231753]:       <nova:name>tempest-VolumesActionsTest-instance-1108088075</nova:name>
Jul 29 13:43:36 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:43:36</nova:creationTime>
Jul 29 13:43:36 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:43:36 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:43:36 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:43:36 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:43:36 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:43:36 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:43:36 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:43:36 user nova-compute[231753]:       <nova:owner>
Jul 29 13:43:36 user nova-compute[231753]:         <nova:user uuid="cc6d5982e15c447c8fb846d125948a3b">tempest-VolumesActionsTest-984220826-project-member</nova:user>
Jul 29 13:43:36 user nova-compute[231753]:         <nova:project uuid="2cf21430995e4002851510b0a609b32e">tempest-VolumesActionsTest-984220826</nova:project>
Jul 29 13:43:36 user nova-compute[231753]:       </nova:owner>
Jul 29 13:43:36 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:43:36 user nova-compute[231753]:       <nova:ports>
Jul 29 13:43:36 user nova-compute[231753]:         <nova:port uuid="c517e924-5a02-4b05-8e1e-ae1ff75e6d82">
Jul 29 13:43:36 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 29 13:43:36 user nova-compute[231753]:         </nova:port>
Jul 29 13:43:36 user nova-compute[231753]:       </nova:ports>
Jul 29 13:43:36 user nova-compute[231753]:     </nova:instance>
Jul 29 13:43:36 user nova-compute[231753]:   </metadata>
Jul 29 13:43:36 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:43:36 user nova-compute[231753]:     <system>
Jul 29 13:43:36 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:43:36 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:43:36 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:43:36 user nova-compute[231753]:       <entry name="serial">91a2fb70-1fc7-475b-af56-6cff04794ef7</entry>
Jul 29 13:43:36 user nova-compute[231753]:       <entry name="uuid">91a2fb70-1fc7-475b-af56-6cff04794ef7</entry>
Jul 29 13:43:36 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:43:36 user nova-compute[231753]:     </system>
Jul 29 13:43:36 user nova-compute[231753]:   </sysinfo>
Jul 29 13:43:36 user nova-compute[231753]:   <os>
Jul 29 13:43:36 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:43:36 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:43:36 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:43:36 user nova-compute[231753]:   </os>
Jul 29 13:43:36 user nova-compute[231753]:   <features>
Jul 29 13:43:36 user nova-compute[231753]:     <acpi/>
Jul 29 13:43:36 user nova-compute[231753]:     <apic/>
Jul 29 13:43:36 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:43:36 user nova-compute[231753]:   </features>
Jul 29 13:43:36 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:43:36 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:43:36 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:43:36 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:43:36 user nova-compute[231753]:   </clock>
Jul 29 13:43:36 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:43:36 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:43:36 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:43:36 user nova-compute[231753]:   </cpu>
Jul 29 13:43:36 user nova-compute[231753]:   <devices>
Jul 29 13:43:36 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:43:36 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:43:36 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/91a2fb70-1fc7-475b-af56-6cff04794ef7/disk"/>
Jul 29 13:43:36 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:43:36 user nova-compute[231753]:     </disk>
Jul 29 13:43:36 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:43:36 user nova-compute[231753]:       <mac address="fa:16:3e:5b:0f:36"/>
Jul 29 13:43:36 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:43:36 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:43:36 user nova-compute[231753]:       <target dev="tapc517e924-5a"/>
Jul 29 13:43:36 user nova-compute[231753]:     </interface>
Jul 29 13:43:36 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:43:36 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/91a2fb70-1fc7-475b-af56-6cff04794ef7/console.log" append="off"/>
Jul 29 13:43:36 user nova-compute[231753]:     </serial>
Jul 29 13:43:36 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:43:36 user nova-compute[231753]:     <video>
Jul 29 13:43:36 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:43:36 user nova-compute[231753]:     </video>
Jul 29 13:43:36 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:43:36 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:43:36 user nova-compute[231753]:     </rng>
Jul 29 13:43:36 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:43:36 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:43:36 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:43:36 user nova-compute[231753]:     </memballoon>
Jul 29 13:43:36 user nova-compute[231753]:   </devices>
Jul 29 13:43:36 user nova-compute[231753]: </domain>
Jul 29 13:43:36 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:43:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1108088075',display_name='tempest-VolumesActionsTest-instance-1108088075',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1108088075',id=28,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='2cf21430995e4002851510b0a609b32e',ramdisk_id='',reservation_id='r-lfvh6npi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-984220826',owner_user_name='tempest-VolumesActionsTest-984220826-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:43:34Z,user_data=None,user_id='cc6d5982e15c447c8fb846d125948a3b',uuid=91a2fb70-1fc7-475b-af56-6cff04794ef7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c517e924-5a02-4b05-8e1e-ae1ff75e6d82", "address": "fa:16:3e:5b:0f:36", "network": {"id": "0a5ae49f-57e8-4915-b0ce-78599a8fecd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1637833367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cf21430995e4002851510b0a609b32e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc517e924-5a", "ovs_interfaceid": "c517e924-5a02-4b05-8e1e-ae1ff75e6d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Converting VIF {"id": "c517e924-5a02-4b05-8e1e-ae1ff75e6d82", "address": "fa:16:3e:5b:0f:36", "network": {"id": "0a5ae49f-57e8-4915-b0ce-78599a8fecd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1637833367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cf21430995e4002851510b0a609b32e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc517e924-5a", "ovs_interfaceid": "c517e924-5a02-4b05-8e1e-ae1ff75e6d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:0f:36,bridge_name='br-int',has_traffic_filtering=True,id=c517e924-5a02-4b05-8e1e-ae1ff75e6d82,network=Network(0a5ae49f-57e8-4915-b0ce-78599a8fecd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc517e924-5a') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG os_vif [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:0f:36,bridge_name='br-int',has_traffic_filtering=True,id=c517e924-5a02-4b05-8e1e-ae1ff75e6d82,network=Network(0a5ae49f-57e8-4915-b0ce-78599a8fecd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc517e924-5a') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc517e924-5a, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc517e924-5a, col_values=(('external_ids', {'iface-id': 'c517e924-5a02-4b05-8e1e-ae1ff75e6d82', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5b:0f:36', 'vm-uuid': '91a2fb70-1fc7-475b-af56-6cff04794ef7'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:36 user nova-compute[231753]: INFO os_vif [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:0f:36,bridge_name='br-int',has_traffic_filtering=True,id=c517e924-5a02-4b05-8e1e-ae1ff75e6d82,network=Network(0a5ae49f-57e8-4915-b0ce-78599a8fecd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc517e924-5a')
Jul 29 13:43:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:43:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] No VIF found with MAC fa:16:3e:5b:0f:36, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:43:37 user nova-compute[231753]: DEBUG nova.network.neutron [req-7dd55f01-f6b9-4655-8491-0b905cda32c6 req-225fa158-b66a-4b19-a2c9-0895970f1cd8 service nova] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Updated VIF entry in instance network info cache for port c517e924-5a02-4b05-8e1e-ae1ff75e6d82. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:43:37 user nova-compute[231753]: DEBUG nova.network.neutron [req-7dd55f01-f6b9-4655-8491-0b905cda32c6 req-225fa158-b66a-4b19-a2c9-0895970f1cd8 service nova] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Updating instance_info_cache with network_info: [{"id": "c517e924-5a02-4b05-8e1e-ae1ff75e6d82", "address": "fa:16:3e:5b:0f:36", "network": {"id": "0a5ae49f-57e8-4915-b0ce-78599a8fecd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1637833367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cf21430995e4002851510b0a609b32e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc517e924-5a", "ovs_interfaceid": "c517e924-5a02-4b05-8e1e-ae1ff75e6d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:43:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7dd55f01-f6b9-4655-8491-0b905cda32c6 req-225fa158-b66a-4b19-a2c9-0895970f1cd8 service nova] Releasing lock "refresh_cache-91a2fb70-1fc7-475b-af56-6cff04794ef7" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:43:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:38 user nova-compute[231753]: DEBUG nova.compute.manager [req-432eed91-5ecb-4716-8e10-a9edc7ba8187 req-a3106ec1-296f-43a4-8767-a3c7597a2e73 service nova] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Received event network-vif-plugged-c517e924-5a02-4b05-8e1e-ae1ff75e6d82 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:43:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-432eed91-5ecb-4716-8e10-a9edc7ba8187 req-a3106ec1-296f-43a4-8767-a3c7597a2e73 service nova] Acquiring lock "91a2fb70-1fc7-475b-af56-6cff04794ef7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:43:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-432eed91-5ecb-4716-8e10-a9edc7ba8187 req-a3106ec1-296f-43a4-8767-a3c7597a2e73 service nova] Lock "91a2fb70-1fc7-475b-af56-6cff04794ef7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:43:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-432eed91-5ecb-4716-8e10-a9edc7ba8187 req-a3106ec1-296f-43a4-8767-a3c7597a2e73 service nova] Lock "91a2fb70-1fc7-475b-af56-6cff04794ef7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:43:38 user nova-compute[231753]: DEBUG nova.compute.manager [req-432eed91-5ecb-4716-8e10-a9edc7ba8187 req-a3106ec1-296f-43a4-8767-a3c7597a2e73 service nova] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] No waiting events found dispatching network-vif-plugged-c517e924-5a02-4b05-8e1e-ae1ff75e6d82 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:43:38 user nova-compute[231753]: WARNING nova.compute.manager [req-432eed91-5ecb-4716-8e10-a9edc7ba8187 req-a3106ec1-296f-43a4-8767-a3c7597a2e73 service nova] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Received unexpected event network-vif-plugged-c517e924-5a02-4b05-8e1e-ae1ff75e6d82 for instance with vm_state building and task_state spawning.
Jul 29 13:43:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:40 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638220.5371497, 91a2fb70-1fc7-475b-af56-6cff04794ef7 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:43:40 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] VM Resumed (Lifecycle Event)
Jul 29 13:43:40 user nova-compute[231753]: DEBUG nova.compute.manager [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:43:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:43:40 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Instance spawned successfully.
Jul 29 13:43:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:43:40 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:43:40 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:43:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:43:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:43:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:43:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:43:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:43:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:43:40 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:43:40 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638220.5385098, 91a2fb70-1fc7-475b-af56-6cff04794ef7 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:43:40 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] VM Started (Lifecycle Event)
Jul 29 13:43:40 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:43:40 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:43:40 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:43:40 user nova-compute[231753]: INFO nova.compute.manager [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Took 6.35 seconds to spawn the instance on the hypervisor.
Jul 29 13:43:40 user nova-compute[231753]: DEBUG nova.compute.manager [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:43:40 user nova-compute[231753]: DEBUG nova.compute.manager [req-3e185abf-3c1a-43f2-a7cd-ef68809486c4 req-175a79ff-93b0-4006-b83e-686c407fb75c service nova] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Received event network-vif-plugged-c517e924-5a02-4b05-8e1e-ae1ff75e6d82 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:43:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3e185abf-3c1a-43f2-a7cd-ef68809486c4 req-175a79ff-93b0-4006-b83e-686c407fb75c service nova] Acquiring lock "91a2fb70-1fc7-475b-af56-6cff04794ef7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:43:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3e185abf-3c1a-43f2-a7cd-ef68809486c4 req-175a79ff-93b0-4006-b83e-686c407fb75c service nova] Lock "91a2fb70-1fc7-475b-af56-6cff04794ef7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:43:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3e185abf-3c1a-43f2-a7cd-ef68809486c4 req-175a79ff-93b0-4006-b83e-686c407fb75c service nova] Lock "91a2fb70-1fc7-475b-af56-6cff04794ef7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:43:40 user nova-compute[231753]: DEBUG nova.compute.manager [req-3e185abf-3c1a-43f2-a7cd-ef68809486c4 req-175a79ff-93b0-4006-b83e-686c407fb75c service nova] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] No waiting events found dispatching network-vif-plugged-c517e924-5a02-4b05-8e1e-ae1ff75e6d82 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:43:40 user nova-compute[231753]: WARNING nova.compute.manager [req-3e185abf-3c1a-43f2-a7cd-ef68809486c4 req-175a79ff-93b0-4006-b83e-686c407fb75c service nova] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Received unexpected event network-vif-plugged-c517e924-5a02-4b05-8e1e-ae1ff75e6d82 for instance with vm_state building and task_state spawning.
Jul 29 13:43:40 user nova-compute[231753]: INFO nova.compute.manager [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Took 7.27 seconds to build instance.
Jul 29 13:43:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0868f2d7-bae4-48e3-9fce-06d23b2ab352 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Lock "91a2fb70-1fc7-475b-af56-6cff04794ef7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.393s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:43:41 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:46 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-686eefad-7130-41e1-b6c4-ffa925a9189d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "481435b2-4319-4caf-aa5b-5c986a747258" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:43:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-686eefad-7130-41e1-b6c4-ffa925a9189d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "481435b2-4319-4caf-aa5b-5c986a747258" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:43:48 user nova-compute[231753]: INFO nova.compute.manager [None req-686eefad-7130-41e1-b6c4-ffa925a9189d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Detaching volume 27a0926a-875c-4f2d-bdcf-fce9178772b0
Jul 29 13:43:48 user nova-compute[231753]: INFO nova.virt.block_device [None req-686eefad-7130-41e1-b6c4-ffa925a9189d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Attempting to driver detach volume 27a0926a-875c-4f2d-bdcf-fce9178772b0 from mountpoint /dev/vdb
Jul 29 13:43:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-686eefad-7130-41e1-b6c4-ffa925a9189d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Attempting to detach device vdb from instance 481435b2-4319-4caf-aa5b-5c986a747258 from the persistent domain config. {{(pid=231753) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 13:43:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-686eefad-7130-41e1-b6c4-ffa925a9189d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:43:48 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:43:48 user nova-compute[231753]:   <source dev="/dev/sdc"/>
Jul 29 13:43:48 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:43:48 user nova-compute[231753]:   <serial>27a0926a-875c-4f2d-bdcf-fce9178772b0</serial>
Jul 29 13:43:48 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 13:43:48 user nova-compute[231753]: </disk>
Jul 29 13:43:48 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:43:48 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-686eefad-7130-41e1-b6c4-ffa925a9189d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Successfully detached device vdb from instance 481435b2-4319-4caf-aa5b-5c986a747258 from the persistent domain config.
Jul 29 13:43:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-686eefad-7130-41e1-b6c4-ffa925a9189d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 481435b2-4319-4caf-aa5b-5c986a747258 from the live domain config. {{(pid=231753) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 13:43:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-686eefad-7130-41e1-b6c4-ffa925a9189d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:43:48 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:43:48 user nova-compute[231753]:   <source dev="/dev/sdc"/>
Jul 29 13:43:48 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:43:48 user nova-compute[231753]:   <serial>27a0926a-875c-4f2d-bdcf-fce9178772b0</serial>
Jul 29 13:43:48 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 13:43:48 user nova-compute[231753]: </disk>
Jul 29 13:43:48 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:43:48 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690638213.6038067, 8dd26572-fe6a-40fd-8c58-6af862b340c4 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:43:48 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] VM Stopped (Lifecycle Event)
Jul 29 13:43:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:48 user nova-compute[231753]: DEBUG nova.compute.manager [None req-48910b46-417d-46f2-b0e3-fc4bcc911714 None None] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:43:48 user nova-compute[231753]: DEBUG nova.compute.manager [None req-48910b46-417d-46f2-b0e3-fc4bcc911714 None None] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:43:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Received event <DeviceRemovedEvent: 1690638228.868378, 481435b2-4319-4caf-aa5b-5c986a747258 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=231753) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 13:43:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-686eefad-7130-41e1-b6c4-ffa925a9189d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 481435b2-4319-4caf-aa5b-5c986a747258 {{(pid=231753) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 13:43:48 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-686eefad-7130-41e1-b6c4-ffa925a9189d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Successfully detached device vdb from instance 481435b2-4319-4caf-aa5b-5c986a747258 from the live domain config.
Jul 29 13:43:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-686eefad-7130-41e1-b6c4-ffa925a9189d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:43:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-686eefad-7130-41e1-b6c4-ffa925a9189d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yfIMhgvi', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:43:48 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-686eefad-7130-41e1-b6c4-ffa925a9189d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:43:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-686eefad-7130-41e1-b6c4-ffa925a9189d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:43:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-686eefad-7130-41e1-b6c4-ffa925a9189d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:43:48 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:48 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:48 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[595b71a9-c2b9-4624-919d-6b49f2d9c7d3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:43:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-686eefad-7130-41e1-b6c4-ffa925a9189d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:43:48 user nova-compute[231753]: No targets found.
Jul 29 13:43:48 user nova-compute[231753]: iSNS:
Jul 29 13:43:48 user nova-compute[231753]: No targets found.
Jul 29 13:43:48 user nova-compute[231753]: STATIC:
Jul 29 13:43:48 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea
Jul 29 13:43:48 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:43:48 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:43:48 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5
Jul 29 13:43:48 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:43:48 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:43:48 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0
Jul 29 13:43:48 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:43:48 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:43:48 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed
Jul 29 13:43:48 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:43:48 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:43:48 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef
Jul 29 13:43:48 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:43:48 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:43:48 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93
Jul 29 13:43:48 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:43:48 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:43:48 user nova-compute[231753]: FIRMWARE:
Jul 29 13:43:48 user nova-compute[231753]: No targets found.
Jul 29 13:43:48 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:43:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-686eefad-7130-41e1-b6c4-ffa925a9189d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:43:48 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:43:48 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:43:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-686eefad-7130-41e1-b6c4-ffa925a9189d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:43:48 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:48 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:48 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[504c720e-a8f6-4f43-aeea-b51e78672cdd]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:43:48 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:48 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:48 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[beb8eec9-010d-456c-bc2b-6459eb36984f]: (4, ('tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)\ntcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:43:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-686eefad-7130-41e1-b6c4-ffa925a9189d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:43:48 user nova-compute[231753]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:43:48 user nova-compute[231753]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)
Jul 29 13:43:48 user nova-compute[231753]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:43:48 user nova-compute[231753]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)
Jul 29 13:43:48 user nova-compute[231753]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)
Jul 29 13:43:48 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:43:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-686eefad-7130-41e1-b6c4-ffa925a9189d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsi session list stdout=tcp: [23] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 (non-flash)
Jul 29 13:43:48 user nova-compute[231753]: tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:43:48 user nova-compute[231753]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)
Jul 29 13:43:48 user nova-compute[231753]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:43:48 user nova-compute[231753]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)
Jul 29 13:43:48 user nova-compute[231753]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)
Jul 29 13:43:48 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:43:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-686eefad-7130-41e1-b6c4-ffa925a9189d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ca683c0d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0'): ({'sdc'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:43:48 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-686eefad-7130-41e1-b6c4-ffa925a9189d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Removing single pathed devices sdc {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:43:48 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:48 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:48 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc499299-76f9-44e6-ab69-8c5e986af519]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:43:48 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:49 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c614c76b-1589-4143-8acb-1c8ef023fa47]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:43:49 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-686eefad-7130-41e1-b6c4-ffa925a9189d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Flushing IO for device /dev/sdc {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:43:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:49 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa7596a1-7422-4a8f-9312-a2272cc6ddcc]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:43:49 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-686eefad-7130-41e1-b6c4-ffa925a9189d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:43:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:49 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb909dbc-db3b-4450-bf2a-2f80bfca70fb]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:43:49 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-686eefad-7130-41e1-b6c4-ffa925a9189d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:43:49 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-686eefad-7130-41e1-b6c4-ffa925a9189d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] SCSI volumes sdc have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:43:49 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-686eefad-7130-41e1-b6c4-ffa925a9189d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:43:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:49 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a8c3ea6-8289-4f1f-9361-59fb98a6af8f]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:43:49 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-686eefad-7130-41e1-b6c4-ffa925a9189d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:43:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:49 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[76df2aa5-05e0-4fff-a554-364306e6a0ce]: (4, ('Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0, portal: 172.16.0.220,3260]\nLogout of [sid: 23, target: iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:43:49 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-686eefad-7130-41e1-b6c4-ffa925a9189d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0, portal: 172.16.0.220,3260]
Jul 29 13:43:49 user nova-compute[231753]: Logout of [sid: 23, target: iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0, portal: 172.16.0.220,3260] successful.
Jul 29 13:43:49 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:43:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:43:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:27a0926a-875c-4f2d-bdcf-fce9178772b0 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:43:49 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[86fbd20c-64b5-4131-9b57-adce1b319256]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:43:49 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-686eefad-7130-41e1-b6c4-ffa925a9189d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:43:49 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-686eefad-7130-41e1-b6c4-ffa925a9189d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.323s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:43:49 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-686eefad-7130-41e1-b6c4-ffa925a9189d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] <== disconnect_volume: return (325ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:43:49 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-686eefad-7130-41e1-b6c4-ffa925a9189d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:43:50 user nova-compute[231753]: DEBUG nova.objects.instance [None req-686eefad-7130-41e1-b6c4-ffa925a9189d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lazy-loading 'flavor' on Instance uuid 481435b2-4319-4caf-aa5b-5c986a747258 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:43:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-686eefad-7130-41e1-b6c4-ffa925a9189d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "481435b2-4319-4caf-aa5b-5c986a747258" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.890s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:43:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:58 user nova-compute[231753]: DEBUG nova.compute.manager [req-46a8a786-5493-4f66-8471-72316b049b2c req-4cddf2d5-fbd9-48fe-a77e-c183dc9590f4 service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Received event network-changed-2a7981fb-647d-4610-9da2-3b162f366dfe {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:43:58 user nova-compute[231753]: DEBUG nova.compute.manager [req-46a8a786-5493-4f66-8471-72316b049b2c req-4cddf2d5-fbd9-48fe-a77e-c183dc9590f4 service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Refreshing instance network info cache due to event network-changed-2a7981fb-647d-4610-9da2-3b162f366dfe. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:43:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-46a8a786-5493-4f66-8471-72316b049b2c req-4cddf2d5-fbd9-48fe-a77e-c183dc9590f4 service nova] Acquiring lock "refresh_cache-3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:43:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-46a8a786-5493-4f66-8471-72316b049b2c req-4cddf2d5-fbd9-48fe-a77e-c183dc9590f4 service nova] Acquired lock "refresh_cache-3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:43:58 user nova-compute[231753]: DEBUG nova.network.neutron [req-46a8a786-5493-4f66-8471-72316b049b2c req-4cddf2d5-fbd9-48fe-a77e-c183dc9590f4 service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Refreshing network info cache for port 2a7981fb-647d-4610-9da2-3b162f366dfe {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:43:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:43:58 user nova-compute[231753]: DEBUG nova.network.neutron [req-46a8a786-5493-4f66-8471-72316b049b2c req-4cddf2d5-fbd9-48fe-a77e-c183dc9590f4 service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Updated VIF entry in instance network info cache for port 2a7981fb-647d-4610-9da2-3b162f366dfe. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:43:58 user nova-compute[231753]: DEBUG nova.network.neutron [req-46a8a786-5493-4f66-8471-72316b049b2c req-4cddf2d5-fbd9-48fe-a77e-c183dc9590f4 service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Updating instance_info_cache with network_info: [{"id": "2a7981fb-647d-4610-9da2-3b162f366dfe", "address": "fa:16:3e:0c:e3:a3", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7981fb-64", "ovs_interfaceid": "2a7981fb-647d-4610-9da2-3b162f366dfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:43:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-46a8a786-5493-4f66-8471-72316b049b2c req-4cddf2d5-fbd9-48fe-a77e-c183dc9590f4 service nova] Releasing lock "refresh_cache-3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:43:59 user nova-compute[231753]: DEBUG nova.compute.manager [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Stashing vm_state: active {{(pid=231753) _prep_resize /opt/stack/nova/nova/compute/manager.py:5535}}
Jul 29 13:43:59 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:43:59 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:43:59 user nova-compute[231753]: DEBUG nova.objects.instance [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lazy-loading 'pci_requests' on Instance uuid f62c7904-d9d1-4bfc-bef8-9b1c241134f1 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:43:59 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:43:59 user nova-compute[231753]: INFO nova.compute.claims [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Claim successful on node user
Jul 29 13:43:59 user nova-compute[231753]: DEBUG nova.objects.instance [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lazy-loading 'resources' on Instance uuid f62c7904-d9d1-4bfc-bef8-9b1c241134f1 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:44:00 user nova-compute[231753]: DEBUG nova.objects.instance [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lazy-loading 'pci_devices' on Instance uuid f62c7904-d9d1-4bfc-bef8-9b1c241134f1 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:44:00 user nova-compute[231753]: INFO nova.compute.resource_tracker [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Updating resource usage from migration 17162dcf-3b46-4c6d-93b0-992f16d1a960
Jul 29 13:44:00 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:44:00 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:44:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 0.557s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:44:00 user nova-compute[231753]: INFO nova.compute.manager [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Migrating
Jul 29 13:44:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "refresh_cache-f62c7904-d9d1-4bfc-bef8-9b1c241134f1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:44:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquired lock "refresh_cache-f62c7904-d9d1-4bfc-bef8-9b1c241134f1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:44:00 user nova-compute[231753]: DEBUG nova.network.neutron [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:44:00 user nova-compute[231753]: DEBUG nova.compute.manager [req-4e3c8c97-3892-462f-a9c4-bc1f65c1253d req-8b4acc0a-ea48-469b-8a89-3028b2a59acd service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Received event network-changed-50f751e1-b359-47f5-8e65-19f48fcf1f4a {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:44:00 user nova-compute[231753]: DEBUG nova.compute.manager [req-4e3c8c97-3892-462f-a9c4-bc1f65c1253d req-8b4acc0a-ea48-469b-8a89-3028b2a59acd service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Refreshing instance network info cache due to event network-changed-50f751e1-b359-47f5-8e65-19f48fcf1f4a. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:44:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4e3c8c97-3892-462f-a9c4-bc1f65c1253d req-8b4acc0a-ea48-469b-8a89-3028b2a59acd service nova] Acquiring lock "refresh_cache-f62c7904-d9d1-4bfc-bef8-9b1c241134f1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:44:01 user nova-compute[231753]: DEBUG nova.network.neutron [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Updating instance_info_cache with network_info: [{"id": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "address": "fa:16:3e:ed:37:b6", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f751e1-b3", "ovs_interfaceid": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:44:01 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Releasing lock "refresh_cache-f62c7904-d9d1-4bfc-bef8-9b1c241134f1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:44:01 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4e3c8c97-3892-462f-a9c4-bc1f65c1253d req-8b4acc0a-ea48-469b-8a89-3028b2a59acd service nova] Acquired lock "refresh_cache-f62c7904-d9d1-4bfc-bef8-9b1c241134f1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:44:01 user nova-compute[231753]: DEBUG nova.network.neutron [req-4e3c8c97-3892-462f-a9c4-bc1f65c1253d req-8b4acc0a-ea48-469b-8a89-3028b2a59acd service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Refreshing network info cache for port 50f751e1-b359-47f5-8e65-19f48fcf1f4a {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:44:01 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Starting migrate_disk_and_power_off {{(pid=231753) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:11487}}
Jul 29 13:44:01 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:01 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:01 user nova-compute[231753]: DEBUG nova.compute.manager [req-e04334c4-e23b-42b4-ad4c-36db86fc6fbc req-5de91859-d0c4-4ff5-b80b-0083e47c06c0 service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Received event network-vif-unplugged-50f751e1-b359-47f5-8e65-19f48fcf1f4a {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:44:01 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e04334c4-e23b-42b4-ad4c-36db86fc6fbc req-5de91859-d0c4-4ff5-b80b-0083e47c06c0 service nova] Acquiring lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:44:01 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e04334c4-e23b-42b4-ad4c-36db86fc6fbc req-5de91859-d0c4-4ff5-b80b-0083e47c06c0 service nova] Lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:44:01 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e04334c4-e23b-42b4-ad4c-36db86fc6fbc req-5de91859-d0c4-4ff5-b80b-0083e47c06c0 service nova] Lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:44:01 user nova-compute[231753]: DEBUG nova.compute.manager [req-e04334c4-e23b-42b4-ad4c-36db86fc6fbc req-5de91859-d0c4-4ff5-b80b-0083e47c06c0 service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] No waiting events found dispatching network-vif-unplugged-50f751e1-b359-47f5-8e65-19f48fcf1f4a {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:44:01 user nova-compute[231753]: WARNING nova.compute.manager [req-e04334c4-e23b-42b4-ad4c-36db86fc6fbc req-5de91859-d0c4-4ff5-b80b-0083e47c06c0 service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Received unexpected event network-vif-unplugged-50f751e1-b359-47f5-8e65-19f48fcf1f4a for instance with vm_state active and task_state resize_migrating.
Jul 29 13:44:01 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:01 user nova-compute[231753]: DEBUG nova.network.neutron [req-4e3c8c97-3892-462f-a9c4-bc1f65c1253d req-8b4acc0a-ea48-469b-8a89-3028b2a59acd service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Updated VIF entry in instance network info cache for port 50f751e1-b359-47f5-8e65-19f48fcf1f4a. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:44:01 user nova-compute[231753]: DEBUG nova.network.neutron [req-4e3c8c97-3892-462f-a9c4-bc1f65c1253d req-8b4acc0a-ea48-469b-8a89-3028b2a59acd service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Updating instance_info_cache with network_info: [{"id": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "address": "fa:16:3e:ed:37:b6", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f751e1-b3", "ovs_interfaceid": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:44:01 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:01 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4e3c8c97-3892-462f-a9c4-bc1f65c1253d req-8b4acc0a-ea48-469b-8a89-3028b2a59acd service nova] Releasing lock "refresh_cache-f62c7904-d9d1-4bfc-bef8-9b1c241134f1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:44:01 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:01 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Instance destroyed successfully.
Jul 29 13:44:01 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:42:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-643824359',display_name='tempest-ServerActionsTestOtherA-server-643824359',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-643824359',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuWQgyAL1ZhtINiMb8bBadRX1/6ZehT6zfTT2DNFW6eh8iXvfW0Pq6raR1PDnzRXJlqkmjwTrVF+AwsdLN+yPf0k+X1yx9QfVmcJaO2ivlK/Orc5S8LFrDXUE7UuYGgdQ==',key_name='tempest-keypair-820646002',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:42:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='afff9d3d250643c58da9bc5cf5756d1e',ramdisk_id='',reservation_id='r-yz0wxii9',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1666416634',owner_user_name='tempest-ServerActionsTestOtherA-1666416634-project-member'},tags=<?>,task_state='resize_migrating',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:44:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='748938c3fbfb4244ab946dcfe4762435',uuid=f62c7904-d9d1-4bfc-bef8-9b1c241134f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "address": "fa:16:3e:ed:37:b6", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1793115211-network", "vif_mac": "fa:16:3e:ed:37:b6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f751e1-b3", "ovs_interfaceid": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:44:01 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Converting VIF {"id": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "address": "fa:16:3e:ed:37:b6", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1793115211-network", "vif_mac": "fa:16:3e:ed:37:b6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f751e1-b3", "ovs_interfaceid": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:44:01 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:37:b6,bridge_name='br-int',has_traffic_filtering=True,id=50f751e1-b359-47f5-8e65-19f48fcf1f4a,network=Network(f99d9e39-7a5f-481e-905f-4d5a4e920b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f751e1-b3') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:44:01 user nova-compute[231753]: DEBUG os_vif [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:37:b6,bridge_name='br-int',has_traffic_filtering=True,id=50f751e1-b359-47f5-8e65-19f48fcf1f4a,network=Network(f99d9e39-7a5f-481e-905f-4d5a4e920b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f751e1-b3') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:44:01 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:01 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50f751e1-b3, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:44:01 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:01 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:44:01 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:01 user nova-compute[231753]: INFO os_vif [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:37:b6,bridge_name='br-int',has_traffic_filtering=True,id=50f751e1-b359-47f5-8e65-19f48fcf1f4a,network=Network(f99d9e39-7a5f-481e-905f-4d5a4e920b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f751e1-b3')
Jul 29 13:44:01 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:44:01 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QWgPCtAU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:44:01 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:44:01 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:44:01 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[864364ed-518f-41aa-9b27-0484844a18ee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:44:02 user nova-compute[231753]: No targets found.
Jul 29 13:44:02 user nova-compute[231753]: iSNS:
Jul 29 13:44:02 user nova-compute[231753]: No targets found.
Jul 29 13:44:02 user nova-compute[231753]: STATIC:
Jul 29 13:44:02 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea
Jul 29 13:44:02 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:44:02 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:44:02 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5
Jul 29 13:44:02 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:44:02 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:44:02 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed
Jul 29 13:44:02 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:44:02 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:44:02 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef
Jul 29 13:44:02 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:44:02 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:44:02 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93
Jul 29 13:44:02 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:44:02 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:44:02 user nova-compute[231753]: FIRMWARE:
Jul 29 13:44:02 user nova-compute[231753]: No targets found.
Jul 29 13:44:02 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:44:02 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:44:02 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa20c70-d7c4-477d-8c6b-8933a0e00b6f]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a0b6b5-01a8-4ebc-9442-a299bf0786b7]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)\ntcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:44:02 user nova-compute[231753]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)
Jul 29 13:44:02 user nova-compute[231753]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:44:02 user nova-compute[231753]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)
Jul 29 13:44:02 user nova-compute[231753]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)
Jul 29 13:44:02 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:44:02 user nova-compute[231753]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)
Jul 29 13:44:02 user nova-compute[231753]: tcp: [27] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:44:02 user nova-compute[231753]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)
Jul 29 13:44:02 user nova-compute[231753]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)
Jul 29 13:44:02 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c80466e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef'): ({'sdf'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Removing single pathed devices sdf {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[077f3523-eca7-4305-9959-551d3fd86ce9]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7584134e-ac7c-4fa8-9fab-10300609f8b4]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Flushing IO for device /dev/sdf {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[598753ef-0b21-4f7c-8d0a-759bfbf28a4f]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.044s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbd052b6-ed60-4a54-8ac1-ba19af3467c8]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] SCSI volumes sdf have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b542c56d', '/dev/disk/by-id/scsi-23632316232303066', '/dev/disk/by-id/scsi-1SCST_BIOb542c56d-621b200f21cbb7a9') {{(pid=242780) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c39735f-6126-41a4-9a92-2f1320ea51a6]: (4, None) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.032s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[11a8dd51-84da-4bc5-be9c-bdf49ce068e5]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --logout" returned: 0 in 0.067s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0963a6f-6cee-4df0-99a0-cb1d401d4fe6]: (4, ('Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef, portal: 172.16.0.220,3260]\nLogout of [sid: 27, target: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef, portal: 172.16.0.220,3260]
Jul 29 13:44:02 user nova-compute[231753]: Logout of [sid: 27, target: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef, portal: 172.16.0.220,3260] successful.
Jul 29 13:44:02 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[165cf1a7-5120-4145-a17f-851a6c528121]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.377s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] <== disconnect_volume: return (378ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:44:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] skipping disk /dev/sdf (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:44:03 user nova-compute[231753]: DEBUG nova.network.neutron [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Port 50f751e1-b359-47f5-8e65-19f48fcf1f4a binding to destination host user is already ACTIVE {{(pid=231753) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3163}}
Jul 29 13:44:03 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:44:03 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:44:03 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:44:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:03 user nova-compute[231753]: DEBUG nova.compute.manager [req-0714ac2b-2a91-426d-b5fb-47bc75a0e158 req-dc31be50-cc4b-4363-a92e-5b69550a9b6b service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Received event network-vif-plugged-50f751e1-b359-47f5-8e65-19f48fcf1f4a {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:44:03 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0714ac2b-2a91-426d-b5fb-47bc75a0e158 req-dc31be50-cc4b-4363-a92e-5b69550a9b6b service nova] Acquiring lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:44:03 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0714ac2b-2a91-426d-b5fb-47bc75a0e158 req-dc31be50-cc4b-4363-a92e-5b69550a9b6b service nova] Lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:44:03 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0714ac2b-2a91-426d-b5fb-47bc75a0e158 req-dc31be50-cc4b-4363-a92e-5b69550a9b6b service nova] Lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:44:03 user nova-compute[231753]: DEBUG nova.compute.manager [req-0714ac2b-2a91-426d-b5fb-47bc75a0e158 req-dc31be50-cc4b-4363-a92e-5b69550a9b6b service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] No waiting events found dispatching network-vif-plugged-50f751e1-b359-47f5-8e65-19f48fcf1f4a {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:44:03 user nova-compute[231753]: WARNING nova.compute.manager [req-0714ac2b-2a91-426d-b5fb-47bc75a0e158 req-dc31be50-cc4b-4363-a92e-5b69550a9b6b service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Received unexpected event network-vif-plugged-50f751e1-b359-47f5-8e65-19f48fcf1f4a for instance with vm_state active and task_state resize_migrated.
Jul 29 13:44:03 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "refresh_cache-f62c7904-d9d1-4bfc-bef8-9b1c241134f1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:44:03 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquired lock "refresh_cache-f62c7904-d9d1-4bfc-bef8-9b1c241134f1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:44:03 user nova-compute[231753]: DEBUG nova.network.neutron [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:44:04 user nova-compute[231753]: DEBUG nova.network.neutron [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Updating instance_info_cache with network_info: [{"id": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "address": "fa:16:3e:ed:37:b6", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f751e1-b3", "ovs_interfaceid": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:44:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Releasing lock "refresh_cache-f62c7904-d9d1-4bfc-bef8-9b1c241134f1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:44:04 user nova-compute[231753]: DEBUG os_brick.utils [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:44:04 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:04 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:04 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3195b574-dff1-4b03-91f8-b2cce6db1c76]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:04 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:04 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:04 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[19e28bb3-4f19-496e-990e-88ebb062f6ef]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:04 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:04 user nova-compute[231753]: INFO nova.compute.manager [None req-b33c0dc6-47a4-4582-bbf3-d7be7a4a5d4a tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Unrescuing
Jul 29 13:44:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b33c0dc6-47a4-4582-bbf3-d7be7a4a5d4a tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Acquiring lock "refresh_cache-55bfcd1f-2b51-4e10-84a3-e132b96111e3" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:44:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b33c0dc6-47a4-4582-bbf3-d7be7a4a5d4a tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Acquired lock "refresh_cache-55bfcd1f-2b51-4e10-84a3-e132b96111e3" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:44:04 user nova-compute[231753]: DEBUG nova.network.neutron [None req-b33c0dc6-47a4-4582-bbf3-d7be7a4a5d4a tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:44:04 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:04 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6771d62e-1b0e-4eba-a5f1-8085501a11c1]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:04 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d3b39b3-a3bb-4ffc-973e-80fe96dfb62d]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:04 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:04 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:44:04 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:44:04 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:04 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:44:04 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:44:04 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62f1830-d174-4270-a4f4-0cfe5ee4b535]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:04 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:44:04 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:44:04 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:44:04 user nova-compute[231753]: DEBUG os_brick.utils [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:44:04 user nova-compute[231753]: DEBUG nova.network.neutron [None req-b33c0dc6-47a4-4582-bbf3-d7be7a4a5d4a tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Updating instance_info_cache with network_info: [{"id": "20213688-43ed-4115-bd0d-bc74791d95c4", "address": "fa:16:3e:5b:23:7c", "network": {"id": "e8ad7fa5-6e98-46f4-8062-0b9eddaa76a6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-253010414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b08b115e89482f9b81e621485c5eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20213688-43", "ovs_interfaceid": "20213688-43ed-4115-bd0d-bc74791d95c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:44:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b33c0dc6-47a4-4582-bbf3-d7be7a4a5d4a tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Releasing lock "refresh_cache-55bfcd1f-2b51-4e10-84a3-e132b96111e3" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:44:05 user nova-compute[231753]: DEBUG nova.objects.instance [None req-b33c0dc6-47a4-4582-bbf3-d7be7a4a5d4a tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lazy-loading 'flavor' on Instance uuid 55bfcd1f-2b51-4e10-84a3-e132b96111e3 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:44:05 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:05 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:05 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:05 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:05 user nova-compute[231753]: DEBUG nova.compute.manager [req-57bcf9df-eb46-4ee8-bffa-365ee408ff39 req-39a9e585-a475-448e-914e-5f6032bf6464 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Received event network-vif-unplugged-20213688-43ed-4115-bd0d-bc74791d95c4 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:44:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-57bcf9df-eb46-4ee8-bffa-365ee408ff39 req-39a9e585-a475-448e-914e-5f6032bf6464 service nova] Acquiring lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:44:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-57bcf9df-eb46-4ee8-bffa-365ee408ff39 req-39a9e585-a475-448e-914e-5f6032bf6464 service nova] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:44:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-57bcf9df-eb46-4ee8-bffa-365ee408ff39 req-39a9e585-a475-448e-914e-5f6032bf6464 service nova] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:44:05 user nova-compute[231753]: DEBUG nova.compute.manager [req-57bcf9df-eb46-4ee8-bffa-365ee408ff39 req-39a9e585-a475-448e-914e-5f6032bf6464 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] No waiting events found dispatching network-vif-unplugged-20213688-43ed-4115-bd0d-bc74791d95c4 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:44:05 user nova-compute[231753]: WARNING nova.compute.manager [req-57bcf9df-eb46-4ee8-bffa-365ee408ff39 req-39a9e585-a475-448e-914e-5f6032bf6464 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Received unexpected event network-vif-unplugged-20213688-43ed-4115-bd0d-bc74791d95c4 for instance with vm_state rescued and task_state unrescuing.
Jul 29 13:44:05 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:05 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Instance destroyed successfully.
Jul 29 13:44:05 user nova-compute[231753]: DEBUG nova.compute.manager [req-710cbfd0-b1fc-4723-b03b-1c5044969b3e req-c5e3ad01-fdb9-4f99-9c7a-bf01ef2c2c2d service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Received event network-changed-20213688-43ed-4115-bd0d-bc74791d95c4 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:44:05 user nova-compute[231753]: DEBUG nova.compute.manager [req-710cbfd0-b1fc-4723-b03b-1c5044969b3e req-c5e3ad01-fdb9-4f99-9c7a-bf01ef2c2c2d service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Refreshing instance network info cache due to event network-changed-20213688-43ed-4115-bd0d-bc74791d95c4. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:44:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-710cbfd0-b1fc-4723-b03b-1c5044969b3e req-c5e3ad01-fdb9-4f99-9c7a-bf01ef2c2c2d service nova] Acquiring lock "refresh_cache-55bfcd1f-2b51-4e10-84a3-e132b96111e3" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:44:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-710cbfd0-b1fc-4723-b03b-1c5044969b3e req-c5e3ad01-fdb9-4f99-9c7a-bf01ef2c2c2d service nova] Acquired lock "refresh_cache-55bfcd1f-2b51-4e10-84a3-e132b96111e3" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:44:05 user nova-compute[231753]: DEBUG nova.network.neutron [req-710cbfd0-b1fc-4723-b03b-1c5044969b3e req-c5e3ad01-fdb9-4f99-9c7a-bf01ef2c2c2d service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Refreshing network info cache for port 20213688-43ed-4115-bd0d-bc74791d95c4 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:44:06 user nova-compute[231753]: DEBUG nova.network.neutron [req-710cbfd0-b1fc-4723-b03b-1c5044969b3e req-c5e3ad01-fdb9-4f99-9c7a-bf01ef2c2c2d service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Updated VIF entry in instance network info cache for port 20213688-43ed-4115-bd0d-bc74791d95c4. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:44:06 user nova-compute[231753]: DEBUG nova.network.neutron [req-710cbfd0-b1fc-4723-b03b-1c5044969b3e req-c5e3ad01-fdb9-4f99-9c7a-bf01ef2c2c2d service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Updating instance_info_cache with network_info: [{"id": "20213688-43ed-4115-bd0d-bc74791d95c4", "address": "fa:16:3e:5b:23:7c", "network": {"id": "e8ad7fa5-6e98-46f4-8062-0b9eddaa76a6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-253010414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b08b115e89482f9b81e621485c5eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20213688-43", "ovs_interfaceid": "20213688-43ed-4115-bd0d-bc74791d95c4", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:44:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-710cbfd0-b1fc-4723-b03b-1c5044969b3e req-c5e3ad01-fdb9-4f99-9c7a-bf01ef2c2c2d service nova] Releasing lock "refresh_cache-55bfcd1f-2b51-4e10-84a3-e132b96111e3" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:44:06 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:07 user nova-compute[231753]: DEBUG nova.compute.manager [req-20f14e26-db4a-4816-a0d4-f18e1ab7c8a7 req-deee6b1d-fdbf-45f9-a762-cfc51d18b941 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Received event network-vif-plugged-20213688-43ed-4115-bd0d-bc74791d95c4 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:44:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-20f14e26-db4a-4816-a0d4-f18e1ab7c8a7 req-deee6b1d-fdbf-45f9-a762-cfc51d18b941 service nova] Acquiring lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:44:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-20f14e26-db4a-4816-a0d4-f18e1ab7c8a7 req-deee6b1d-fdbf-45f9-a762-cfc51d18b941 service nova] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:44:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-20f14e26-db4a-4816-a0d4-f18e1ab7c8a7 req-deee6b1d-fdbf-45f9-a762-cfc51d18b941 service nova] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:44:07 user nova-compute[231753]: DEBUG nova.compute.manager [req-20f14e26-db4a-4816-a0d4-f18e1ab7c8a7 req-deee6b1d-fdbf-45f9-a762-cfc51d18b941 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] No waiting events found dispatching network-vif-plugged-20213688-43ed-4115-bd0d-bc74791d95c4 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:44:07 user nova-compute[231753]: WARNING nova.compute.manager [req-20f14e26-db4a-4816-a0d4-f18e1ab7c8a7 req-deee6b1d-fdbf-45f9-a762-cfc51d18b941 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Received unexpected event network-vif-plugged-20213688-43ed-4115-bd0d-bc74791d95c4 for instance with vm_state rescued and task_state unrescuing.
Jul 29 13:44:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:07 user nova-compute[231753]: DEBUG nova.compute.manager [req-2ef4f8f3-b9c0-43b9-892f-fb78c119e1c7 req-b5f34cde-998b-498f-9c22-1c65a61db8f4 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Received event network-changed-20213688-43ed-4115-bd0d-bc74791d95c4 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:44:07 user nova-compute[231753]: DEBUG nova.compute.manager [req-2ef4f8f3-b9c0-43b9-892f-fb78c119e1c7 req-b5f34cde-998b-498f-9c22-1c65a61db8f4 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Refreshing instance network info cache due to event network-changed-20213688-43ed-4115-bd0d-bc74791d95c4. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:44:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-2ef4f8f3-b9c0-43b9-892f-fb78c119e1c7 req-b5f34cde-998b-498f-9c22-1c65a61db8f4 service nova] Acquiring lock "refresh_cache-55bfcd1f-2b51-4e10-84a3-e132b96111e3" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:44:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-2ef4f8f3-b9c0-43b9-892f-fb78c119e1c7 req-b5f34cde-998b-498f-9c22-1c65a61db8f4 service nova] Acquired lock "refresh_cache-55bfcd1f-2b51-4e10-84a3-e132b96111e3" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:44:07 user nova-compute[231753]: DEBUG nova.network.neutron [req-2ef4f8f3-b9c0-43b9-892f-fb78c119e1c7 req-b5f34cde-998b-498f-9c22-1c65a61db8f4 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Refreshing network info cache for port 20213688-43ed-4115-bd0d-bc74791d95c4 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:44:08 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:44:08 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 13:44:08 user nova-compute[231753]: DEBUG nova.network.neutron [req-2ef4f8f3-b9c0-43b9-892f-fb78c119e1c7 req-b5f34cde-998b-498f-9c22-1c65a61db8f4 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Updated VIF entry in instance network info cache for port 20213688-43ed-4115-bd0d-bc74791d95c4. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:44:08 user nova-compute[231753]: DEBUG nova.network.neutron [req-2ef4f8f3-b9c0-43b9-892f-fb78c119e1c7 req-b5f34cde-998b-498f-9c22-1c65a61db8f4 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Updating instance_info_cache with network_info: [{"id": "20213688-43ed-4115-bd0d-bc74791d95c4", "address": "fa:16:3e:5b:23:7c", "network": {"id": "e8ad7fa5-6e98-46f4-8062-0b9eddaa76a6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-253010414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b08b115e89482f9b81e621485c5eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20213688-43", "ovs_interfaceid": "20213688-43ed-4115-bd0d-bc74791d95c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:44:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-2ef4f8f3-b9c0-43b9-892f-fb78c119e1c7 req-b5f34cde-998b-498f-9c22-1c65a61db8f4 service nova] Releasing lock "refresh_cache-55bfcd1f-2b51-4e10-84a3-e132b96111e3" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:44:08 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:09 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:44:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:44:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:44:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:44:09 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 13:44:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Removed pending event for 55bfcd1f-2b51-4e10-84a3-e132b96111e3 due to event {{(pid=231753) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 29 13:44:09 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638249.4577026, 55bfcd1f-2b51-4e10-84a3-e132b96111e3 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:44:09 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] VM Resumed (Lifecycle Event)
Jul 29 13:44:09 user nova-compute[231753]: DEBUG nova.compute.manager [None req-b33c0dc6-47a4-4582-bbf3-d7be7a4a5d4a tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:44:09 user nova-compute[231753]: DEBUG nova.compute.manager [req-70317313-cf99-46b2-9b1f-348c10b173e2 req-9d9757fe-87e2-46c8-80f8-883b31df0ac8 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Received event network-vif-plugged-20213688-43ed-4115-bd0d-bc74791d95c4 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:44:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-70317313-cf99-46b2-9b1f-348c10b173e2 req-9d9757fe-87e2-46c8-80f8-883b31df0ac8 service nova] Acquiring lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:44:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-70317313-cf99-46b2-9b1f-348c10b173e2 req-9d9757fe-87e2-46c8-80f8-883b31df0ac8 service nova] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:44:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-70317313-cf99-46b2-9b1f-348c10b173e2 req-9d9757fe-87e2-46c8-80f8-883b31df0ac8 service nova] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:44:09 user nova-compute[231753]: DEBUG nova.compute.manager [req-70317313-cf99-46b2-9b1f-348c10b173e2 req-9d9757fe-87e2-46c8-80f8-883b31df0ac8 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] No waiting events found dispatching network-vif-plugged-20213688-43ed-4115-bd0d-bc74791d95c4 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:44:09 user nova-compute[231753]: WARNING nova.compute.manager [req-70317313-cf99-46b2-9b1f-348c10b173e2 req-9d9757fe-87e2-46c8-80f8-883b31df0ac8 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Received unexpected event network-vif-plugged-20213688-43ed-4115-bd0d-bc74791d95c4 for instance with vm_state rescued and task_state unrescuing.
Jul 29 13:44:09 user nova-compute[231753]: DEBUG nova.compute.manager [req-70317313-cf99-46b2-9b1f-348c10b173e2 req-9d9757fe-87e2-46c8-80f8-883b31df0ac8 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Received event network-vif-plugged-20213688-43ed-4115-bd0d-bc74791d95c4 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:44:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-70317313-cf99-46b2-9b1f-348c10b173e2 req-9d9757fe-87e2-46c8-80f8-883b31df0ac8 service nova] Acquiring lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:44:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-70317313-cf99-46b2-9b1f-348c10b173e2 req-9d9757fe-87e2-46c8-80f8-883b31df0ac8 service nova] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:44:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-70317313-cf99-46b2-9b1f-348c10b173e2 req-9d9757fe-87e2-46c8-80f8-883b31df0ac8 service nova] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:44:09 user nova-compute[231753]: DEBUG nova.compute.manager [req-70317313-cf99-46b2-9b1f-348c10b173e2 req-9d9757fe-87e2-46c8-80f8-883b31df0ac8 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] No waiting events found dispatching network-vif-plugged-20213688-43ed-4115-bd0d-bc74791d95c4 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:44:09 user nova-compute[231753]: WARNING nova.compute.manager [req-70317313-cf99-46b2-9b1f-348c10b173e2 req-9d9757fe-87e2-46c8-80f8-883b31df0ac8 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Received unexpected event network-vif-plugged-20213688-43ed-4115-bd0d-bc74791d95c4 for instance with vm_state rescued and task_state unrescuing.
Jul 29 13:44:09 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:44:09 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:44:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:44:09 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638249.4599416, 55bfcd1f-2b51-4e10-84a3-e132b96111e3 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:44:09 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] VM Started (Lifecycle Event)
Jul 29 13:44:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:09 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:44:09 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:44:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:44:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258/disk --force-share --output=json" returned: 0 in 0.176s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk --force-share --output=json" returned: 0 in 0.196s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a2fb70-1fc7-475b-af56-6cff04794ef7/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a2fb70-1fc7-475b-af56-6cff04794ef7/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a2fb70-1fc7-475b-af56-6cff04794ef7/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a2fb70-1fc7-475b-af56-6cff04794ef7/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:11 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b99a72ba-73e2-4be7-b52b-7797351daa5f/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b99a72ba-73e2-4be7-b52b-7797351daa5f/disk.rescue --force-share --output=json" returned: 0 in 0.200s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b99a72ba-73e2-4be7-b52b-7797351daa5f/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b99a72ba-73e2-4be7-b52b-7797351daa5f/disk.rescue --force-share --output=json" returned: 0 in 0.149s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Starting finish_migration {{(pid=231753) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11674}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Instance directory exists: not creating {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 29 13:44:12 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Creating image(s)
Jul 29 13:44:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Did not create local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Ensure instance console log exists: /opt/stack/data/nova/instances/f62c7904-d9d1-4bfc-bef8-9b1c241134f1/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Start _get_guest_xml network_info=[{"id": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "address": "fa:16:3e:ed:37:b6", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1793115211-network", "vif_mac": "fa:16:3e:ed:37:b6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f751e1-b3", "ovs_interfaceid": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QWgPCtAU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'attaching', 'instance': 'f62c7904-d9d1-4bfc-bef8-9b1c241134f1', 'attached_at': '2023-07-29T13:44:12.000000', 'detached_at': '', 'volume_id': 'afa3c554-c497-4ad8-94dc-fbe61541e6ef', 'serial': 'afa3c554-c497-4ad8-94dc-fbe61541e6ef'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'attachment_id': '320e27a2-a735-4224-9a2d-b36060f1f0d3', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:44:12 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:44:12 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:44:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:16Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='2',id=7,is_public=True,memory_mb=2048,name='m1.small',projects=<?>,root_gb=20,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG nova.objects.instance [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lazy-loading 'vcpu_model' on Instance uuid f62c7904-d9d1-4bfc-bef8-9b1c241134f1 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:44:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QWgPCtAU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:44:12 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:44:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:44:13 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:44:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:44:13 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260" returned: 21 in 0.027s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea798324-5b5b-43af-b08f-bdbc592392a7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:44:13 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[238b4e94-b6db-42d0-bb70-212a99872e07]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef] added
Jul 29 13:44:13 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.031s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8381e504-129f-43f5-9bfa-973b9c326bac]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[35509b59-da30-4207-a723-5ec213884589]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QWgPCtAU {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QWgPCtAU" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b11b382-52d5-47d1-8cf8-56af45f15842]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QWgPCtAU'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f264e87-26c3-4b8e-ac31-0719661dbf87]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[90f20562-597b-4b09-b1ea-229a06f335b8]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:44:13 user nova-compute[231753]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)
Jul 29 13:44:13 user nova-compute[231753]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)
Jul 29 13:44:13 user nova-compute[231753]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)
Jul 29 13:44:13 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:44:13 user nova-compute[231753]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)
Jul 29 13:44:13 user nova-compute[231753]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)
Jul 29 13:44:13 user nova-compute[231753]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)
Jul 29 13:44:13 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:13 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:44:13 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:44:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=7133MB free_disk=25.054000854492188GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --login" returned: 0 in 0.098s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4d28615-d0ae-49d8-9e03-f79b7ade3c4e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef, portal: 172.16.0.220,3260]
Jul 29 13:44:13 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef, portal: 172.16.0.220,3260] successful.
Jul 29 13:44:13 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[facb12a8-f3db-483d-b2bd-cec8ff85aa0b]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Applying migration context for instance f62c7904-d9d1-4bfc-bef8-9b1c241134f1 as it has an incoming, in-progress migration 17162dcf-3b46-4c6d-93b0-992f16d1a960. Migration status is post-migrating {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Jul 29 13:44:13 user nova-compute[231753]: INFO nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Updating resource usage from migration 17162dcf-3b46-4c6d-93b0-992f16d1a960
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3ce7120-f16f-4ddd-9f33-92cf4d143068]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:44:13 user nova-compute[231753]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)
Jul 29 13:44:13 user nova-compute[231753]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)
Jul 29 13:44:13 user nova-compute[231753]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)
Jul 29 13:44:13 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:44:13 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:44:13 user nova-compute[231753]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)
Jul 29 13:44:13 user nova-compute[231753]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)
Jul 29 13:44:13 user nova-compute[231753]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)
Jul 29 13:44:13 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:44:13 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.856s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] HCTL ('34', '-', '-', 0) found on session 30 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 7e2615c1-b03e-4076-bcd9-3585fb11b8ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8ea52d41-7ec3-44d7-8421-133000ee887b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance cf326e80-7293-4764-9411-ed05a5aeba23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 55bfcd1f-2b51-4e10-84a3-e132b96111e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 481435b2-4319-4caf-aa5b-5c986a747258 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 576f5002-4e4d-4236-8b0f-9b8788246de2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b99a72ba-73e2-4be7-b52b-7797351daa5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8dd26572-fe6a-40fd-8c58-6af862b340c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 37fbc873-537c-4bbc-a57b-2c44e47ecf30 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 91a2fb70-1fc7-475b-af56-6cff04794ef7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Migration 17162dcf-3b46-4c6d-93b0-992f16d1a960 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance f62c7904-d9d1-4bfc-bef8-9b1c241134f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce08abdf-fb1e-49a3-99df-a660383edc7a]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Searching for a device in session 30 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QWgPCtAU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Refreshing inventories for resource provider 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Updating ProviderTree inventory for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 29 13:44:13 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Updating inventory in ProviderTree for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 29 13:44:14 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Refreshing aggregate associations for resource provider 222db5c7-e17f-4307-968d-4284bf5c19f4, aggregates: None {{(pid=231753) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 29 13:44:14 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Refreshing trait associations for resource provider 222db5c7-e17f-4307-968d-4284bf5c19f4, traits: HW_CPU_X86_SSSE3,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_VIRTIO {{(pid=231753) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 29 13:44:14 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:44:14 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:44:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 13:44:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.809s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:44:14 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:44:14 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Cleaning up deleted instances {{(pid=231753) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 29 13:44:14 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] There are 0 instances to clean {{(pid=231753) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 29 13:44:14 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.904s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:44:14 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] <== connect_volume: return (1906ms) {'type': 'block', 'scsi_wwn': '23632316232303066', 'path': '/dev/sdc'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:44:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23632316232303066', 'path': '/dev/sdc'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:44:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:42:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-643824359',display_name='tempest-ServerActionsTestOtherA-server-643824359',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-643824359',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuWQgyAL1ZhtINiMb8bBadRX1/6ZehT6zfTT2DNFW6eh8iXvfW0Pq6raR1PDnzRXJlqkmjwTrVF+AwsdLN+yPf0k+X1yx9QfVmcJaO2ivlK/Orc5S8LFrDXUE7UuYGgdQ==',key_name='tempest-keypair-820646002',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:42:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='afff9d3d250643c58da9bc5cf5756d1e',ramdisk_id='',reservation_id='r-yz0wxii9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1666416634',owner_user_name='tempest-ServerActionsTestOtherA-1666416634-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:44:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='748938c3fbfb4244ab946dcfe4762435',uuid=f62c7904-d9d1-4bfc-bef8-9b1c241134f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "address": "fa:16:3e:ed:37:b6", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1793115211-network", "vif_mac": "fa:16:3e:ed:37:b6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f751e1-b3", "ovs_interfaceid": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:44:14 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Converting VIF {"id": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "address": "fa:16:3e:ed:37:b6", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1793115211-network", "vif_mac": "fa:16:3e:ed:37:b6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f751e1-b3", "ovs_interfaceid": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:44:14 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:37:b6,bridge_name='br-int',has_traffic_filtering=True,id=50f751e1-b359-47f5-8e65-19f48fcf1f4a,network=Network(f99d9e39-7a5f-481e-905f-4d5a4e920b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f751e1-b3') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:44:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:44:14 user nova-compute[231753]:   <uuid>f62c7904-d9d1-4bfc-bef8-9b1c241134f1</uuid>
Jul 29 13:44:14 user nova-compute[231753]:   <name>instance-0000001a</name>
Jul 29 13:44:14 user nova-compute[231753]:   <memory>2097152</memory>
Jul 29 13:44:14 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:44:14 user nova-compute[231753]:   <metadata>
Jul 29 13:44:14 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:44:14 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:44:14 user nova-compute[231753]:       <nova:name>tempest-ServerActionsTestOtherA-server-643824359</nova:name>
Jul 29 13:44:14 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:44:12</nova:creationTime>
Jul 29 13:44:14 user nova-compute[231753]:       <nova:flavor name="m1.small">
Jul 29 13:44:14 user nova-compute[231753]:         <nova:memory>2048</nova:memory>
Jul 29 13:44:14 user nova-compute[231753]:         <nova:disk>20</nova:disk>
Jul 29 13:44:14 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:44:14 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:44:14 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:44:14 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:44:14 user nova-compute[231753]:       <nova:owner>
Jul 29 13:44:14 user nova-compute[231753]:         <nova:user uuid="748938c3fbfb4244ab946dcfe4762435">tempest-ServerActionsTestOtherA-1666416634-project-member</nova:user>
Jul 29 13:44:14 user nova-compute[231753]:         <nova:project uuid="afff9d3d250643c58da9bc5cf5756d1e">tempest-ServerActionsTestOtherA-1666416634</nova:project>
Jul 29 13:44:14 user nova-compute[231753]:       </nova:owner>
Jul 29 13:44:14 user nova-compute[231753]:       <nova:ports>
Jul 29 13:44:14 user nova-compute[231753]:         <nova:port uuid="50f751e1-b359-47f5-8e65-19f48fcf1f4a">
Jul 29 13:44:14 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 29 13:44:14 user nova-compute[231753]:         </nova:port>
Jul 29 13:44:14 user nova-compute[231753]:       </nova:ports>
Jul 29 13:44:14 user nova-compute[231753]:     </nova:instance>
Jul 29 13:44:14 user nova-compute[231753]:   </metadata>
Jul 29 13:44:14 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:44:14 user nova-compute[231753]:     <system>
Jul 29 13:44:14 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:44:14 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:44:14 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:44:14 user nova-compute[231753]:       <entry name="serial">f62c7904-d9d1-4bfc-bef8-9b1c241134f1</entry>
Jul 29 13:44:14 user nova-compute[231753]:       <entry name="uuid">f62c7904-d9d1-4bfc-bef8-9b1c241134f1</entry>
Jul 29 13:44:14 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:44:14 user nova-compute[231753]:     </system>
Jul 29 13:44:14 user nova-compute[231753]:   </sysinfo>
Jul 29 13:44:14 user nova-compute[231753]:   <os>
Jul 29 13:44:14 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:44:14 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:44:14 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:44:14 user nova-compute[231753]:   </os>
Jul 29 13:44:14 user nova-compute[231753]:   <features>
Jul 29 13:44:14 user nova-compute[231753]:     <acpi/>
Jul 29 13:44:14 user nova-compute[231753]:     <apic/>
Jul 29 13:44:14 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:44:14 user nova-compute[231753]:   </features>
Jul 29 13:44:14 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:44:14 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:44:14 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:44:14 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:44:14 user nova-compute[231753]:   </clock>
Jul 29 13:44:14 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:44:14 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:44:14 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:44:14 user nova-compute[231753]:   </cpu>
Jul 29 13:44:14 user nova-compute[231753]:   <devices>
Jul 29 13:44:14 user nova-compute[231753]:     <disk type="block" device="disk">
Jul 29 13:44:14 user nova-compute[231753]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:44:14 user nova-compute[231753]:       <source dev="/dev/sdc"/>
Jul 29 13:44:14 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:44:14 user nova-compute[231753]:       <serial>afa3c554-c497-4ad8-94dc-fbe61541e6ef</serial>
Jul 29 13:44:14 user nova-compute[231753]:     </disk>
Jul 29 13:44:14 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:44:14 user nova-compute[231753]:       <mac address="fa:16:3e:ed:37:b6"/>
Jul 29 13:44:14 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:44:14 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:44:14 user nova-compute[231753]:       <target dev="tap50f751e1-b3"/>
Jul 29 13:44:14 user nova-compute[231753]:     </interface>
Jul 29 13:44:14 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:44:14 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/f62c7904-d9d1-4bfc-bef8-9b1c241134f1/console.log" append="off"/>
Jul 29 13:44:14 user nova-compute[231753]:     </serial>
Jul 29 13:44:14 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:44:14 user nova-compute[231753]:     <video>
Jul 29 13:44:14 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:44:14 user nova-compute[231753]:     </video>
Jul 29 13:44:14 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:44:14 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:44:14 user nova-compute[231753]:     </rng>
Jul 29 13:44:14 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:44:14 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:44:14 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:44:14 user nova-compute[231753]:     </memballoon>
Jul 29 13:44:14 user nova-compute[231753]:   </devices>
Jul 29 13:44:14 user nova-compute[231753]: </domain>
Jul 29 13:44:14 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:44:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:42:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-643824359',display_name='tempest-ServerActionsTestOtherA-server-643824359',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-643824359',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuWQgyAL1ZhtINiMb8bBadRX1/6ZehT6zfTT2DNFW6eh8iXvfW0Pq6raR1PDnzRXJlqkmjwTrVF+AwsdLN+yPf0k+X1yx9QfVmcJaO2ivlK/Orc5S8LFrDXUE7UuYGgdQ==',key_name='tempest-keypair-820646002',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:42:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=MigrationContext,new_flavor=Flavor(7),node='user',numa_topology=None,old_flavor=Flavor(6),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='afff9d3d250643c58da9bc5cf5756d1e',ramdisk_id='',reservation_id='r-yz0wxii9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherA-1666416634',owner_user_name='tempest-ServerActionsTestOtherA-1666416634-project-member'},tags=<?>,task_state='resize_finish',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:44:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='748938c3fbfb4244ab946dcfe4762435',uuid=f62c7904-d9d1-4bfc-bef8-9b1c241134f1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "address": "fa:16:3e:ed:37:b6", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1793115211-network", "vif_mac": "fa:16:3e:ed:37:b6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f751e1-b3", "ovs_interfaceid": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:44:14 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Converting VIF {"id": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "address": "fa:16:3e:ed:37:b6", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherA-1793115211-network", "vif_mac": "fa:16:3e:ed:37:b6"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f751e1-b3", "ovs_interfaceid": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:44:14 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ed:37:b6,bridge_name='br-int',has_traffic_filtering=True,id=50f751e1-b359-47f5-8e65-19f48fcf1f4a,network=Network(f99d9e39-7a5f-481e-905f-4d5a4e920b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f751e1-b3') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:44:14 user nova-compute[231753]: DEBUG os_vif [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:37:b6,bridge_name='br-int',has_traffic_filtering=True,id=50f751e1-b359-47f5-8e65-19f48fcf1f4a,network=Network(f99d9e39-7a5f-481e-905f-4d5a4e920b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f751e1-b3') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:44:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:44:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:44:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap50f751e1-b3, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:44:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap50f751e1-b3, col_values=(('external_ids', {'iface-id': '50f751e1-b359-47f5-8e65-19f48fcf1f4a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ed:37:b6', 'vm-uuid': 'f62c7904-d9d1-4bfc-bef8-9b1c241134f1'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:44:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:44:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:14 user nova-compute[231753]: INFO os_vif [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ed:37:b6,bridge_name='br-int',has_traffic_filtering=True,id=50f751e1-b359-47f5-8e65-19f48fcf1f4a,network=Network(f99d9e39-7a5f-481e-905f-4d5a4e920b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f751e1-b3')
Jul 29 13:44:15 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:44:15 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] No VIF found with MAC fa:16:3e:ed:37:b6, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:44:15 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:44:15 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:44:15 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 13:44:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "refresh_cache-cf326e80-7293-4764-9411-ed05a5aeba23" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:44:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquired lock "refresh_cache-cf326e80-7293-4764-9411-ed05a5aeba23" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:44:15 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Forcefully refreshing network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 13:44:15 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Updating instance_info_cache with network_info: [{"id": "fbd63de1-966b-4791-8c72-6a5e2d26a7e2", "address": "fa:16:3e:09:75:c0", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd63de1-96", "ovs_interfaceid": "fbd63de1-966b-4791-8c72-6a5e2d26a7e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:44:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Releasing lock "refresh_cache-cf326e80-7293-4764-9411-ed05a5aeba23" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:44:15 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Updated the network info_cache for instance {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 13:44:15 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:44:15 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:44:15 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:44:15 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:44:15 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:44:16 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:44:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:16 user nova-compute[231753]: DEBUG nova.compute.manager [req-41ee8b45-770c-4e25-ba1d-c8aeb54c1498 req-3fce9272-d6ba-4d59-a97e-c5f5ab4d7631 service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Received event network-vif-plugged-50f751e1-b359-47f5-8e65-19f48fcf1f4a {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:44:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-41ee8b45-770c-4e25-ba1d-c8aeb54c1498 req-3fce9272-d6ba-4d59-a97e-c5f5ab4d7631 service nova] Acquiring lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:44:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-41ee8b45-770c-4e25-ba1d-c8aeb54c1498 req-3fce9272-d6ba-4d59-a97e-c5f5ab4d7631 service nova] Lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:44:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-41ee8b45-770c-4e25-ba1d-c8aeb54c1498 req-3fce9272-d6ba-4d59-a97e-c5f5ab4d7631 service nova] Lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:44:16 user nova-compute[231753]: DEBUG nova.compute.manager [req-41ee8b45-770c-4e25-ba1d-c8aeb54c1498 req-3fce9272-d6ba-4d59-a97e-c5f5ab4d7631 service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] No waiting events found dispatching network-vif-plugged-50f751e1-b359-47f5-8e65-19f48fcf1f4a {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:44:16 user nova-compute[231753]: WARNING nova.compute.manager [req-41ee8b45-770c-4e25-ba1d-c8aeb54c1498 req-3fce9272-d6ba-4d59-a97e-c5f5ab4d7631 service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Received unexpected event network-vif-plugged-50f751e1-b359-47f5-8e65-19f48fcf1f4a for instance with vm_state active and task_state resize_finish.
Jul 29 13:44:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:16 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690638241.959015, f62c7904-d9d1-4bfc-bef8-9b1c241134f1 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:44:16 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] VM Stopped (Lifecycle Event)
Jul 29 13:44:16 user nova-compute[231753]: DEBUG nova.compute.manager [None req-c772f627-66ed-446d-8804-c092d59210ca None None] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:44:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:18 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638258.7797391, f62c7904-d9d1-4bfc-bef8-9b1c241134f1 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:44:18 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] VM Resumed (Lifecycle Event)
Jul 29 13:44:18 user nova-compute[231753]: DEBUG nova.compute.manager [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:44:18 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Instance running successfully.
Jul 29 13:44:18 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Failed to set time: agent not configured {{(pid=231753) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:200}}
Jul 29 13:44:18 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-18593ced-a76e-45c4-a4ac-dd4ad2349eb9 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] finish_migration finished successfully. {{(pid=231753) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:11769}}
Jul 29 13:44:18 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:44:18 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:44:18 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 29 13:44:18 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638258.7856119, f62c7904-d9d1-4bfc-bef8-9b1c241134f1 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:44:18 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] VM Started (Lifecycle Event)
Jul 29 13:44:18 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:44:18 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:44:18 user nova-compute[231753]: DEBUG nova.compute.manager [req-e392a064-5748-47ab-884a-e8452c4030d7 req-ec088061-4d55-4dce-9a70-c3e7632443d8 service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Received event network-vif-plugged-50f751e1-b359-47f5-8e65-19f48fcf1f4a {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:44:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e392a064-5748-47ab-884a-e8452c4030d7 req-ec088061-4d55-4dce-9a70-c3e7632443d8 service nova] Acquiring lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:44:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e392a064-5748-47ab-884a-e8452c4030d7 req-ec088061-4d55-4dce-9a70-c3e7632443d8 service nova] Lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:44:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e392a064-5748-47ab-884a-e8452c4030d7 req-ec088061-4d55-4dce-9a70-c3e7632443d8 service nova] Lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:44:18 user nova-compute[231753]: DEBUG nova.compute.manager [req-e392a064-5748-47ab-884a-e8452c4030d7 req-ec088061-4d55-4dce-9a70-c3e7632443d8 service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] No waiting events found dispatching network-vif-plugged-50f751e1-b359-47f5-8e65-19f48fcf1f4a {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:44:18 user nova-compute[231753]: WARNING nova.compute.manager [req-e392a064-5748-47ab-884a-e8452c4030d7 req-ec088061-4d55-4dce-9a70-c3e7632443d8 service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Received unexpected event network-vif-plugged-50f751e1-b359-47f5-8e65-19f48fcf1f4a for instance with vm_state active and task_state resize_finish.
Jul 29 13:44:18 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] During sync_power_state the instance has a pending task (resize_finish). Skip.
Jul 29 13:44:19 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:44:19 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Cleaning up deleted instances with incomplete migration  {{(pid=231753) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 29 13:44:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:29 user nova-compute[231753]: DEBUG nova.compute.manager [req-458519b5-2a8f-4238-9387-333a1dc0dd75 req-f5b8d7d4-026e-4f53-8551-0325be12c832 service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Received event network-changed-78884930-2bc7-430e-b250-851ff726d5f8 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:44:29 user nova-compute[231753]: DEBUG nova.compute.manager [req-458519b5-2a8f-4238-9387-333a1dc0dd75 req-f5b8d7d4-026e-4f53-8551-0325be12c832 service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Refreshing instance network info cache due to event network-changed-78884930-2bc7-430e-b250-851ff726d5f8. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:44:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-458519b5-2a8f-4238-9387-333a1dc0dd75 req-f5b8d7d4-026e-4f53-8551-0325be12c832 service nova] Acquiring lock "refresh_cache-37fbc873-537c-4bbc-a57b-2c44e47ecf30" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:44:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-458519b5-2a8f-4238-9387-333a1dc0dd75 req-f5b8d7d4-026e-4f53-8551-0325be12c832 service nova] Acquired lock "refresh_cache-37fbc873-537c-4bbc-a57b-2c44e47ecf30" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:44:29 user nova-compute[231753]: DEBUG nova.network.neutron [req-458519b5-2a8f-4238-9387-333a1dc0dd75 req-f5b8d7d4-026e-4f53-8551-0325be12c832 service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Refreshing network info cache for port 78884930-2bc7-430e-b250-851ff726d5f8 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:44:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:30 user nova-compute[231753]: DEBUG nova.network.neutron [req-458519b5-2a8f-4238-9387-333a1dc0dd75 req-f5b8d7d4-026e-4f53-8551-0325be12c832 service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Updated VIF entry in instance network info cache for port 78884930-2bc7-430e-b250-851ff726d5f8. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:44:30 user nova-compute[231753]: DEBUG nova.network.neutron [req-458519b5-2a8f-4238-9387-333a1dc0dd75 req-f5b8d7d4-026e-4f53-8551-0325be12c832 service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Updating instance_info_cache with network_info: [{"id": "78884930-2bc7-430e-b250-851ff726d5f8", "address": "fa:16:3e:0e:5d:f8", "network": {"id": "c8ebc7da-3ffe-45a0-b7f5-bb85261852ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1496462371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876fbcda354d47c197ce14ca4ed7ead6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78884930-2b", "ovs_interfaceid": "78884930-2bc7-430e-b250-851ff726d5f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:44:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-458519b5-2a8f-4238-9387-333a1dc0dd75 req-f5b8d7d4-026e-4f53-8551-0325be12c832 service nova] Releasing lock "refresh_cache-37fbc873-537c-4bbc-a57b-2c44e47ecf30" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:44:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "16097b06-976f-4fcd-a449-7b1ec8f739d1" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:44:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "16097b06-976f-4fcd-a449-7b1ec8f739d1" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:44:30 user nova-compute[231753]: INFO nova.compute.manager [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Unshelving
Jul 29 13:44:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:44:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:44:30 user nova-compute[231753]: DEBUG nova.objects.instance [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lazy-loading 'pci_requests' on Instance uuid 16097b06-976f-4fcd-a449-7b1ec8f739d1 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:44:31 user nova-compute[231753]: DEBUG nova.objects.instance [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lazy-loading 'numa_topology' on Instance uuid 16097b06-976f-4fcd-a449-7b1ec8f739d1 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:44:31 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:44:31 user nova-compute[231753]: INFO nova.compute.claims [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Claim successful on node user
Jul 29 13:44:31 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:44:31 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:44:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.589s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:44:31 user nova-compute[231753]: INFO nova.network.neutron [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Updating port 7066a691-9911-48c6-a50c-de2e25f08f1d with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 29 13:44:31 user nova-compute[231753]: INFO nova.compute.manager [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Rebuilding instance
Jul 29 13:44:32 user nova-compute[231753]: DEBUG nova.objects.instance [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lazy-loading 'trusted_certs' on Instance uuid 37fbc873-537c-4bbc-a57b-2c44e47ecf30 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:44:32 user nova-compute[231753]: DEBUG nova.compute.manager [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:44:32 user nova-compute[231753]: DEBUG nova.objects.instance [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lazy-loading 'pci_requests' on Instance uuid 37fbc873-537c-4bbc-a57b-2c44e47ecf30 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:44:32 user nova-compute[231753]: DEBUG nova.objects.instance [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lazy-loading 'pci_devices' on Instance uuid 37fbc873-537c-4bbc-a57b-2c44e47ecf30 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:44:32 user nova-compute[231753]: DEBUG nova.objects.instance [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lazy-loading 'resources' on Instance uuid 37fbc873-537c-4bbc-a57b-2c44e47ecf30 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:44:32 user nova-compute[231753]: DEBUG nova.objects.instance [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lazy-loading 'migration_context' on Instance uuid 37fbc873-537c-4bbc-a57b-2c44e47ecf30 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:44:32 user nova-compute[231753]: DEBUG nova.objects.instance [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Trying to apply a migration context that does not seem to be set for this instance {{(pid=231753) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 29 13:44:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:32 user nova-compute[231753]: DEBUG nova.compute.manager [req-acc7d84f-8db1-43f7-a239-f1ebe86abae3 req-61fcac8d-72b0-431d-bfeb-c5f9c2e8f498 service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Received event network-vif-unplugged-78884930-2bc7-430e-b250-851ff726d5f8 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:44:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-acc7d84f-8db1-43f7-a239-f1ebe86abae3 req-61fcac8d-72b0-431d-bfeb-c5f9c2e8f498 service nova] Acquiring lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:44:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-acc7d84f-8db1-43f7-a239-f1ebe86abae3 req-61fcac8d-72b0-431d-bfeb-c5f9c2e8f498 service nova] Lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:44:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-acc7d84f-8db1-43f7-a239-f1ebe86abae3 req-61fcac8d-72b0-431d-bfeb-c5f9c2e8f498 service nova] Lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:44:32 user nova-compute[231753]: DEBUG nova.compute.manager [req-acc7d84f-8db1-43f7-a239-f1ebe86abae3 req-61fcac8d-72b0-431d-bfeb-c5f9c2e8f498 service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] No waiting events found dispatching network-vif-unplugged-78884930-2bc7-430e-b250-851ff726d5f8 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:44:32 user nova-compute[231753]: WARNING nova.compute.manager [req-acc7d84f-8db1-43f7-a239-f1ebe86abae3 req-61fcac8d-72b0-431d-bfeb-c5f9c2e8f498 service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Received unexpected event network-vif-unplugged-78884930-2bc7-430e-b250-851ff726d5f8 for instance with vm_state active and task_state rebuilding.
Jul 29 13:44:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "refresh_cache-16097b06-976f-4fcd-a449-7b1ec8f739d1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:44:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquired lock "refresh_cache-16097b06-976f-4fcd-a449-7b1ec8f739d1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:44:32 user nova-compute[231753]: DEBUG nova.network.neutron [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:44:32 user nova-compute[231753]: DEBUG nova.compute.manager [req-99296781-cf10-44c9-9b41-e9141b7bac0a req-8e9701b9-863d-45ce-85e1-a167fbb3c8f4 service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Received event network-changed-7066a691-9911-48c6-a50c-de2e25f08f1d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:44:32 user nova-compute[231753]: DEBUG nova.compute.manager [req-99296781-cf10-44c9-9b41-e9141b7bac0a req-8e9701b9-863d-45ce-85e1-a167fbb3c8f4 service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Refreshing instance network info cache due to event network-changed-7066a691-9911-48c6-a50c-de2e25f08f1d. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:44:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-99296781-cf10-44c9-9b41-e9141b7bac0a req-8e9701b9-863d-45ce-85e1-a167fbb3c8f4 service nova] Acquiring lock "refresh_cache-16097b06-976f-4fcd-a449-7b1ec8f739d1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:44:32 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Instance destroyed successfully.
Jul 29 13:44:32 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Instance destroyed successfully.
Jul 29 13:44:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:42:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-565491757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1951457883',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDc03FdfB1WkJMQ+OFlTQGDyqI+vnX8r38QSC1X3+I46SKYhhpq2ELYDYwCr+yT2E/7oa4VZ/8HKFoV3Qq+q1XdXsiLTiNzAVeDrjcozJkO0FAkqdQDw0IZWfQrN8WwQag==',key_name='tempest-keypair-386440795',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:42:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='876fbcda354d47c197ce14ca4ed7ead6',ramdisk_id='',reservation_id='r-8m5l27cs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1385583979',owner_user_name='tempest-ServerActionsV293TestJSON-1385583979-project-member'},tags=<?>,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:44:32Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3330125060d64234bce343af655e58e3',uuid=37fbc873-537c-4bbc-a57b-2c44e47ecf30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78884930-2bc7-430e-b250-851ff726d5f8", "address": "fa:16:3e:0e:5d:f8", "network": {"id": "c8ebc7da-3ffe-45a0-b7f5-bb85261852ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1496462371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876fbcda354d47c197ce14ca4ed7ead6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78884930-2b", "ovs_interfaceid": "78884930-2bc7-430e-b250-851ff726d5f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:44:32 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Converting VIF {"id": "78884930-2bc7-430e-b250-851ff726d5f8", "address": "fa:16:3e:0e:5d:f8", "network": {"id": "c8ebc7da-3ffe-45a0-b7f5-bb85261852ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1496462371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876fbcda354d47c197ce14ca4ed7ead6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78884930-2b", "ovs_interfaceid": "78884930-2bc7-430e-b250-851ff726d5f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:44:32 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:5d:f8,bridge_name='br-int',has_traffic_filtering=True,id=78884930-2bc7-430e-b250-851ff726d5f8,network=Network(c8ebc7da-3ffe-45a0-b7f5-bb85261852ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78884930-2b') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:44:32 user nova-compute[231753]: DEBUG os_vif [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:5d:f8,bridge_name='br-int',has_traffic_filtering=True,id=78884930-2bc7-430e-b250-851ff726d5f8,network=Network(c8ebc7da-3ffe-45a0-b7f5-bb85261852ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78884930-2b') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:44:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78884930-2b, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:44:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:33 user nova-compute[231753]: INFO os_vif [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:5d:f8,bridge_name='br-int',has_traffic_filtering=True,id=78884930-2bc7-430e-b250-851ff726d5f8,network=Network(c8ebc7da-3ffe-45a0-b7f5-bb85261852ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78884930-2b')
Jul 29 13:44:33 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ogpdWmcA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:44:33 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 29 13:44:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3babec4b-b762-4198-8cef-deaea0aa15ab]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:44:33 user nova-compute[231753]: No targets found.
Jul 29 13:44:33 user nova-compute[231753]: iSNS:
Jul 29 13:44:33 user nova-compute[231753]: No targets found.
Jul 29 13:44:33 user nova-compute[231753]: STATIC:
Jul 29 13:44:33 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea
Jul 29 13:44:33 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:44:33 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:44:33 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5
Jul 29 13:44:33 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:44:33 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:44:33 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed
Jul 29 13:44:33 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:44:33 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:44:33 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef
Jul 29 13:44:33 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:44:33 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:44:33 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93
Jul 29 13:44:33 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:44:33 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:44:33 user nova-compute[231753]: FIRMWARE:
Jul 29 13:44:33 user nova-compute[231753]: No targets found.
Jul 29 13:44:33 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:44:33 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:44:33 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2ac492-5de9-4e90-ae4f-eff0a84d51f3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[801a3b5e-a7dc-4eb1-85ee-0e8b467d48a5]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)\ntcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:44:33 user nova-compute[231753]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)
Jul 29 13:44:33 user nova-compute[231753]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)
Jul 29 13:44:33 user nova-compute[231753]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)
Jul 29 13:44:33 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:44:33 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:44:33 user nova-compute[231753]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)
Jul 29 13:44:33 user nova-compute[231753]: tcp: [28] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)
Jul 29 13:44:33 user nova-compute[231753]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)
Jul 29 13:44:33 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:44:33 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c80466170>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93'): ({'sdb'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Removing single pathed devices sdb {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc647d5-c9ba-4986-91ee-208d33a22b64]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[37b5ca1a-78a5-4b8f-9e1d-f978c9c36e45]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Flushing IO for device /dev/sdb {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6284034b-8c3b-4c22-a425-5e961bf8a8fe]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.045s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb86bf03-811f-4250-948c-bb7ab512a346]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] SCSI volumes sdb have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe9e08ee9-0c04b495066569f5', '/dev/disk/by-id/scsi-23063303462343935', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e9e08ee9') {{(pid=242780) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee97abd3-f7ac-4522-8c2f-2c0fedf0515b]: (4, None) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a1e9b8-494e-46a0-ae81-3ca29374098b]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[51476340-cfdc-484a-b427-9062e6f0ed64]: (4, ('Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93, portal: 172.16.0.220,3260]\nLogout of [sid: 28, target: iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 28, target: iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93, portal: 172.16.0.220,3260]
Jul 29 13:44:33 user nova-compute[231753]: Logout of [sid: 28, target: iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93, portal: 172.16.0.220,3260] successful.
Jul 29 13:44:33 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG nova.network.neutron [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Updating instance_info_cache with network_info: [{"id": "7066a691-9911-48c6-a50c-de2e25f08f1d", "address": "fa:16:3e:33:c2:0b", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7066a691-99", "ovs_interfaceid": "7066a691-9911-48c6-a50c-de2e25f08f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Releasing lock "refresh_cache-16097b06-976f-4fcd-a449-7b1ec8f739d1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:44:33 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Creating image(s)
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "/opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "/opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "/opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG nova.objects.instance [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lazy-loading 'trusted_certs' on Instance uuid 16097b06-976f-4fcd-a449-7b1ec8f739d1 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bc902d-7a7b-4ccf-ba9f-d2bc2618f088]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-99296781-cf10-44c9-9b41-e9141b7bac0a req-8e9701b9-863d-45ce-85e1-a167fbb3c8f4 service nova] Acquired lock "refresh_cache-16097b06-976f-4fcd-a449-7b1ec8f739d1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG nova.network.neutron [req-99296781-cf10-44c9-9b41-e9141b7bac0a req-8e9701b9-863d-45ce-85e1-a167fbb3c8f4 service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Refreshing network info cache for port 7066a691-9911-48c6-a50c-de2e25f08f1d {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.391s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] <== disconnect_volume: return (393ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:44:33 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Deleting instance files /opt/stack/data/nova/instances/37fbc873-537c-4bbc-a57b-2c44e47ecf30_del
Jul 29 13:44:33 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Deletion of /opt/stack/data/nova/instances/37fbc873-537c-4bbc-a57b-2c44e47ecf30_del complete
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "9e7978e9b012688ee41069e98147e9a78b58c0c4" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:44:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "9e7978e9b012688ee41069e98147e9a78b58c0c4" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:44:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e7978e9b012688ee41069e98147e9a78b58c0c4.part --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:34 user nova-compute[231753]: DEBUG nova.compute.manager [req-8055101e-9013-4647-a054-add3ced2beee req-76043bf0-03df-457e-9a35-f82b1cbc899f service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Received event network-vif-plugged-78884930-2bc7-430e-b250-851ff726d5f8 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:44:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8055101e-9013-4647-a054-add3ced2beee req-76043bf0-03df-457e-9a35-f82b1cbc899f service nova] Acquiring lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:44:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8055101e-9013-4647-a054-add3ced2beee req-76043bf0-03df-457e-9a35-f82b1cbc899f service nova] Lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:44:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8055101e-9013-4647-a054-add3ced2beee req-76043bf0-03df-457e-9a35-f82b1cbc899f service nova] Lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:44:34 user nova-compute[231753]: DEBUG nova.compute.manager [req-8055101e-9013-4647-a054-add3ced2beee req-76043bf0-03df-457e-9a35-f82b1cbc899f service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] No waiting events found dispatching network-vif-plugged-78884930-2bc7-430e-b250-851ff726d5f8 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:44:34 user nova-compute[231753]: WARNING nova.compute.manager [req-8055101e-9013-4647-a054-add3ced2beee req-76043bf0-03df-457e-9a35-f82b1cbc899f service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Received unexpected event network-vif-plugged-78884930-2bc7-430e-b250-851ff726d5f8 for instance with vm_state active and task_state rebuilding.
Jul 29 13:44:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e7978e9b012688ee41069e98147e9a78b58c0c4.part --force-share --output=json" returned: 0 in 0.165s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:34 user nova-compute[231753]: DEBUG nova.virt.images [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] 86c962bf-36a6-4f61-873a-c2c030b9350f was qcow2, converting to raw {{(pid=231753) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 29 13:44:34 user nova-compute[231753]: DEBUG nova.privsep.utils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=231753) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 29 13:44:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9e7978e9b012688ee41069e98147e9a78b58c0c4.part /opt/stack/data/nova/instances/_base/9e7978e9b012688ee41069e98147e9a78b58c0c4.converted {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:34 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 37fbc873-537c-4bbc-a57b-2c44e47ecf30 could not be found.
Jul 29 13:44:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:44:34 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ogpdWmcA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:44:34 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 29 13:44:34 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:44:34 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:44:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.027s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:34 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[eef90cd4-d6e9-403c-8d58-d5f4711c6f8a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:34 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:44:34 user nova-compute[231753]: No targets found.
Jul 29 13:44:34 user nova-compute[231753]: iSNS:
Jul 29 13:44:34 user nova-compute[231753]: No targets found.
Jul 29 13:44:34 user nova-compute[231753]: STATIC:
Jul 29 13:44:34 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea
Jul 29 13:44:34 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:44:34 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:44:34 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5
Jul 29 13:44:34 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:44:34 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:44:34 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed
Jul 29 13:44:34 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:44:34 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:44:34 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef
Jul 29 13:44:34 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:44:34 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:44:34 user nova-compute[231753]: FIRMWARE:
Jul 29 13:44:34 user nova-compute[231753]: No targets found.
Jul 29 13:44:34 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:44:34 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:44:34 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:44:34 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:44:34 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:44:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:34 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[151697b5-3f62-4e69-80c7-6245fc99dce8]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:34 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[38945207-1d91-4670-85b7-11b05c8765b0]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:34 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:44:34 user nova-compute[231753]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)
Jul 29 13:44:34 user nova-compute[231753]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)
Jul 29 13:44:34 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:44:34 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:44:34 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:44:34 user nova-compute[231753]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)
Jul 29 13:44:34 user nova-compute[231753]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)
Jul 29 13:44:34 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:44:34 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:44:34 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c8045e0e0>, {}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:44:34 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Disconnecting from: [] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:44:34 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.095s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:44:34 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] <== disconnect_volume: return (96ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:44:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:44:35 user nova-compute[231753]: DEBUG nova.network.neutron [req-99296781-cf10-44c9-9b41-e9141b7bac0a req-8e9701b9-863d-45ce-85e1-a167fbb3c8f4 service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Updated VIF entry in instance network info cache for port 7066a691-9911-48c6-a50c-de2e25f08f1d. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:44:35 user nova-compute[231753]: DEBUG nova.network.neutron [req-99296781-cf10-44c9-9b41-e9141b7bac0a req-8e9701b9-863d-45ce-85e1-a167fbb3c8f4 service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Updating instance_info_cache with network_info: [{"id": "7066a691-9911-48c6-a50c-de2e25f08f1d", "address": "fa:16:3e:33:c2:0b", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7066a691-99", "ovs_interfaceid": "7066a691-9911-48c6-a50c-de2e25f08f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:44:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-99296781-cf10-44c9-9b41-e9141b7bac0a req-8e9701b9-863d-45ce-85e1-a167fbb3c8f4 service nova] Releasing lock "refresh_cache-16097b06-976f-4fcd-a449-7b1ec8f739d1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:44:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/9e7978e9b012688ee41069e98147e9a78b58c0c4.part /opt/stack/data/nova/instances/_base/9e7978e9b012688ee41069e98147e9a78b58c0c4.converted" returned: 0 in 0.527s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e7978e9b012688ee41069e98147e9a78b58c0c4.converted --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e7978e9b012688ee41069e98147e9a78b58c0c4.converted --force-share --output=json" returned: 0 in 0.161s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "9e7978e9b012688ee41069e98147e9a78b58c0c4" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 2.035s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:44:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e7978e9b012688ee41069e98147e9a78b58c0c4 --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e7978e9b012688ee41069e98147e9a78b58c0c4 --force-share --output=json" returned: 0 in 0.146s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "9e7978e9b012688ee41069e98147e9a78b58c0c4" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:44:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "9e7978e9b012688ee41069e98147e9a78b58c0c4" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:44:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e7978e9b012688ee41069e98147e9a78b58c0c4 --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e7978e9b012688ee41069e98147e9a78b58c0c4 --force-share --output=json" returned: 0 in 0.212s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9e7978e9b012688ee41069e98147e9a78b58c0c4,backing_fmt=raw /opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/9e7978e9b012688ee41069e98147e9a78b58c0c4,backing_fmt=raw /opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/disk 1073741824" returned: 0 in 0.059s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "9e7978e9b012688ee41069e98147e9a78b58c0c4" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.279s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:44:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e7978e9b012688ee41069e98147e9a78b58c0c4 --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:36 user nova-compute[231753]: DEBUG nova.compute.manager [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Preparing to wait for external event volume-reimaged-ab44b913-5e3b-47fc-bd32-bd84e4d88f93 {{(pid=231753) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:283}}
Jul 29 13:44:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Acquiring lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:44:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:44:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.<locals>._create_or_get_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:44:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/9e7978e9b012688ee41069e98147e9a78b58c0c4 --force-share --output=json" returned: 0 in 0.166s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:36 user nova-compute[231753]: DEBUG nova.objects.instance [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lazy-loading 'migration_context' on Instance uuid 16097b06-976f-4fcd-a449-7b1ec8f739d1 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:44:36 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Rebasing disk image.
Jul 29 13:44:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.190s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a -F raw /opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/disk {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2869d038-137b-4ebc-9d7e-6dfd65e24db2 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Acquiring lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:44:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2869d038-137b-4ebc-9d7e-6dfd65e24db2 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:44:38 user nova-compute[231753]: INFO nova.compute.manager [None req-2869d038-137b-4ebc-9d7e-6dfd65e24db2 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Detaching volume 04a22034-ac5e-42aa-a4f1-4f6bcbee85ed
Jul 29 13:44:38 user nova-compute[231753]: INFO nova.virt.block_device [None req-2869d038-137b-4ebc-9d7e-6dfd65e24db2 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Attempting to driver detach volume 04a22034-ac5e-42aa-a4f1-4f6bcbee85ed from mountpoint /dev/vdb
Jul 29 13:44:38 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2869d038-137b-4ebc-9d7e-6dfd65e24db2 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Attempting to detach device vdb from instance 55bfcd1f-2b51-4e10-84a3-e132b96111e3 from the persistent domain config. {{(pid=231753) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 13:44:38 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-2869d038-137b-4ebc-9d7e-6dfd65e24db2 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:44:38 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:44:38 user nova-compute[231753]:   <source dev="/dev/sde"/>
Jul 29 13:44:38 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:44:38 user nova-compute[231753]:   <serial>04a22034-ac5e-42aa-a4f1-4f6bcbee85ed</serial>
Jul 29 13:44:38 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 13:44:38 user nova-compute[231753]: </disk>
Jul 29 13:44:38 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:44:38 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-2869d038-137b-4ebc-9d7e-6dfd65e24db2 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Successfully detached device vdb from instance 55bfcd1f-2b51-4e10-84a3-e132b96111e3 from the persistent domain config.
Jul 29 13:44:38 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2869d038-137b-4ebc-9d7e-6dfd65e24db2 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 55bfcd1f-2b51-4e10-84a3-e132b96111e3 from the live domain config. {{(pid=231753) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 13:44:38 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-2869d038-137b-4ebc-9d7e-6dfd65e24db2 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:44:38 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:44:38 user nova-compute[231753]:   <source dev="/dev/sde"/>
Jul 29 13:44:38 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:44:38 user nova-compute[231753]:   <serial>04a22034-ac5e-42aa-a4f1-4f6bcbee85ed</serial>
Jul 29 13:44:38 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 13:44:38 user nova-compute[231753]: </disk>
Jul 29 13:44:38 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:44:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2c8c09ab-3e57-4c03-b9d5-7f7a8a6d6b11 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "481435b2-4319-4caf-aa5b-5c986a747258" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:44:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2c8c09ab-3e57-4c03-b9d5-7f7a8a6d6b11 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "481435b2-4319-4caf-aa5b-5c986a747258" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:44:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2c8c09ab-3e57-4c03-b9d5-7f7a8a6d6b11 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "481435b2-4319-4caf-aa5b-5c986a747258-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:44:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2c8c09ab-3e57-4c03-b9d5-7f7a8a6d6b11 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "481435b2-4319-4caf-aa5b-5c986a747258-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:44:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2c8c09ab-3e57-4c03-b9d5-7f7a8a6d6b11 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "481435b2-4319-4caf-aa5b-5c986a747258-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:44:38 user nova-compute[231753]: INFO nova.compute.manager [None req-2c8c09ab-3e57-4c03-b9d5-7f7a8a6d6b11 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Terminating instance
Jul 29 13:44:38 user nova-compute[231753]: DEBUG nova.compute.manager [None req-2c8c09ab-3e57-4c03-b9d5-7f7a8a6d6b11 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:44:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Received event <DeviceRemovedEvent: 1690638279.1374815, 55bfcd1f-2b51-4e10-84a3-e132b96111e3 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=231753) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2869d038-137b-4ebc-9d7e-6dfd65e24db2 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 55bfcd1f-2b51-4e10-84a3-e132b96111e3 {{(pid=231753) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 13:44:39 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-2869d038-137b-4ebc-9d7e-6dfd65e24db2 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Successfully detached device vdb from instance 55bfcd1f-2b51-4e10-84a3-e132b96111e3 from the live domain config.
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2869d038-137b-4ebc-9d7e-6dfd65e24db2 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2869d038-137b-4ebc-9d7e-6dfd65e24db2 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'NVqGAIHZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:44:39 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-2869d038-137b-4ebc-9d7e-6dfd65e24db2 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:44:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-2869d038-137b-4ebc-9d7e-6dfd65e24db2 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-2869d038-137b-4ebc-9d7e-6dfd65e24db2 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.compute.manager [req-f546494f-227a-4a19-ab61-864ef77308b9 req-4584ba83-a5bc-4c0b-a986-ba7f2fff3265 service nova] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Received event network-vif-unplugged-a73b2376-652b-4f89-a463-3f854a2995ee {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-f546494f-227a-4a19-ab61-864ef77308b9 req-4584ba83-a5bc-4c0b-a986-ba7f2fff3265 service nova] Acquiring lock "481435b2-4319-4caf-aa5b-5c986a747258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-f546494f-227a-4a19-ab61-864ef77308b9 req-4584ba83-a5bc-4c0b-a986-ba7f2fff3265 service nova] Lock "481435b2-4319-4caf-aa5b-5c986a747258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-f546494f-227a-4a19-ab61-864ef77308b9 req-4584ba83-a5bc-4c0b-a986-ba7f2fff3265 service nova] Lock "481435b2-4319-4caf-aa5b-5c986a747258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.compute.manager [req-f546494f-227a-4a19-ab61-864ef77308b9 req-4584ba83-a5bc-4c0b-a986-ba7f2fff3265 service nova] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] No waiting events found dispatching network-vif-unplugged-a73b2376-652b-4f89-a463-3f854a2995ee {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.compute.manager [req-f546494f-227a-4a19-ab61-864ef77308b9 req-4584ba83-a5bc-4c0b-a986-ba7f2fff3265 service nova] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Received event network-vif-unplugged-a73b2376-652b-4f89-a463-3f854a2995ee for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bdacfc9-bc06-4e3a-a799-4687be4abe4f]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2869d038-137b-4ebc-9d7e-6dfd65e24db2 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:44:39 user nova-compute[231753]: No targets found.
Jul 29 13:44:39 user nova-compute[231753]: iSNS:
Jul 29 13:44:39 user nova-compute[231753]: No targets found.
Jul 29 13:44:39 user nova-compute[231753]: STATIC:
Jul 29 13:44:39 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea
Jul 29 13:44:39 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:44:39 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:44:39 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5
Jul 29 13:44:39 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:44:39 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:44:39 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed
Jul 29 13:44:39 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:44:39 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:44:39 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef
Jul 29 13:44:39 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:44:39 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:44:39 user nova-compute[231753]: FIRMWARE:
Jul 29 13:44:39 user nova-compute[231753]: No targets found.
Jul 29 13:44:39 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2869d038-137b-4ebc-9d7e-6dfd65e24db2 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:44:39 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:44:39 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2869d038-137b-4ebc-9d7e-6dfd65e24db2 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1727865-de7c-407e-ae6e-44d580560a23]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a94582-c6f9-4148-a79e-dfbfffddda51]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2869d038-137b-4ebc-9d7e-6dfd65e24db2 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:44:39 user nova-compute[231753]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)
Jul 29 13:44:39 user nova-compute[231753]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)
Jul 29 13:44:39 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:44:39 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2869d038-137b-4ebc-9d7e-6dfd65e24db2 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:44:39 user nova-compute[231753]: tcp: [26] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed (non-flash)
Jul 29 13:44:39 user nova-compute[231753]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)
Jul 29 13:44:39 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:44:39 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2869d038-137b-4ebc-9d7e-6dfd65e24db2 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c8045fa30>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed'): ({'sde'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-2869d038-137b-4ebc-9d7e-6dfd65e24db2 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Removing single pathed devices sde {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.038s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[48fa7e97-90f3-4f4a-a75e-5c6163251346]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a -F raw /opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/disk" returned: 0 in 3.053s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Ensure instance console log exists: /opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Start _get_guest_xml network_info=[{"id": "7066a691-9911-48c6-a50c-de2e25f08f1d", "address": "fa:16:3e:33:c2:0b", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7066a691-99", "ovs_interfaceid": "7066a691-9911-48c6-a50c-de2e25f08f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='6158282f485d5371bc6a0277660b3e4d',container_format='bare',created_at=2023-07-29T13:42:37Z,direct_url=<?>,disk_format='qcow2',id=86c962bf-36a6-4f61-873a-c2c030b9350f,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1785686519-shelved',owner='d53ebbb5f2e440dfa0cf3950232b4853',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-29T13:42:42Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.031s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[29f41e09-d65f-4628-96f7-b66ada5f55f4]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-2869d038-137b-4ebc-9d7e-6dfd65e24db2 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Flushing IO for device /dev/sde {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:39 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:44:39 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a702d17-faa9-4697-8f25-4d8e648ba92d]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-2869d038-137b-4ebc-9d7e-6dfd65e24db2 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='6158282f485d5371bc6a0277660b3e4d',container_format='bare',created_at=2023-07-29T13:42:37Z,direct_url=<?>,disk_format='qcow2',id=86c962bf-36a6-4f61-873a-c2c030b9350f,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1785686519-shelved',owner='d53ebbb5f2e440dfa0cf3950232b4853',properties=ImageMetaProps,protected=<?>,size=52297728,status='active',tags=<?>,updated_at=2023-07-29T13:42:42Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.objects.instance [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lazy-loading 'vcpu_model' on Instance uuid 16097b06-976f-4fcd-a449-7b1ec8f739d1 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-29T13:40:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1785686519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1785686519',id=22,image_ref='86c962bf-36a6-4f61-873a-c2c030b9350f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1407725312',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:40:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d53ebbb5f2e440dfa0cf3950232b4853',ramdisk_id='',reservation_id='r-u7dl5zqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-460717858',owner_user_name='tempest-AttachVolumeShelveTestJSON-460717858-project-member',shelved_at='2023-07-29T13:42:42.425459',shelved_host='user',shelved_image_id='86c962bf-36a6-4f61-873a-c2c030b9350f'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:44:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='932b5bd757f94be29d52035fd9f70293',uuid=16097b06-976f-4fcd-a449-7b1ec8f739d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7066a691-9911-48c6-a50c-de2e25f08f1d", "address": "fa:16:3e:33:c2:0b", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7066a691-99", "ovs_interfaceid": "7066a691-9911-48c6-a50c-de2e25f08f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Converting VIF {"id": "7066a691-9911-48c6-a50c-de2e25f08f1d", "address": "fa:16:3e:33:c2:0b", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7066a691-99", "ovs_interfaceid": "7066a691-9911-48c6-a50c-de2e25f08f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:c2:0b,bridge_name='br-int',has_traffic_filtering=True,id=7066a691-9911-48c6-a50c-de2e25f08f1d,network=Network(9be19067-cc29-4c67-95a0-cf37f95f9fc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7066a691-99') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.objects.instance [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lazy-loading 'pci_devices' on Instance uuid 16097b06-976f-4fcd-a449-7b1ec8f739d1 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.048s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[63877183-ffc1-4e4c-a812-0df39ae57115]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-2869d038-137b-4ebc-9d7e-6dfd65e24db2 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-2869d038-137b-4ebc-9d7e-6dfd65e24db2 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] SCSI volumes sde have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2869d038-137b-4ebc-9d7e-6dfd65e24db2 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:44:39 user nova-compute[231753]:   <uuid>16097b06-976f-4fcd-a449-7b1ec8f739d1</uuid>
Jul 29 13:44:39 user nova-compute[231753]:   <name>instance-00000016</name>
Jul 29 13:44:39 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:44:39 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:44:39 user nova-compute[231753]:   <metadata>
Jul 29 13:44:39 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:44:39 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:44:39 user nova-compute[231753]:       <nova:name>tempest-AttachVolumeShelveTestJSON-server-1785686519</nova:name>
Jul 29 13:44:39 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:44:39</nova:creationTime>
Jul 29 13:44:39 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:44:39 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:44:39 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:44:39 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:44:39 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:44:39 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:44:39 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:44:39 user nova-compute[231753]:       <nova:owner>
Jul 29 13:44:39 user nova-compute[231753]:         <nova:user uuid="932b5bd757f94be29d52035fd9f70293">tempest-AttachVolumeShelveTestJSON-460717858-project-member</nova:user>
Jul 29 13:44:39 user nova-compute[231753]:         <nova:project uuid="d53ebbb5f2e440dfa0cf3950232b4853">tempest-AttachVolumeShelveTestJSON-460717858</nova:project>
Jul 29 13:44:39 user nova-compute[231753]:       </nova:owner>
Jul 29 13:44:39 user nova-compute[231753]:       <nova:root type="image" uuid="86c962bf-36a6-4f61-873a-c2c030b9350f"/>
Jul 29 13:44:39 user nova-compute[231753]:       <nova:ports>
Jul 29 13:44:39 user nova-compute[231753]:         <nova:port uuid="7066a691-9911-48c6-a50c-de2e25f08f1d">
Jul 29 13:44:39 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 29 13:44:39 user nova-compute[231753]:         </nova:port>
Jul 29 13:44:39 user nova-compute[231753]:       </nova:ports>
Jul 29 13:44:39 user nova-compute[231753]:     </nova:instance>
Jul 29 13:44:39 user nova-compute[231753]:   </metadata>
Jul 29 13:44:39 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:44:39 user nova-compute[231753]:     <system>
Jul 29 13:44:39 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:44:39 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:44:39 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:44:39 user nova-compute[231753]:       <entry name="serial">16097b06-976f-4fcd-a449-7b1ec8f739d1</entry>
Jul 29 13:44:39 user nova-compute[231753]:       <entry name="uuid">16097b06-976f-4fcd-a449-7b1ec8f739d1</entry>
Jul 29 13:44:39 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:44:39 user nova-compute[231753]:     </system>
Jul 29 13:44:39 user nova-compute[231753]:   </sysinfo>
Jul 29 13:44:39 user nova-compute[231753]:   <os>
Jul 29 13:44:39 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:44:39 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:44:39 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:44:39 user nova-compute[231753]:   </os>
Jul 29 13:44:39 user nova-compute[231753]:   <features>
Jul 29 13:44:39 user nova-compute[231753]:     <acpi/>
Jul 29 13:44:39 user nova-compute[231753]:     <apic/>
Jul 29 13:44:39 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:44:39 user nova-compute[231753]:   </features>
Jul 29 13:44:39 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:44:39 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:44:39 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:44:39 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:44:39 user nova-compute[231753]:   </clock>
Jul 29 13:44:39 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:44:39 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:44:39 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:44:39 user nova-compute[231753]:   </cpu>
Jul 29 13:44:39 user nova-compute[231753]:   <devices>
Jul 29 13:44:39 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:44:39 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:44:39 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/disk"/>
Jul 29 13:44:39 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:44:39 user nova-compute[231753]:     </disk>
Jul 29 13:44:39 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:44:39 user nova-compute[231753]:       <mac address="fa:16:3e:33:c2:0b"/>
Jul 29 13:44:39 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:44:39 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:44:39 user nova-compute[231753]:       <target dev="tap7066a691-99"/>
Jul 29 13:44:39 user nova-compute[231753]:     </interface>
Jul 29 13:44:39 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:44:39 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/console.log" append="off"/>
Jul 29 13:44:39 user nova-compute[231753]:     </serial>
Jul 29 13:44:39 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:44:39 user nova-compute[231753]:     <video>
Jul 29 13:44:39 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:44:39 user nova-compute[231753]:     </video>
Jul 29 13:44:39 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:44:39 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:44:39 user nova-compute[231753]:     </rng>
Jul 29 13:44:39 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:44:39 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:44:39 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:44:39 user nova-compute[231753]:     </memballoon>
Jul 29 13:44:39 user nova-compute[231753]:   </devices>
Jul 29 13:44:39 user nova-compute[231753]: </domain>
Jul 29 13:44:39 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-29T13:40:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1785686519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1785686519',id=22,image_ref='86c962bf-36a6-4f61-873a-c2c030b9350f',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-keypair-1407725312',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:40:48Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='d53ebbb5f2e440dfa0cf3950232b4853',ramdisk_id='',reservation_id='r-u7dl5zqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-460717858',owner_user_name='tempest-AttachVolumeShelveTestJSON-460717858-project-member',shelved_at='2023-07-29T13:42:42.425459',shelved_host='user',shelved_image_id='86c962bf-36a6-4f61-873a-c2c030b9350f'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:44:31Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='932b5bd757f94be29d52035fd9f70293',uuid=16097b06-976f-4fcd-a449-7b1ec8f739d1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "7066a691-9911-48c6-a50c-de2e25f08f1d", "address": "fa:16:3e:33:c2:0b", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7066a691-99", "ovs_interfaceid": "7066a691-9911-48c6-a50c-de2e25f08f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Converting VIF {"id": "7066a691-9911-48c6-a50c-de2e25f08f1d", "address": "fa:16:3e:33:c2:0b", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7066a691-99", "ovs_interfaceid": "7066a691-9911-48c6-a50c-de2e25f08f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:c2:0b,bridge_name='br-int',has_traffic_filtering=True,id=7066a691-9911-48c6-a50c-de2e25f08f1d,network=Network(9be19067-cc29-4c67-95a0-cf37f95f9fc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7066a691-99') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG os_vif [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:c2:0b,bridge_name='br-int',has_traffic_filtering=True,id=7066a691-9911-48c6-a50c-de2e25f08f1d,network=Network(9be19067-cc29-4c67-95a0-cf37f95f9fc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7066a691-99') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd746b3-4bce-40c0-8428-4b817ab92935]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2869d038-137b-4ebc-9d7e-6dfd65e24db2 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7066a691-99, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap7066a691-99, col_values=(('external_ids', {'iface-id': '7066a691-9911-48c6-a50c-de2e25f08f1d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:33:c2:0b', 'vm-uuid': '16097b06-976f-4fcd-a449-7b1ec8f739d1'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:44:39 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Instance destroyed successfully.
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.objects.instance [None req-2c8c09ab-3e57-4c03-b9d5-7f7a8a6d6b11 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lazy-loading 'resources' on Instance uuid 481435b2-4319-4caf-aa5b-5c986a747258 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-2c8c09ab-3e57-4c03-b9d5-7f7a8a6d6b11 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:38:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1046079103',display_name='tempest-AttachVolumeNegativeTest-server-1046079103',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1046079103',id=19,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGyAEcUFDiNBsPFPPa+JR0QYMpbX4Y39F0skkPuwRnwBReQGnE3vcfy0e1rLLudNwbWD8rIZ9YeyCBDoyr62sJkm43PWHVUuioFvdFQz2pf1i4HNLoMm8tw4X3VTI+a7Hw==',key_name='tempest-keypair-2143632731',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:39:00Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f3122196c4504a82a2a01774ab60406a',ramdisk_id='',reservation_id='r-g2m77k0r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1031975907',owner_user_name='tempest-AttachVolumeNegativeTest-1031975907-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:39:01Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a09de75c8ab742fe951604b612ea5839',uuid=481435b2-4319-4caf-aa5b-5c986a747258,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a73b2376-652b-4f89-a463-3f854a2995ee", "address": "fa:16:3e:77:e8:2e", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73b2376-65", "ovs_interfaceid": "a73b2376-652b-4f89-a463-3f854a2995ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-2c8c09ab-3e57-4c03-b9d5-7f7a8a6d6b11 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Converting VIF {"id": "a73b2376-652b-4f89-a463-3f854a2995ee", "address": "fa:16:3e:77:e8:2e", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.143", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa73b2376-65", "ovs_interfaceid": "a73b2376-652b-4f89-a463-3f854a2995ee", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-2c8c09ab-3e57-4c03-b9d5-7f7a8a6d6b11 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:77:e8:2e,bridge_name='br-int',has_traffic_filtering=True,id=a73b2376-652b-4f89-a463-3f854a2995ee,network=Network(1ff03660-77ea-4ec6-8eeb-55df7e78096b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73b2376-65') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG os_vif [None req-2c8c09ab-3e57-4c03-b9d5-7f7a8a6d6b11 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:e8:2e,bridge_name='br-int',has_traffic_filtering=True,id=a73b2376-652b-4f89-a463-3f854a2995ee,network=Network(1ff03660-77ea-4ec6-8eeb-55df7e78096b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73b2376-65') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:44:39 user nova-compute[231753]: INFO os_vif [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:c2:0b,bridge_name='br-int',has_traffic_filtering=True,id=7066a691-9911-48c6-a50c-de2e25f08f1d,network=Network(9be19067-cc29-4c67-95a0-cf37f95f9fc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7066a691-99')
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed -p 172.16.0.220:3260 --logout" returned: 0 in 0.078s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b8c676a-2e06-47f0-82d7-7bde31ff9247]: (4, ('Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed, portal: 172.16.0.220,3260]\nLogout of [sid: 26, target: iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2869d038-137b-4ebc-9d7e-6dfd65e24db2 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed, portal: 172.16.0.220,3260]
Jul 29 13:44:39 user nova-compute[231753]: Logout of [sid: 26, target: iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed, portal: 172.16.0.220,3260] successful.
Jul 29 13:44:39 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa73b2376-65, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:04a22034-ac5e-42aa-a4f1-4f6bcbee85ed -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:39 user nova-compute[231753]: INFO os_vif [None req-2c8c09ab-3e57-4c03-b9d5-7f7a8a6d6b11 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:77:e8:2e,bridge_name='br-int',has_traffic_filtering=True,id=a73b2376-652b-4f89-a463-3f854a2995ee,network=Network(1ff03660-77ea-4ec6-8eeb-55df7e78096b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa73b2376-65')
Jul 29 13:44:39 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-2c8c09ab-3e57-4c03-b9d5-7f7a8a6d6b11 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Deleting instance files /opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258_del
Jul 29 13:44:39 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-2c8c09ab-3e57-4c03-b9d5-7f7a8a6d6b11 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Deletion of /opt/stack/data/nova/instances/481435b2-4319-4caf-aa5b-5c986a747258_del complete
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36a82af-3dde-495c-950d-838aa9ebf300]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2869d038-137b-4ebc-9d7e-6dfd65e24db2 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-2869d038-137b-4ebc-9d7e-6dfd65e24db2 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.509s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2869d038-137b-4ebc-9d7e-6dfd65e24db2 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] <== disconnect_volume: return (510ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2869d038-137b-4ebc-9d7e-6dfd65e24db2 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] No VIF found with MAC fa:16:3e:33:c2:0b, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:44:39 user nova-compute[231753]: INFO nova.compute.manager [None req-2c8c09ab-3e57-4c03-b9d5-7f7a8a6d6b11 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Took 1.14 seconds to destroy the instance on the hypervisor.
Jul 29 13:44:39 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-2c8c09ab-3e57-4c03-b9d5-7f7a8a6d6b11 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:44:39 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:44:40 user nova-compute[231753]: DEBUG nova.objects.instance [None req-2869d038-137b-4ebc-9d7e-6dfd65e24db2 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lazy-loading 'flavor' on Instance uuid 55bfcd1f-2b51-4e10-84a3-e132b96111e3 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:44:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2869d038-137b-4ebc-9d7e-6dfd65e24db2 tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.247s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:44:40 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:44:40 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Took 1.01 seconds to deallocate network for instance.
Jul 29 13:44:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2c8c09ab-3e57-4c03-b9d5-7f7a8a6d6b11 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:44:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2c8c09ab-3e57-4c03-b9d5-7f7a8a6d6b11 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:44:41 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:41 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:41 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:41 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:41 user nova-compute[231753]: DEBUG nova.compute.manager [req-85b358a5-0fff-49f9-82a5-8c6bb2803aa3 req-ecb9584b-fe5f-4483-b195-c6459034140f service nova] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Received event network-vif-plugged-a73b2376-652b-4f89-a463-3f854a2995ee {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:44:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-85b358a5-0fff-49f9-82a5-8c6bb2803aa3 req-ecb9584b-fe5f-4483-b195-c6459034140f service nova] Acquiring lock "481435b2-4319-4caf-aa5b-5c986a747258-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:44:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-85b358a5-0fff-49f9-82a5-8c6bb2803aa3 req-ecb9584b-fe5f-4483-b195-c6459034140f service nova] Lock "481435b2-4319-4caf-aa5b-5c986a747258-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:44:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-85b358a5-0fff-49f9-82a5-8c6bb2803aa3 req-ecb9584b-fe5f-4483-b195-c6459034140f service nova] Lock "481435b2-4319-4caf-aa5b-5c986a747258-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:44:41 user nova-compute[231753]: DEBUG nova.compute.manager [req-85b358a5-0fff-49f9-82a5-8c6bb2803aa3 req-ecb9584b-fe5f-4483-b195-c6459034140f service nova] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] No waiting events found dispatching network-vif-plugged-a73b2376-652b-4f89-a463-3f854a2995ee {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:44:41 user nova-compute[231753]: WARNING nova.compute.manager [req-85b358a5-0fff-49f9-82a5-8c6bb2803aa3 req-ecb9584b-fe5f-4483-b195-c6459034140f service nova] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Received unexpected event network-vif-plugged-a73b2376-652b-4f89-a463-3f854a2995ee for instance with vm_state deleted and task_state None.
Jul 29 13:44:41 user nova-compute[231753]: DEBUG nova.compute.manager [req-85b358a5-0fff-49f9-82a5-8c6bb2803aa3 req-ecb9584b-fe5f-4483-b195-c6459034140f service nova] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Received event network-vif-deleted-a73b2376-652b-4f89-a463-3f854a2995ee {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:44:41 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-2c8c09ab-3e57-4c03-b9d5-7f7a8a6d6b11 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:44:41 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-2c8c09ab-3e57-4c03-b9d5-7f7a8a6d6b11 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:44:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2c8c09ab-3e57-4c03-b9d5-7f7a8a6d6b11 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.594s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:44:41 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-2c8c09ab-3e57-4c03-b9d5-7f7a8a6d6b11 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Deleted allocations for instance 481435b2-4319-4caf-aa5b-5c986a747258
Jul 29 13:44:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2c8c09ab-3e57-4c03-b9d5-7f7a8a6d6b11 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "481435b2-4319-4caf-aa5b-5c986a747258" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.047s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:44:41 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:41 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:41 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:43 user nova-compute[231753]: DEBUG nova.compute.manager [req-4de18e11-e02b-4012-b2f0-d8287ec40176 req-3989213a-faad-4008-957c-d53647ce985e service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Received event network-vif-plugged-7066a691-9911-48c6-a50c-de2e25f08f1d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:44:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4de18e11-e02b-4012-b2f0-d8287ec40176 req-3989213a-faad-4008-957c-d53647ce985e service nova] Acquiring lock "16097b06-976f-4fcd-a449-7b1ec8f739d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:44:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4de18e11-e02b-4012-b2f0-d8287ec40176 req-3989213a-faad-4008-957c-d53647ce985e service nova] Lock "16097b06-976f-4fcd-a449-7b1ec8f739d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:44:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4de18e11-e02b-4012-b2f0-d8287ec40176 req-3989213a-faad-4008-957c-d53647ce985e service nova] Lock "16097b06-976f-4fcd-a449-7b1ec8f739d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:44:43 user nova-compute[231753]: DEBUG nova.compute.manager [req-4de18e11-e02b-4012-b2f0-d8287ec40176 req-3989213a-faad-4008-957c-d53647ce985e service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] No waiting events found dispatching network-vif-plugged-7066a691-9911-48c6-a50c-de2e25f08f1d {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:44:43 user nova-compute[231753]: WARNING nova.compute.manager [req-4de18e11-e02b-4012-b2f0-d8287ec40176 req-3989213a-faad-4008-957c-d53647ce985e service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Received unexpected event network-vif-plugged-7066a691-9911-48c6-a50c-de2e25f08f1d for instance with vm_state shelved_offloaded and task_state spawning.
Jul 29 13:44:43 user nova-compute[231753]: DEBUG nova.compute.manager [req-4de18e11-e02b-4012-b2f0-d8287ec40176 req-3989213a-faad-4008-957c-d53647ce985e service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Received event network-vif-plugged-7066a691-9911-48c6-a50c-de2e25f08f1d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:44:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4de18e11-e02b-4012-b2f0-d8287ec40176 req-3989213a-faad-4008-957c-d53647ce985e service nova] Acquiring lock "16097b06-976f-4fcd-a449-7b1ec8f739d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:44:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4de18e11-e02b-4012-b2f0-d8287ec40176 req-3989213a-faad-4008-957c-d53647ce985e service nova] Lock "16097b06-976f-4fcd-a449-7b1ec8f739d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:44:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4de18e11-e02b-4012-b2f0-d8287ec40176 req-3989213a-faad-4008-957c-d53647ce985e service nova] Lock "16097b06-976f-4fcd-a449-7b1ec8f739d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:44:43 user nova-compute[231753]: DEBUG nova.compute.manager [req-4de18e11-e02b-4012-b2f0-d8287ec40176 req-3989213a-faad-4008-957c-d53647ce985e service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] No waiting events found dispatching network-vif-plugged-7066a691-9911-48c6-a50c-de2e25f08f1d {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:44:43 user nova-compute[231753]: WARNING nova.compute.manager [req-4de18e11-e02b-4012-b2f0-d8287ec40176 req-3989213a-faad-4008-957c-d53647ce985e service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Received unexpected event network-vif-plugged-7066a691-9911-48c6-a50c-de2e25f08f1d for instance with vm_state shelved_offloaded and task_state spawning.
Jul 29 13:44:43 user nova-compute[231753]: DEBUG nova.compute.manager [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:44:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:44:43 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638283.5185568, 16097b06-976f-4fcd-a449-7b1ec8f739d1 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:44:43 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] VM Resumed (Lifecycle Event)
Jul 29 13:44:43 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Instance spawned successfully.
Jul 29 13:44:43 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:44:43 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:44:43 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:44:43 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638283.518768, 16097b06-976f-4fcd-a449-7b1ec8f739d1 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:44:43 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] VM Started (Lifecycle Event)
Jul 29 13:44:43 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:44:43 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:44:43 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:44:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:43 user nova-compute[231753]: DEBUG nova.compute.manager [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:44:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e8bc7e11-6e66-46ac-9e12-d7e0fbfdf7d6 tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "16097b06-976f-4fcd-a449-7b1ec8f739d1" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 13.046s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:44:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:47 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690638272.9628642, 37fbc873-537c-4bbc-a57b-2c44e47ecf30 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:44:47 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] VM Stopped (Lifecycle Event)
Jul 29 13:44:47 user nova-compute[231753]: DEBUG nova.compute.manager [None req-117dccb6-22d0-4b72-a29a-523774aef34b None None] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:44:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:50 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:50 user nova-compute[231753]: INFO nova.compute.manager [None req-56a26fe5-7bab-46e0-9174-c3f16f2ddff5 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Unrescuing
Jul 29 13:44:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-56a26fe5-7bab-46e0-9174-c3f16f2ddff5 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "refresh_cache-b99a72ba-73e2-4be7-b52b-7797351daa5f" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:44:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-56a26fe5-7bab-46e0-9174-c3f16f2ddff5 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquired lock "refresh_cache-b99a72ba-73e2-4be7-b52b-7797351daa5f" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:44:50 user nova-compute[231753]: DEBUG nova.network.neutron [None req-56a26fe5-7bab-46e0-9174-c3f16f2ddff5 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:44:50 user nova-compute[231753]: DEBUG nova.network.neutron [None req-56a26fe5-7bab-46e0-9174-c3f16f2ddff5 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Updating instance_info_cache with network_info: [{"id": "d145cf59-908e-42c4-ba8e-ce5abe640639", "address": "fa:16:3e:25:37:92", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd145cf59-90", "ovs_interfaceid": "d145cf59-908e-42c4-ba8e-ce5abe640639", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:44:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-56a26fe5-7bab-46e0-9174-c3f16f2ddff5 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Releasing lock "refresh_cache-b99a72ba-73e2-4be7-b52b-7797351daa5f" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:44:50 user nova-compute[231753]: DEBUG nova.objects.instance [None req-56a26fe5-7bab-46e0-9174-c3f16f2ddff5 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lazy-loading 'flavor' on Instance uuid b99a72ba-73e2-4be7-b52b-7797351daa5f {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:44:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:51 user nova-compute[231753]: DEBUG nova.compute.manager [req-7ca63466-8192-4736-999d-62a52116f420 req-8b4274a5-cbed-4e72-b127-6effb4f8dcbf service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Received event network-vif-unplugged-d145cf59-908e-42c4-ba8e-ce5abe640639 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:44:51 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7ca63466-8192-4736-999d-62a52116f420 req-8b4274a5-cbed-4e72-b127-6effb4f8dcbf service nova] Acquiring lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:44:51 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7ca63466-8192-4736-999d-62a52116f420 req-8b4274a5-cbed-4e72-b127-6effb4f8dcbf service nova] Lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:44:51 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7ca63466-8192-4736-999d-62a52116f420 req-8b4274a5-cbed-4e72-b127-6effb4f8dcbf service nova] Lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:44:51 user nova-compute[231753]: DEBUG nova.compute.manager [req-7ca63466-8192-4736-999d-62a52116f420 req-8b4274a5-cbed-4e72-b127-6effb4f8dcbf service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] No waiting events found dispatching network-vif-unplugged-d145cf59-908e-42c4-ba8e-ce5abe640639 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:44:51 user nova-compute[231753]: WARNING nova.compute.manager [req-7ca63466-8192-4736-999d-62a52116f420 req-8b4274a5-cbed-4e72-b127-6effb4f8dcbf service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Received unexpected event network-vif-unplugged-d145cf59-908e-42c4-ba8e-ce5abe640639 for instance with vm_state rescued and task_state unrescuing.
Jul 29 13:44:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:51 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Instance destroyed successfully.
Jul 29 13:44:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:53 user nova-compute[231753]: DEBUG nova.compute.manager [req-1b505b71-ae6b-48cc-b4d1-ca3b594732cb req-16f40344-1b8a-409f-b668-d32416b9460f service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Received event network-vif-plugged-d145cf59-908e-42c4-ba8e-ce5abe640639 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:44:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-1b505b71-ae6b-48cc-b4d1-ca3b594732cb req-16f40344-1b8a-409f-b668-d32416b9460f service nova] Acquiring lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:44:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-1b505b71-ae6b-48cc-b4d1-ca3b594732cb req-16f40344-1b8a-409f-b668-d32416b9460f service nova] Lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:44:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-1b505b71-ae6b-48cc-b4d1-ca3b594732cb req-16f40344-1b8a-409f-b668-d32416b9460f service nova] Lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:44:53 user nova-compute[231753]: DEBUG nova.compute.manager [req-1b505b71-ae6b-48cc-b4d1-ca3b594732cb req-16f40344-1b8a-409f-b668-d32416b9460f service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] No waiting events found dispatching network-vif-plugged-d145cf59-908e-42c4-ba8e-ce5abe640639 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:44:53 user nova-compute[231753]: WARNING nova.compute.manager [req-1b505b71-ae6b-48cc-b4d1-ca3b594732cb req-16f40344-1b8a-409f-b668-d32416b9460f service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Received unexpected event network-vif-plugged-d145cf59-908e-42c4-ba8e-ce5abe640639 for instance with vm_state rescued and task_state unrescuing.
Jul 29 13:44:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:54 user nova-compute[231753]: DEBUG nova.compute.manager [req-71c21297-7221-4bb7-a20d-279ac05a2498 req-436d49a7-4884-42bb-bc95-0dc49c9191ad service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Received event volume-reimaged-ab44b913-5e3b-47fc-bd32-bd84e4d88f93 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:44:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-71c21297-7221-4bb7-a20d-279ac05a2498 req-436d49a7-4884-42bb-bc95-0dc49c9191ad service nova] Acquiring lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:44:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-71c21297-7221-4bb7-a20d-279ac05a2498 req-436d49a7-4884-42bb-bc95-0dc49c9191ad service nova] Lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:44:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-71c21297-7221-4bb7-a20d-279ac05a2498 req-436d49a7-4884-42bb-bc95-0dc49c9191ad service nova] Lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:44:54 user nova-compute[231753]: DEBUG nova.compute.manager [req-71c21297-7221-4bb7-a20d-279ac05a2498 req-436d49a7-4884-42bb-bc95-0dc49c9191ad service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Processing event volume-reimaged-ab44b913-5e3b-47fc-bd32-bd84e4d88f93 {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10792}}
Jul 29 13:44:54 user nova-compute[231753]: DEBUG nova.compute.manager [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Instance event wait completed in 18 seconds for volume-reimaged {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:44:54 user nova-compute[231753]: INFO nova.virt.block_device [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Booting with volume ab44b913-5e3b-47fc-bd32-bd84e4d88f93 at /dev/vda
Jul 29 13:44:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:54 user nova-compute[231753]: DEBUG os_brick.utils [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:44:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c56b6be-8802-4e18-a7e6-cbc9306855a4]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a3a06d8-b229-443b-8953-c89e10e983f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:44:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9af03bb-12c4-4ad8-ad06-c3a2afeb9ae0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6799e10-4d28-4f15-8f1c-2e775961799a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:44:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:44:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:44:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:44:54 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:44:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7edeba79-07b5-45eb-8fa2-2b1dda5916e2]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:44:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:44:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:44:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:44:54 user nova-compute[231753]: DEBUG os_brick.utils [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] <== get_connector_properties: return (141ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:44:54 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Updating existing volume attachment record: 576d7287-3395-4bb9-8a87-bed388bff0cd {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:44:54 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690638279.5707362, 481435b2-4319-4caf-aa5b-5c986a747258 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:44:54 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] VM Stopped (Lifecycle Event)
Jul 29 13:44:54 user nova-compute[231753]: DEBUG nova.compute.manager [None req-de6daca7-6cde-4cfd-8d2f-b15c3ede528c None None] [instance: 481435b2-4319-4caf-aa5b-5c986a747258] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:44:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:55 user nova-compute[231753]: DEBUG nova.compute.manager [req-c3442d3c-182e-4bfd-b79f-1972180c5e8e req-e905e4aa-1112-4f4c-92e3-e3841814ff66 service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Received event network-vif-plugged-d145cf59-908e-42c4-ba8e-ce5abe640639 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:44:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c3442d3c-182e-4bfd-b79f-1972180c5e8e req-e905e4aa-1112-4f4c-92e3-e3841814ff66 service nova] Acquiring lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:44:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c3442d3c-182e-4bfd-b79f-1972180c5e8e req-e905e4aa-1112-4f4c-92e3-e3841814ff66 service nova] Lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:44:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c3442d3c-182e-4bfd-b79f-1972180c5e8e req-e905e4aa-1112-4f4c-92e3-e3841814ff66 service nova] Lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:44:55 user nova-compute[231753]: DEBUG nova.compute.manager [req-c3442d3c-182e-4bfd-b79f-1972180c5e8e req-e905e4aa-1112-4f4c-92e3-e3841814ff66 service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] No waiting events found dispatching network-vif-plugged-d145cf59-908e-42c4-ba8e-ce5abe640639 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:44:55 user nova-compute[231753]: WARNING nova.compute.manager [req-c3442d3c-182e-4bfd-b79f-1972180c5e8e req-e905e4aa-1112-4f4c-92e3-e3841814ff66 service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Received unexpected event network-vif-plugged-d145cf59-908e-42c4-ba8e-ce5abe640639 for instance with vm_state rescued and task_state unrescuing.
Jul 29 13:44:55 user nova-compute[231753]: DEBUG nova.compute.manager [req-c3442d3c-182e-4bfd-b79f-1972180c5e8e req-e905e4aa-1112-4f4c-92e3-e3841814ff66 service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Received event network-vif-plugged-d145cf59-908e-42c4-ba8e-ce5abe640639 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:44:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c3442d3c-182e-4bfd-b79f-1972180c5e8e req-e905e4aa-1112-4f4c-92e3-e3841814ff66 service nova] Acquiring lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:44:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c3442d3c-182e-4bfd-b79f-1972180c5e8e req-e905e4aa-1112-4f4c-92e3-e3841814ff66 service nova] Lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:44:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c3442d3c-182e-4bfd-b79f-1972180c5e8e req-e905e4aa-1112-4f4c-92e3-e3841814ff66 service nova] Lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:44:55 user nova-compute[231753]: DEBUG nova.compute.manager [req-c3442d3c-182e-4bfd-b79f-1972180c5e8e req-e905e4aa-1112-4f4c-92e3-e3841814ff66 service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] No waiting events found dispatching network-vif-plugged-d145cf59-908e-42c4-ba8e-ce5abe640639 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:44:55 user nova-compute[231753]: WARNING nova.compute.manager [req-c3442d3c-182e-4bfd-b79f-1972180c5e8e req-e905e4aa-1112-4f4c-92e3-e3841814ff66 service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Received unexpected event network-vif-plugged-d145cf59-908e-42c4-ba8e-ce5abe640639 for instance with vm_state rescued and task_state unrescuing.
Jul 29 13:44:55 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Removed pending event for b99a72ba-73e2-4be7-b52b-7797351daa5f due to event {{(pid=231753) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 29 13:44:55 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638295.5846334, b99a72ba-73e2-4be7-b52b-7797351daa5f => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:44:55 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] VM Resumed (Lifecycle Event)
Jul 29 13:44:55 user nova-compute[231753]: DEBUG nova.compute.manager [None req-56a26fe5-7bab-46e0-9174-c3f16f2ddff5 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:44:55 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:44:55 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:44:55 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 29 13:44:55 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638295.586091, b99a72ba-73e2-4be7-b52b-7797351daa5f => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:44:55 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] VM Started (Lifecycle Event)
Jul 29 13:44:55 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:44:55 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:44:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:44:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:01 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:45:02 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Creating image(s)
Jul 29 13:45:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Did not create local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Ensure instance console log exists: /opt/stack/data/nova/instances/37fbc873-537c-4bbc-a57b-2c44e47ecf30/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Start _get_guest_xml network_info=[{"id": "78884930-2bc7-430e-b250-851ff726d5f8", "address": "fa:16:3e:0e:5d:f8", "network": {"id": "c8ebc7da-3ffe-45a0-b7f5-bb85261852ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1496462371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876fbcda354d47c197ce14ca4ed7ead6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78884930-2b", "ovs_interfaceid": "78884930-2bc7-430e-b250-851ff726d5f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ogpdWmcA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '37fbc873-537c-4bbc-a57b-2c44e47ecf30', 'attached_at': '', 'detached_at': '', 'volume_id': 'ab44b913-5e3b-47fc-bd32-bd84e4d88f93', 'serial': 'ab44b913-5e3b-47fc-bd32-bd84e4d88f93'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'attachment_id': '576d7287-3395-4bb9-8a87-bed388bff0cd', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:45:02 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 29 13:45:02 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError
Jul 29 13:45:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG nova.objects.instance [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lazy-loading 'vcpu_model' on Instance uuid 37fbc873-537c-4bbc-a57b-2c44e47ecf30 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ogpdWmcA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:45:02 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 29 13:45:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:45:02 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release: NotImplementedError
Jul 29 13:45:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:45:02 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:45:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17d6d28-a72d-48d2-a5b6-5065c55ff951]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:45:02 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bbb329b-0a17-4737-a281-129673349655]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93] added
Jul 29 13:45:02 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5c5fada-6ad4-41fb-a9c5-4879283d25cc]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f547904-88c8-4f2d-a400-6795c6c4d148]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ogpdWmcA {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v ogpdWmcA" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aaa9cc1-25c5-49de-96a2-254db18b7533]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'ogpdWmcA'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2cf0947-8544-48df-a0f7-60371d36a9d8]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[659b3cdb-f58b-490b-a978-b3b4e27c7824]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:45:02 user nova-compute[231753]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)
Jul 29 13:45:02 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:45:02 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:45:02 user nova-compute[231753]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)
Jul 29 13:45:02 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:45:02 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --login" returned: 0 in 0.078s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[605f2431-2182-4e0f-b042-50f80919d0af]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93, portal: 172.16.0.220,3260]
Jul 29 13:45:02 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93, portal: 172.16.0.220,3260] successful.
Jul 29 13:45:02 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0797408e-dd8f-4f6f-be05-3da22e1cb095]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d459908d-d433-417f-a747-1b2055bce20f]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:45:02 user nova-compute[231753]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)
Jul 29 13:45:02 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:45:02 user nova-compute[231753]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)
Jul 29 13:45:02 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:45:02 user nova-compute[231753]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)
Jul 29 13:45:02 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:45:02 user nova-compute[231753]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)
Jul 29 13:45:02 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.327s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] HCTL ('33', '-', '-', 0) found on session 32 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb25b780-786e-4fc8-84df-a3ec81a07e9d]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Searching for a device in session 32 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:45:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ogpdWmcA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:45:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:03 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.366s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:45:03 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] <== connect_volume: return (1367ms) {'type': 'block', 'scsi_wwn': '23063303462343935', 'path': '/dev/sdb'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:45:03 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23063303462343935', 'path': '/dev/sdb'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:45:03 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-29T13:42:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-565491757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1951457883',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDc03FdfB1WkJMQ+OFlTQGDyqI+vnX8r38QSC1X3+I46SKYhhpq2ELYDYwCr+yT2E/7oa4VZ/8HKFoV3Qq+q1XdXsiLTiNzAVeDrjcozJkO0FAkqdQDw0IZWfQrN8WwQag==',key_name='tempest-keypair-386440795',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:42:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='876fbcda354d47c197ce14ca4ed7ead6',ramdisk_id='',reservation_id='r-8m5l27cs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1385583979',owner_user_name='tempest-ServerActionsV293TestJSON-1385583979-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:44:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3330125060d64234bce343af655e58e3',uuid=37fbc873-537c-4bbc-a57b-2c44e47ecf30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78884930-2bc7-430e-b250-851ff726d5f8", "address": "fa:16:3e:0e:5d:f8", "network": {"id": "c8ebc7da-3ffe-45a0-b7f5-bb85261852ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1496462371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876fbcda354d47c197ce14ca4ed7ead6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78884930-2b", "ovs_interfaceid": "78884930-2bc7-430e-b250-851ff726d5f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:45:03 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Converting VIF {"id": "78884930-2bc7-430e-b250-851ff726d5f8", "address": "fa:16:3e:0e:5d:f8", "network": {"id": "c8ebc7da-3ffe-45a0-b7f5-bb85261852ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1496462371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876fbcda354d47c197ce14ca4ed7ead6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78884930-2b", "ovs_interfaceid": "78884930-2bc7-430e-b250-851ff726d5f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:45:03 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:5d:f8,bridge_name='br-int',has_traffic_filtering=True,id=78884930-2bc7-430e-b250-851ff726d5f8,network=Network(c8ebc7da-3ffe-45a0-b7f5-bb85261852ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78884930-2b') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:45:03 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:45:03 user nova-compute[231753]:   <uuid>37fbc873-537c-4bbc-a57b-2c44e47ecf30</uuid>
Jul 29 13:45:03 user nova-compute[231753]:   <name>instance-0000001b</name>
Jul 29 13:45:03 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:45:03 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:45:03 user nova-compute[231753]:   <metadata>
Jul 29 13:45:03 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:45:03 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:45:03 user nova-compute[231753]:       <nova:name>tempest-ServerActionsV293TestJSON-server-565491757</nova:name>
Jul 29 13:45:03 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:45:02</nova:creationTime>
Jul 29 13:45:03 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:45:03 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:45:03 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:45:03 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:45:03 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:45:03 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:45:03 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:45:03 user nova-compute[231753]:       <nova:owner>
Jul 29 13:45:03 user nova-compute[231753]:         <nova:user uuid="3330125060d64234bce343af655e58e3">tempest-ServerActionsV293TestJSON-1385583979-project-member</nova:user>
Jul 29 13:45:03 user nova-compute[231753]:         <nova:project uuid="876fbcda354d47c197ce14ca4ed7ead6">tempest-ServerActionsV293TestJSON-1385583979</nova:project>
Jul 29 13:45:03 user nova-compute[231753]:       </nova:owner>
Jul 29 13:45:03 user nova-compute[231753]:       <nova:ports>
Jul 29 13:45:03 user nova-compute[231753]:         <nova:port uuid="78884930-2bc7-430e-b250-851ff726d5f8">
Jul 29 13:45:03 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 29 13:45:03 user nova-compute[231753]:         </nova:port>
Jul 29 13:45:03 user nova-compute[231753]:       </nova:ports>
Jul 29 13:45:03 user nova-compute[231753]:     </nova:instance>
Jul 29 13:45:03 user nova-compute[231753]:   </metadata>
Jul 29 13:45:03 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:45:03 user nova-compute[231753]:     <system>
Jul 29 13:45:03 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:45:03 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:45:03 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:45:03 user nova-compute[231753]:       <entry name="serial">37fbc873-537c-4bbc-a57b-2c44e47ecf30</entry>
Jul 29 13:45:03 user nova-compute[231753]:       <entry name="uuid">37fbc873-537c-4bbc-a57b-2c44e47ecf30</entry>
Jul 29 13:45:03 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:45:03 user nova-compute[231753]:     </system>
Jul 29 13:45:03 user nova-compute[231753]:   </sysinfo>
Jul 29 13:45:03 user nova-compute[231753]:   <os>
Jul 29 13:45:03 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:45:03 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:45:03 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:45:03 user nova-compute[231753]:   </os>
Jul 29 13:45:03 user nova-compute[231753]:   <features>
Jul 29 13:45:03 user nova-compute[231753]:     <acpi/>
Jul 29 13:45:03 user nova-compute[231753]:     <apic/>
Jul 29 13:45:03 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:45:03 user nova-compute[231753]:   </features>
Jul 29 13:45:03 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:45:03 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:45:03 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:45:03 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:45:03 user nova-compute[231753]:   </clock>
Jul 29 13:45:03 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:45:03 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:45:03 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:45:03 user nova-compute[231753]:   </cpu>
Jul 29 13:45:03 user nova-compute[231753]:   <devices>
Jul 29 13:45:03 user nova-compute[231753]:     <disk type="block" device="disk">
Jul 29 13:45:03 user nova-compute[231753]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:45:03 user nova-compute[231753]:       <source dev="/dev/sdb"/>
Jul 29 13:45:03 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:45:03 user nova-compute[231753]:       <serial>ab44b913-5e3b-47fc-bd32-bd84e4d88f93</serial>
Jul 29 13:45:03 user nova-compute[231753]:     </disk>
Jul 29 13:45:03 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:45:03 user nova-compute[231753]:       <mac address="fa:16:3e:0e:5d:f8"/>
Jul 29 13:45:03 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:45:03 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:45:03 user nova-compute[231753]:       <target dev="tap78884930-2b"/>
Jul 29 13:45:03 user nova-compute[231753]:     </interface>
Jul 29 13:45:03 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:45:03 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/37fbc873-537c-4bbc-a57b-2c44e47ecf30/console.log" append="off"/>
Jul 29 13:45:03 user nova-compute[231753]:     </serial>
Jul 29 13:45:03 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:45:03 user nova-compute[231753]:     <video>
Jul 29 13:45:03 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:45:03 user nova-compute[231753]:     </video>
Jul 29 13:45:03 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:45:03 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:45:03 user nova-compute[231753]:     </rng>
Jul 29 13:45:03 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:45:03 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:45:03 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:45:03 user nova-compute[231753]:     </memballoon>
Jul 29 13:45:03 user nova-compute[231753]:   </devices>
Jul 29 13:45:03 user nova-compute[231753]: </domain>
Jul 29 13:45:03 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:45:03 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-29T13:42:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-565491757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1951457883',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDc03FdfB1WkJMQ+OFlTQGDyqI+vnX8r38QSC1X3+I46SKYhhpq2ELYDYwCr+yT2E/7oa4VZ/8HKFoV3Qq+q1XdXsiLTiNzAVeDrjcozJkO0FAkqdQDw0IZWfQrN8WwQag==',key_name='tempest-keypair-386440795',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:42:53Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='876fbcda354d47c197ce14ca4ed7ead6',ramdisk_id='',reservation_id='r-8m5l27cs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1385583979',owner_user_name='tempest-ServerActionsV293TestJSON-1385583979-project-member'},tags=<?>,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:44:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3330125060d64234bce343af655e58e3',uuid=37fbc873-537c-4bbc-a57b-2c44e47ecf30,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78884930-2bc7-430e-b250-851ff726d5f8", "address": "fa:16:3e:0e:5d:f8", "network": {"id": "c8ebc7da-3ffe-45a0-b7f5-bb85261852ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1496462371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876fbcda354d47c197ce14ca4ed7ead6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78884930-2b", "ovs_interfaceid": "78884930-2bc7-430e-b250-851ff726d5f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:45:03 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Converting VIF {"id": "78884930-2bc7-430e-b250-851ff726d5f8", "address": "fa:16:3e:0e:5d:f8", "network": {"id": "c8ebc7da-3ffe-45a0-b7f5-bb85261852ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1496462371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876fbcda354d47c197ce14ca4ed7ead6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78884930-2b", "ovs_interfaceid": "78884930-2bc7-430e-b250-851ff726d5f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:45:03 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:5d:f8,bridge_name='br-int',has_traffic_filtering=True,id=78884930-2bc7-430e-b250-851ff726d5f8,network=Network(c8ebc7da-3ffe-45a0-b7f5-bb85261852ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78884930-2b') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:45:03 user nova-compute[231753]: DEBUG os_vif [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:5d:f8,bridge_name='br-int',has_traffic_filtering=True,id=78884930-2bc7-430e-b250-851ff726d5f8,network=Network(c8ebc7da-3ffe-45a0-b7f5-bb85261852ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78884930-2b') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:45:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:45:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:45:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap78884930-2b, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:45:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap78884930-2b, col_values=(('external_ids', {'iface-id': '78884930-2bc7-430e-b250-851ff726d5f8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:5d:f8', 'vm-uuid': '37fbc873-537c-4bbc-a57b-2c44e47ecf30'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:45:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:45:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:03 user nova-compute[231753]: INFO os_vif [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:5d:f8,bridge_name='br-int',has_traffic_filtering=True,id=78884930-2bc7-430e-b250-851ff726d5f8,network=Network(c8ebc7da-3ffe-45a0-b7f5-bb85261852ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78884930-2b')
Jul 29 13:45:04 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:45:04 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] No VIF found with MAC fa:16:3e:0e:5d:f8, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:45:05 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:05 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:05 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:05 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:05 user nova-compute[231753]: DEBUG nova.compute.manager [req-ff66d6d8-9250-44bb-9879-b950af1042be req-540c58eb-2a5e-496a-b068-c709939bb7a9 service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Received event network-vif-plugged-78884930-2bc7-430e-b250-851ff726d5f8 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:45:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ff66d6d8-9250-44bb-9879-b950af1042be req-540c58eb-2a5e-496a-b068-c709939bb7a9 service nova] Acquiring lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ff66d6d8-9250-44bb-9879-b950af1042be req-540c58eb-2a5e-496a-b068-c709939bb7a9 service nova] Lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ff66d6d8-9250-44bb-9879-b950af1042be req-540c58eb-2a5e-496a-b068-c709939bb7a9 service nova] Lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:05 user nova-compute[231753]: DEBUG nova.compute.manager [req-ff66d6d8-9250-44bb-9879-b950af1042be req-540c58eb-2a5e-496a-b068-c709939bb7a9 service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] No waiting events found dispatching network-vif-plugged-78884930-2bc7-430e-b250-851ff726d5f8 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:45:05 user nova-compute[231753]: WARNING nova.compute.manager [req-ff66d6d8-9250-44bb-9879-b950af1042be req-540c58eb-2a5e-496a-b068-c709939bb7a9 service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Received unexpected event network-vif-plugged-78884930-2bc7-430e-b250-851ff726d5f8 for instance with vm_state active and task_state rebuild_spawning.
Jul 29 13:45:05 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:05 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "aee15bbf-4d52-4611-9e75-6443c2384913" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "aee15bbf-4d52-4611-9e75-6443c2384913" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:06 user nova-compute[231753]: DEBUG nova.compute.manager [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:45:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:45:06 user nova-compute[231753]: INFO nova.compute.claims [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Claim successful on node user
Jul 29 13:45:06 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:45:06 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:45:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.521s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:06 user nova-compute[231753]: DEBUG nova.compute.manager [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:45:06 user nova-compute[231753]: DEBUG nova.compute.manager [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:45:06 user nova-compute[231753]: DEBUG nova.network.neutron [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:45:06 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:45:06 user nova-compute[231753]: DEBUG nova.compute.manager [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:45:06 user nova-compute[231753]: DEBUG nova.policy [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '68002afa2ff64150afe91714800481ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0d7f4b7f8641f9890a4ac009942190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:45:07 user nova-compute[231753]: DEBUG nova.compute.manager [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:45:07 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:45:07 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Creating image(s)
Jul 29 13:45:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "/opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "/opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "/opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "1d6ff72a81b12e9d9d85cd1600c2c98947b6d776" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "1d6ff72a81b12e9d9d85cd1600c2c98947b6d776" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d6ff72a81b12e9d9d85cd1600c2c98947b6d776.part --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d6ff72a81b12e9d9d85cd1600c2c98947b6d776.part --force-share --output=json" returned: 0 in 0.151s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:07 user nova-compute[231753]: DEBUG nova.virt.images [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] 78adb53f-be8b-4033-a431-1a462bd1ead9 was qcow2, converting to raw {{(pid=231753) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 29 13:45:07 user nova-compute[231753]: DEBUG nova.privsep.utils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=231753) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 29 13:45:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1d6ff72a81b12e9d9d85cd1600c2c98947b6d776.part /opt/stack/data/nova/instances/_base/1d6ff72a81b12e9d9d85cd1600c2c98947b6d776.converted {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:07 user nova-compute[231753]: DEBUG nova.compute.manager [req-711d4073-7e25-4bef-b3c2-f7cd900656ae req-d4b62103-83e5-408e-bd80-39e948cb7d58 service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Received event network-vif-plugged-78884930-2bc7-430e-b250-851ff726d5f8 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:45:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-711d4073-7e25-4bef-b3c2-f7cd900656ae req-d4b62103-83e5-408e-bd80-39e948cb7d58 service nova] Acquiring lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-711d4073-7e25-4bef-b3c2-f7cd900656ae req-d4b62103-83e5-408e-bd80-39e948cb7d58 service nova] Lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-711d4073-7e25-4bef-b3c2-f7cd900656ae req-d4b62103-83e5-408e-bd80-39e948cb7d58 service nova] Lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:07 user nova-compute[231753]: DEBUG nova.compute.manager [req-711d4073-7e25-4bef-b3c2-f7cd900656ae req-d4b62103-83e5-408e-bd80-39e948cb7d58 service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] No waiting events found dispatching network-vif-plugged-78884930-2bc7-430e-b250-851ff726d5f8 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:45:07 user nova-compute[231753]: WARNING nova.compute.manager [req-711d4073-7e25-4bef-b3c2-f7cd900656ae req-d4b62103-83e5-408e-bd80-39e948cb7d58 service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Received unexpected event network-vif-plugged-78884930-2bc7-430e-b250-851ff726d5f8 for instance with vm_state active and task_state rebuild_spawning.
Jul 29 13:45:07 user nova-compute[231753]: DEBUG nova.network.neutron [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Successfully created port: 351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:45:07 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638307.9098194, 37fbc873-537c-4bbc-a57b-2c44e47ecf30 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:45:07 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] VM Resumed (Lifecycle Event)
Jul 29 13:45:07 user nova-compute[231753]: DEBUG nova.compute.manager [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:45:07 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:45:07 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Instance spawned successfully.
Jul 29 13:45:07 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:45:07 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:45:07 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:45:08 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 29 13:45:08 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638307.9109483, 37fbc873-537c-4bbc-a57b-2c44e47ecf30 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:45:08 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] VM Started (Lifecycle Event)
Jul 29 13:45:08 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:45:08 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:45:08 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:45:08 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:45:08 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:45:08 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:45:08 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:45:08 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rebuild_spawning, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:45:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/1d6ff72a81b12e9d9d85cd1600c2c98947b6d776.part /opt/stack/data/nova/instances/_base/1d6ff72a81b12e9d9d85cd1600c2c98947b6d776.converted" returned: 0 in 0.577s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d6ff72a81b12e9d9d85cd1600c2c98947b6d776.converted --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:08 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] During sync_power_state the instance has a pending task (rebuild_spawning). Skip.
Jul 29 13:45:08 user nova-compute[231753]: DEBUG nova.compute.manager [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:45:08 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:45:08 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 13:45:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:08 user nova-compute[231753]: DEBUG nova.objects.instance [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Trying to apply a migration context that does not seem to be set for this instance {{(pid=231753) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1066}}
Jul 29 13:45:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d6ff72a81b12e9d9d85cd1600c2c98947b6d776.converted --force-share --output=json" returned: 0 in 0.143s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "1d6ff72a81b12e9d9d85cd1600c2c98947b6d776" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.369s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d6ff72a81b12e9d9d85cd1600c2c98947b6d776 --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-71c21297-7221-4bb7-a20d-279ac05a2498 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: held 0.089s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d6ff72a81b12e9d9d85cd1600c2c98947b6d776 --force-share --output=json" returned: 0 in 0.150s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "1d6ff72a81b12e9d9d85cd1600c2c98947b6d776" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "1d6ff72a81b12e9d9d85cd1600c2c98947b6d776" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d6ff72a81b12e9d9d85cd1600c2c98947b6d776 --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:08 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d6ff72a81b12e9d9d85cd1600c2c98947b6d776 --force-share --output=json" returned: 0 in 0.149s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1d6ff72a81b12e9d9d85cd1600c2c98947b6d776,backing_fmt=raw /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/1d6ff72a81b12e9d9d85cd1600c2c98947b6d776,backing_fmt=raw /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk 1073741824" returned: 0 in 0.063s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "1d6ff72a81b12e9d9d85cd1600c2c98947b6d776" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.219s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d6ff72a81b12e9d9d85cd1600c2c98947b6d776 --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:08 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:08 user nova-compute[231753]: DEBUG nova.network.neutron [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Successfully updated port: 351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:45:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d6ff72a81b12e9d9d85cd1600c2c98947b6d776 --force-share --output=json" returned: 0 in 0.154s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:08 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:45:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "refresh_cache-aee15bbf-4d52-4611-9e75-6443c2384913" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:45:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquired lock "refresh_cache-aee15bbf-4d52-4611-9e75-6443c2384913" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:45:08 user nova-compute[231753]: DEBUG nova.network.neutron [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.compute.manager [req-c750fb77-4168-470e-b7f1-22b339ce5eac req-cd0e4b8b-d387-4565-b563-4c018d21112d service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Received event network-changed-351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.compute.manager [req-c750fb77-4168-470e-b7f1-22b339ce5eac req-cd0e4b8b-d387-4565-b563-4c018d21112d service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Refreshing instance network info cache due to event network-changed-351f3080-98ce-4f1f-a53f-d4415327255f. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c750fb77-4168-470e-b7f1-22b339ce5eac req-cd0e4b8b-d387-4565-b563-4c018d21112d service nova] Acquiring lock "refresh_cache-aee15bbf-4d52-4611-9e75-6443c2384913" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.network.neutron [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Cannot resize image /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.objects.instance [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lazy-loading 'migration_context' on Instance uuid aee15bbf-4d52-4611-9e75-6443c2384913 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Ensure instance console log exists: /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.network.neutron [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Updating instance_info_cache with network_info: [{"id": "351f3080-98ce-4f1f-a53f-d4415327255f", "address": "fa:16:3e:ae:ff:c5", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351f3080-98", "ovs_interfaceid": "351f3080-98ce-4f1f-a53f-d4415327255f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Releasing lock "refresh_cache-aee15bbf-4d52-4611-9e75-6443c2384913" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.compute.manager [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Instance network_info: |[{"id": "351f3080-98ce-4f1f-a53f-d4415327255f", "address": "fa:16:3e:ae:ff:c5", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351f3080-98", "ovs_interfaceid": "351f3080-98ce-4f1f-a53f-d4415327255f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c750fb77-4168-470e-b7f1-22b339ce5eac req-cd0e4b8b-d387-4565-b563-4c018d21112d service nova] Acquired lock "refresh_cache-aee15bbf-4d52-4611-9e75-6443c2384913" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.network.neutron [req-c750fb77-4168-470e-b7f1-22b339ce5eac req-cd0e4b8b-d387-4565-b563-4c018d21112d service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Refreshing network info cache for port 351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Start _get_guest_xml network_info=[{"id": "351f3080-98ce-4f1f-a53f-d4415327255f", "address": "fa:16:3e:ae:ff:c5", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351f3080-98", "ovs_interfaceid": "351f3080-98ce-4f1f-a53f-d4415327255f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:45:02Z,direct_url=<?>,disk_format='qcow2',id=78adb53f-be8b-4033-a431-1a462bd1ead9,min_disk=0,min_ram=0,name='tempest-scenario-img--191383832',owner='3a0d7f4b7f8641f9890a4ac009942190',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:45:04Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '78adb53f-be8b-4033-a431-1a462bd1ead9'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:45:09 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:45:09 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:45:02Z,direct_url=<?>,disk_format='qcow2',id=78adb53f-be8b-4033-a431-1a462bd1ead9,min_disk=0,min_ram=0,name='tempest-scenario-img--191383832',owner='3a0d7f4b7f8641f9890a4ac009942190',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:45:04Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:45:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1284255744',display_name='tempest-TestMinimumBasicScenario-server-1284255744',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1284255744',id=29,image_ref='78adb53f-be8b-4033-a431-1a462bd1ead9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKr8ekMLRc3v6qbOd8eRngk+ys5vegV1XgCj9XLuALI1iIMjOlfgT1s5XKib17FXpypyjWP6kJK3XT768WDJC2k5DNlfH8LLPqFoCUrFbdeUyhXm4lePDDUp4AQyBXC4Dg==',key_name='tempest-TestMinimumBasicScenario-949027565',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a0d7f4b7f8641f9890a4ac009942190',ramdisk_id='',reservation_id='r-f9wpz5wp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='78adb53f-be8b-4033-a431-1a462bd1ead9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-187684118',owner_user_name='tempest-TestMinimumBasicScenario-187684118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:45:07Z,user_data=None,user_id='68002afa2ff64150afe91714800481ae',uuid=aee15bbf-4d52-4611-9e75-6443c2384913,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "351f3080-98ce-4f1f-a53f-d4415327255f", "address": "fa:16:3e:ae:ff:c5", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351f3080-98", "ovs_interfaceid": "351f3080-98ce-4f1f-a53f-d4415327255f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Converting VIF {"id": "351f3080-98ce-4f1f-a53f-d4415327255f", "address": "fa:16:3e:ae:ff:c5", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351f3080-98", "ovs_interfaceid": "351f3080-98ce-4f1f-a53f-d4415327255f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ff:c5,bridge_name='br-int',has_traffic_filtering=True,id=351f3080-98ce-4f1f-a53f-d4415327255f,network=Network(70a92bb8-13dd-4b75-9986-5c136de68b16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap351f3080-98') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.objects.instance [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lazy-loading 'pci_devices' on Instance uuid aee15bbf-4d52-4611-9e75-6443c2384913 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:45:09 user nova-compute[231753]:   <uuid>aee15bbf-4d52-4611-9e75-6443c2384913</uuid>
Jul 29 13:45:09 user nova-compute[231753]:   <name>instance-0000001d</name>
Jul 29 13:45:09 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:45:09 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:45:09 user nova-compute[231753]:   <metadata>
Jul 29 13:45:09 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:45:09 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:45:09 user nova-compute[231753]:       <nova:name>tempest-TestMinimumBasicScenario-server-1284255744</nova:name>
Jul 29 13:45:09 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:45:09</nova:creationTime>
Jul 29 13:45:09 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:45:09 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:45:09 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:45:09 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:45:09 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:45:09 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:45:09 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:45:09 user nova-compute[231753]:       <nova:owner>
Jul 29 13:45:09 user nova-compute[231753]:         <nova:user uuid="68002afa2ff64150afe91714800481ae">tempest-TestMinimumBasicScenario-187684118-project-member</nova:user>
Jul 29 13:45:09 user nova-compute[231753]:         <nova:project uuid="3a0d7f4b7f8641f9890a4ac009942190">tempest-TestMinimumBasicScenario-187684118</nova:project>
Jul 29 13:45:09 user nova-compute[231753]:       </nova:owner>
Jul 29 13:45:09 user nova-compute[231753]:       <nova:root type="image" uuid="78adb53f-be8b-4033-a431-1a462bd1ead9"/>
Jul 29 13:45:09 user nova-compute[231753]:       <nova:ports>
Jul 29 13:45:09 user nova-compute[231753]:         <nova:port uuid="351f3080-98ce-4f1f-a53f-d4415327255f">
Jul 29 13:45:09 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 29 13:45:09 user nova-compute[231753]:         </nova:port>
Jul 29 13:45:09 user nova-compute[231753]:       </nova:ports>
Jul 29 13:45:09 user nova-compute[231753]:     </nova:instance>
Jul 29 13:45:09 user nova-compute[231753]:   </metadata>
Jul 29 13:45:09 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:45:09 user nova-compute[231753]:     <system>
Jul 29 13:45:09 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:45:09 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:45:09 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:45:09 user nova-compute[231753]:       <entry name="serial">aee15bbf-4d52-4611-9e75-6443c2384913</entry>
Jul 29 13:45:09 user nova-compute[231753]:       <entry name="uuid">aee15bbf-4d52-4611-9e75-6443c2384913</entry>
Jul 29 13:45:09 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:45:09 user nova-compute[231753]:     </system>
Jul 29 13:45:09 user nova-compute[231753]:   </sysinfo>
Jul 29 13:45:09 user nova-compute[231753]:   <os>
Jul 29 13:45:09 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:45:09 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:45:09 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:45:09 user nova-compute[231753]:   </os>
Jul 29 13:45:09 user nova-compute[231753]:   <features>
Jul 29 13:45:09 user nova-compute[231753]:     <acpi/>
Jul 29 13:45:09 user nova-compute[231753]:     <apic/>
Jul 29 13:45:09 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:45:09 user nova-compute[231753]:   </features>
Jul 29 13:45:09 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:45:09 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:45:09 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:45:09 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:45:09 user nova-compute[231753]:   </clock>
Jul 29 13:45:09 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:45:09 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:45:09 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:45:09 user nova-compute[231753]:   </cpu>
Jul 29 13:45:09 user nova-compute[231753]:   <devices>
Jul 29 13:45:09 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:45:09 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:45:09 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk"/>
Jul 29 13:45:09 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:45:09 user nova-compute[231753]:     </disk>
Jul 29 13:45:09 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:45:09 user nova-compute[231753]:       <mac address="fa:16:3e:ae:ff:c5"/>
Jul 29 13:45:09 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:45:09 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:45:09 user nova-compute[231753]:       <target dev="tap351f3080-98"/>
Jul 29 13:45:09 user nova-compute[231753]:     </interface>
Jul 29 13:45:09 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:45:09 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/console.log" append="off"/>
Jul 29 13:45:09 user nova-compute[231753]:     </serial>
Jul 29 13:45:09 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:45:09 user nova-compute[231753]:     <video>
Jul 29 13:45:09 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:45:09 user nova-compute[231753]:     </video>
Jul 29 13:45:09 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:45:09 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:45:09 user nova-compute[231753]:     </rng>
Jul 29 13:45:09 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:45:09 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:45:09 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:45:09 user nova-compute[231753]:     </memballoon>
Jul 29 13:45:09 user nova-compute[231753]:   </devices>
Jul 29 13:45:09 user nova-compute[231753]: </domain>
Jul 29 13:45:09 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:45:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1284255744',display_name='tempest-TestMinimumBasicScenario-server-1284255744',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1284255744',id=29,image_ref='78adb53f-be8b-4033-a431-1a462bd1ead9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKr8ekMLRc3v6qbOd8eRngk+ys5vegV1XgCj9XLuALI1iIMjOlfgT1s5XKib17FXpypyjWP6kJK3XT768WDJC2k5DNlfH8LLPqFoCUrFbdeUyhXm4lePDDUp4AQyBXC4Dg==',key_name='tempest-TestMinimumBasicScenario-949027565',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a0d7f4b7f8641f9890a4ac009942190',ramdisk_id='',reservation_id='r-f9wpz5wp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='78adb53f-be8b-4033-a431-1a462bd1ead9',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-187684118',owner_user_name='tempest-TestMinimumBasicScenario-187684118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:45:07Z,user_data=None,user_id='68002afa2ff64150afe91714800481ae',uuid=aee15bbf-4d52-4611-9e75-6443c2384913,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "351f3080-98ce-4f1f-a53f-d4415327255f", "address": "fa:16:3e:ae:ff:c5", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351f3080-98", "ovs_interfaceid": "351f3080-98ce-4f1f-a53f-d4415327255f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Converting VIF {"id": "351f3080-98ce-4f1f-a53f-d4415327255f", "address": "fa:16:3e:ae:ff:c5", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351f3080-98", "ovs_interfaceid": "351f3080-98ce-4f1f-a53f-d4415327255f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ff:c5,bridge_name='br-int',has_traffic_filtering=True,id=351f3080-98ce-4f1f-a53f-d4415327255f,network=Network(70a92bb8-13dd-4b75-9986-5c136de68b16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap351f3080-98') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG os_vif [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ff:c5,bridge_name='br-int',has_traffic_filtering=True,id=351f3080-98ce-4f1f-a53f-d4415327255f,network=Network(70a92bb8-13dd-4b75-9986-5c136de68b16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap351f3080-98') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap351f3080-98, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap351f3080-98, col_values=(('external_ids', {'iface-id': '351f3080-98ce-4f1f-a53f-d4415327255f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:ff:c5', 'vm-uuid': 'aee15bbf-4d52-4611-9e75-6443c2384913'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:09 user nova-compute[231753]: INFO os_vif [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ae:ff:c5,bridge_name='br-int',has_traffic_filtering=True,id=351f3080-98ce-4f1f-a53f-d4415327255f,network=Network(70a92bb8-13dd-4b75-9986-5c136de68b16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap351f3080-98')
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] No VIF found with MAC fa:16:3e:ae:ff:c5, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdg (vdb) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:45:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a2fb70-1fc7-475b-af56-6cff04794ef7/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:10 user nova-compute[231753]: DEBUG nova.network.neutron [req-c750fb77-4168-470e-b7f1-22b339ce5eac req-cd0e4b8b-d387-4565-b563-4c018d21112d service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Updated VIF entry in instance network info cache for port 351f3080-98ce-4f1f-a53f-d4415327255f. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:45:10 user nova-compute[231753]: DEBUG nova.network.neutron [req-c750fb77-4168-470e-b7f1-22b339ce5eac req-cd0e4b8b-d387-4565-b563-4c018d21112d service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Updating instance_info_cache with network_info: [{"id": "351f3080-98ce-4f1f-a53f-d4415327255f", "address": "fa:16:3e:ae:ff:c5", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351f3080-98", "ovs_interfaceid": "351f3080-98ce-4f1f-a53f-d4415327255f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:45:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c750fb77-4168-470e-b7f1-22b339ce5eac req-cd0e4b8b-d387-4565-b563-4c018d21112d service nova] Releasing lock "refresh_cache-aee15bbf-4d52-4611-9e75-6443c2384913" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:45:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a2fb70-1fc7-475b-af56-6cff04794ef7/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a2fb70-1fc7-475b-af56-6cff04794ef7/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/91a2fb70-1fc7-475b-af56-6cff04794ef7/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:11 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:11 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:11 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:11 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json" returned: 0 in 0.184s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json" returned: 0 in 0.183s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:11 user nova-compute[231753]: DEBUG nova.compute.manager [req-8e9942c7-4690-41da-8f0e-5ba7a837393f req-452d639c-57df-4ab3-8581-ab534cf9dda3 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Received event network-vif-plugged-351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:45:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8e9942c7-4690-41da-8f0e-5ba7a837393f req-452d639c-57df-4ab3-8581-ab534cf9dda3 service nova] Acquiring lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8e9942c7-4690-41da-8f0e-5ba7a837393f req-452d639c-57df-4ab3-8581-ab534cf9dda3 service nova] Lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8e9942c7-4690-41da-8f0e-5ba7a837393f req-452d639c-57df-4ab3-8581-ab534cf9dda3 service nova] Lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:11 user nova-compute[231753]: DEBUG nova.compute.manager [req-8e9942c7-4690-41da-8f0e-5ba7a837393f req-452d639c-57df-4ab3-8581-ab534cf9dda3 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] No waiting events found dispatching network-vif-plugged-351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:45:11 user nova-compute[231753]: WARNING nova.compute.manager [req-8e9942c7-4690-41da-8f0e-5ba7a837393f req-452d639c-57df-4ab3-8581-ab534cf9dda3 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Received unexpected event network-vif-plugged-351f3080-98ce-4f1f-a53f-d4415327255f for instance with vm_state building and task_state spawning.
Jul 29 13:45:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:11 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:11 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:11 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:11 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/disk --force-share --output=json" returned: 0 in 0.222s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:45:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:45:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk --force-share --output=json" returned: 0 in 0.197s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638313.7257793, aee15bbf-4d52-4611-9e75-6443c2384913 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:45:14 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] VM Resumed (Lifecycle Event)
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.compute.manager [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.compute.manager [req-e2931e22-9f51-48d3-9e61-3c2230c338f4 req-da75849d-8575-43e7-a56e-518ee8dfee07 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Received event network-vif-plugged-351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e2931e22-9f51-48d3-9e61-3c2230c338f4 req-da75849d-8575-43e7-a56e-518ee8dfee07 service nova] Acquiring lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e2931e22-9f51-48d3-9e61-3c2230c338f4 req-da75849d-8575-43e7-a56e-518ee8dfee07 service nova] Lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e2931e22-9f51-48d3-9e61-3c2230c338f4 req-da75849d-8575-43e7-a56e-518ee8dfee07 service nova] Lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.compute.manager [req-e2931e22-9f51-48d3-9e61-3c2230c338f4 req-da75849d-8575-43e7-a56e-518ee8dfee07 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] No waiting events found dispatching network-vif-plugged-351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:45:14 user nova-compute[231753]: WARNING nova.compute.manager [req-e2931e22-9f51-48d3-9e61-3c2230c338f4 req-da75849d-8575-43e7-a56e-518ee8dfee07 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Received unexpected event network-vif-plugged-351f3080-98ce-4f1f-a53f-d4415327255f for instance with vm_state building and task_state spawning.
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:45:14 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:45:14 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=7038MB free_disk=24.982784271240234GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:14 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Instance spawned successfully.
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:45:14 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638313.7277837, aee15bbf-4d52-4611-9e75-6443c2384913 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:45:14 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] VM Started (Lifecycle Event)
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:45:14 user nova-compute[231753]: INFO nova.compute.manager [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Took 7.27 seconds to spawn the instance on the hypervisor.
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.compute.manager [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Applying migration context for instance f62c7904-d9d1-4bfc-bef8-9b1c241134f1 as it has an incoming, in-progress migration 17162dcf-3b46-4c6d-93b0-992f16d1a960. Migration status is finished {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1016}}
Jul 29 13:45:14 user nova-compute[231753]: INFO nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Updating resource usage from migration 17162dcf-3b46-4c6d-93b0-992f16d1a960
Jul 29 13:45:14 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 7e2615c1-b03e-4076-bcd9-3585fb11b8ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8ea52d41-7ec3-44d7-8421-133000ee887b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance cf326e80-7293-4764-9411-ed05a5aeba23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 55bfcd1f-2b51-4e10-84a3-e132b96111e3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 576f5002-4e4d-4236-8b0f-9b8788246de2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b99a72ba-73e2-4be7-b52b-7797351daa5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8dd26572-fe6a-40fd-8c58-6af862b340c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 37fbc873-537c-4bbc-a57b-2c44e47ecf30 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 91a2fb70-1fc7-475b-af56-6cff04794ef7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Migration 17162dcf-3b46-4c6d-93b0-992f16d1a960 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1709}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance f62c7904-d9d1-4bfc-bef8-9b1c241134f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 16097b06-976f-4fcd-a449-7b1ec8f739d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance aee15bbf-4d52-4611-9e75-6443c2384913 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 14 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=9216MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=14 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 13:45:14 user nova-compute[231753]: INFO nova.compute.manager [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Took 8.16 seconds to build instance.
Jul 29 13:45:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-570da1dd-a286-4a51-acaf-76c0142971da tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "aee15bbf-4d52-4611-9e75-6443c2384913" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.258s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:45:14 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:45:15 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 13:45:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.929s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "b9751029-dfed-4342-ad92-9ae53d72fbc1" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:16 user nova-compute[231753]: DEBUG nova.compute.manager [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:45:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:16 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:45:16 user nova-compute[231753]: INFO nova.compute.claims [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Claim successful on node user
Jul 29 13:45:17 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:45:17 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:45:17 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:45:17 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 13:45:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "refresh_cache-55bfcd1f-2b51-4e10-84a3-e132b96111e3" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:45:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquired lock "refresh_cache-55bfcd1f-2b51-4e10-84a3-e132b96111e3" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:45:17 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Forcefully refreshing network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 13:45:17 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:45:17 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:45:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.559s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:17 user nova-compute[231753]: DEBUG nova.compute.manager [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:45:17 user nova-compute[231753]: DEBUG nova.compute.manager [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:45:17 user nova-compute[231753]: DEBUG nova.network.neutron [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:45:17 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:45:17 user nova-compute[231753]: DEBUG nova.compute.manager [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:45:17 user nova-compute[231753]: DEBUG nova.policy [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '01b32889cd7442399a8bceaff3d05662', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7aa6e9e70b4a49cb994440e868203c99', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:45:17 user nova-compute[231753]: DEBUG nova.compute.manager [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:45:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:45:17 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Creating image(s)
Jul 29 13:45:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "/opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "/opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:17 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Updating instance_info_cache with network_info: [{"id": "20213688-43ed-4115-bd0d-bc74791d95c4", "address": "fa:16:3e:5b:23:7c", "network": {"id": "e8ad7fa5-6e98-46f4-8062-0b9eddaa76a6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-253010414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b08b115e89482f9b81e621485c5eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20213688-43", "ovs_interfaceid": "20213688-43ed-4115-bd0d-bc74791d95c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:45:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Releasing lock "refresh_cache-55bfcd1f-2b51-4e10-84a3-e132b96111e3" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:45:17 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Updated the network info_cache for instance {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 13:45:17 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:45:17 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:45:17 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:45:17 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:45:17 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:45:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.157s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.139s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk 1073741824" returned: 0 in 0.051s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.198s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.142s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:18 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:45:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:18 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Cannot resize image /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:45:18 user nova-compute[231753]: DEBUG nova.objects.instance [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lazy-loading 'migration_context' on Instance uuid b9751029-dfed-4342-ad92-9ae53d72fbc1 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:45:18 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:45:18 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Ensure instance console log exists: /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:45:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:18 user nova-compute[231753]: DEBUG nova.network.neutron [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Successfully created port: a25ce12c-a83d-4128-ac1e-62ca02ae31fd {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:45:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG nova.network.neutron [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Successfully updated port: a25ce12c-a83d-4128-ac1e-62ca02ae31fd {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "refresh_cache-b9751029-dfed-4342-ad92-9ae53d72fbc1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquired lock "refresh_cache-b9751029-dfed-4342-ad92-9ae53d72fbc1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG nova.network.neutron [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG nova.compute.manager [req-54be3834-1043-4056-84fa-16a4329f1cbc req-8b57a097-d942-49c3-a0d4-9df6e0b94087 service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Received event network-changed-a25ce12c-a83d-4128-ac1e-62ca02ae31fd {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG nova.compute.manager [req-54be3834-1043-4056-84fa-16a4329f1cbc req-8b57a097-d942-49c3-a0d4-9df6e0b94087 service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Refreshing instance network info cache due to event network-changed-a25ce12c-a83d-4128-ac1e-62ca02ae31fd. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-54be3834-1043-4056-84fa-16a4329f1cbc req-8b57a097-d942-49c3-a0d4-9df6e0b94087 service nova] Acquiring lock "refresh_cache-b9751029-dfed-4342-ad92-9ae53d72fbc1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG nova.network.neutron [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG nova.network.neutron [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Updating instance_info_cache with network_info: [{"id": "a25ce12c-a83d-4128-ac1e-62ca02ae31fd", "address": "fa:16:3e:8f:41:ff", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25ce12c-a8", "ovs_interfaceid": "a25ce12c-a83d-4128-ac1e-62ca02ae31fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Releasing lock "refresh_cache-b9751029-dfed-4342-ad92-9ae53d72fbc1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG nova.compute.manager [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Instance network_info: |[{"id": "a25ce12c-a83d-4128-ac1e-62ca02ae31fd", "address": "fa:16:3e:8f:41:ff", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25ce12c-a8", "ovs_interfaceid": "a25ce12c-a83d-4128-ac1e-62ca02ae31fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-54be3834-1043-4056-84fa-16a4329f1cbc req-8b57a097-d942-49c3-a0d4-9df6e0b94087 service nova] Acquired lock "refresh_cache-b9751029-dfed-4342-ad92-9ae53d72fbc1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG nova.network.neutron [req-54be3834-1043-4056-84fa-16a4329f1cbc req-8b57a097-d942-49c3-a0d4-9df6e0b94087 service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Refreshing network info cache for port a25ce12c-a83d-4128-ac1e-62ca02ae31fd {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Start _get_guest_xml network_info=[{"id": "a25ce12c-a83d-4128-ac1e-62ca02ae31fd", "address": "fa:16:3e:8f:41:ff", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25ce12c-a8", "ovs_interfaceid": "a25ce12c-a83d-4128-ac1e-62ca02ae31fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:45:19 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:45:19 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:45:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:45:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1353679928',display_name='tempest-ServerRescueNegativeTestJSON-server-1353679928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1353679928',id=30,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyqkIk/mHZFeegD1t3ptlpbHx03xO8udA7bbSIZfXHD2TqVVmNTQHOJm3Ynbo+HPT9yM0akjPtiAtsZY0rh56MyFHx5g8gunx9fj5pIS+vVgJEMoD4LC8RWOTY18wNCtg==',key_name='tempest-keypair-1425594541',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7aa6e9e70b4a49cb994440e868203c99',ramdisk_id='',reservation_id='r-q5ty12vq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-700305152',owner_user_name='tempest-ServerRescueNegativeTestJSON-700305152-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:45:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01b32889cd7442399a8bceaff3d05662',uuid=b9751029-dfed-4342-ad92-9ae53d72fbc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a25ce12c-a83d-4128-ac1e-62ca02ae31fd", "address": "fa:16:3e:8f:41:ff", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25ce12c-a8", "ovs_interfaceid": "a25ce12c-a83d-4128-ac1e-62ca02ae31fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Converting VIF {"id": "a25ce12c-a83d-4128-ac1e-62ca02ae31fd", "address": "fa:16:3e:8f:41:ff", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25ce12c-a8", "ovs_interfaceid": "a25ce12c-a83d-4128-ac1e-62ca02ae31fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:41:ff,bridge_name='br-int',has_traffic_filtering=True,id=a25ce12c-a83d-4128-ac1e-62ca02ae31fd,network=Network(e1a83272-2e22-47dc-95ae-2ab9861c5925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa25ce12c-a8') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG nova.objects.instance [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lazy-loading 'pci_devices' on Instance uuid b9751029-dfed-4342-ad92-9ae53d72fbc1 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:45:19 user nova-compute[231753]:   <uuid>b9751029-dfed-4342-ad92-9ae53d72fbc1</uuid>
Jul 29 13:45:19 user nova-compute[231753]:   <name>instance-0000001e</name>
Jul 29 13:45:19 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:45:19 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:45:19 user nova-compute[231753]:   <metadata>
Jul 29 13:45:19 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:45:19 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:45:19 user nova-compute[231753]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1353679928</nova:name>
Jul 29 13:45:19 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:45:19</nova:creationTime>
Jul 29 13:45:19 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:45:19 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:45:19 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:45:19 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:45:19 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:45:19 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:45:19 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:45:19 user nova-compute[231753]:       <nova:owner>
Jul 29 13:45:19 user nova-compute[231753]:         <nova:user uuid="01b32889cd7442399a8bceaff3d05662">tempest-ServerRescueNegativeTestJSON-700305152-project-member</nova:user>
Jul 29 13:45:19 user nova-compute[231753]:         <nova:project uuid="7aa6e9e70b4a49cb994440e868203c99">tempest-ServerRescueNegativeTestJSON-700305152</nova:project>
Jul 29 13:45:19 user nova-compute[231753]:       </nova:owner>
Jul 29 13:45:19 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:45:19 user nova-compute[231753]:       <nova:ports>
Jul 29 13:45:19 user nova-compute[231753]:         <nova:port uuid="a25ce12c-a83d-4128-ac1e-62ca02ae31fd">
Jul 29 13:45:19 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 29 13:45:19 user nova-compute[231753]:         </nova:port>
Jul 29 13:45:19 user nova-compute[231753]:       </nova:ports>
Jul 29 13:45:19 user nova-compute[231753]:     </nova:instance>
Jul 29 13:45:19 user nova-compute[231753]:   </metadata>
Jul 29 13:45:19 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:45:19 user nova-compute[231753]:     <system>
Jul 29 13:45:19 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:45:19 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:45:19 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:45:19 user nova-compute[231753]:       <entry name="serial">b9751029-dfed-4342-ad92-9ae53d72fbc1</entry>
Jul 29 13:45:19 user nova-compute[231753]:       <entry name="uuid">b9751029-dfed-4342-ad92-9ae53d72fbc1</entry>
Jul 29 13:45:19 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:45:19 user nova-compute[231753]:     </system>
Jul 29 13:45:19 user nova-compute[231753]:   </sysinfo>
Jul 29 13:45:19 user nova-compute[231753]:   <os>
Jul 29 13:45:19 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:45:19 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:45:19 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:45:19 user nova-compute[231753]:   </os>
Jul 29 13:45:19 user nova-compute[231753]:   <features>
Jul 29 13:45:19 user nova-compute[231753]:     <acpi/>
Jul 29 13:45:19 user nova-compute[231753]:     <apic/>
Jul 29 13:45:19 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:45:19 user nova-compute[231753]:   </features>
Jul 29 13:45:19 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:45:19 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:45:19 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:45:19 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:45:19 user nova-compute[231753]:   </clock>
Jul 29 13:45:19 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:45:19 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:45:19 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:45:19 user nova-compute[231753]:   </cpu>
Jul 29 13:45:19 user nova-compute[231753]:   <devices>
Jul 29 13:45:19 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:45:19 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:45:19 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk"/>
Jul 29 13:45:19 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:45:19 user nova-compute[231753]:     </disk>
Jul 29 13:45:19 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:45:19 user nova-compute[231753]:       <mac address="fa:16:3e:8f:41:ff"/>
Jul 29 13:45:19 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:45:19 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:45:19 user nova-compute[231753]:       <target dev="tapa25ce12c-a8"/>
Jul 29 13:45:19 user nova-compute[231753]:     </interface>
Jul 29 13:45:19 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:45:19 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/console.log" append="off"/>
Jul 29 13:45:19 user nova-compute[231753]:     </serial>
Jul 29 13:45:19 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:45:19 user nova-compute[231753]:     <video>
Jul 29 13:45:19 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:45:19 user nova-compute[231753]:     </video>
Jul 29 13:45:19 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:45:19 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:45:19 user nova-compute[231753]:     </rng>
Jul 29 13:45:19 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:45:19 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:45:19 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:45:19 user nova-compute[231753]:     </memballoon>
Jul 29 13:45:19 user nova-compute[231753]:   </devices>
Jul 29 13:45:19 user nova-compute[231753]: </domain>
Jul 29 13:45:19 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:45:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1353679928',display_name='tempest-ServerRescueNegativeTestJSON-server-1353679928',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1353679928',id=30,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyqkIk/mHZFeegD1t3ptlpbHx03xO8udA7bbSIZfXHD2TqVVmNTQHOJm3Ynbo+HPT9yM0akjPtiAtsZY0rh56MyFHx5g8gunx9fj5pIS+vVgJEMoD4LC8RWOTY18wNCtg==',key_name='tempest-keypair-1425594541',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='7aa6e9e70b4a49cb994440e868203c99',ramdisk_id='',reservation_id='r-q5ty12vq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-700305152',owner_user_name='tempest-ServerRescueNegativeTestJSON-700305152-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:45:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01b32889cd7442399a8bceaff3d05662',uuid=b9751029-dfed-4342-ad92-9ae53d72fbc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a25ce12c-a83d-4128-ac1e-62ca02ae31fd", "address": "fa:16:3e:8f:41:ff", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25ce12c-a8", "ovs_interfaceid": "a25ce12c-a83d-4128-ac1e-62ca02ae31fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Converting VIF {"id": "a25ce12c-a83d-4128-ac1e-62ca02ae31fd", "address": "fa:16:3e:8f:41:ff", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25ce12c-a8", "ovs_interfaceid": "a25ce12c-a83d-4128-ac1e-62ca02ae31fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8f:41:ff,bridge_name='br-int',has_traffic_filtering=True,id=a25ce12c-a83d-4128-ac1e-62ca02ae31fd,network=Network(e1a83272-2e22-47dc-95ae-2ab9861c5925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa25ce12c-a8') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG os_vif [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:41:ff,bridge_name='br-int',has_traffic_filtering=True,id=a25ce12c-a83d-4128-ac1e-62ca02ae31fd,network=Network(e1a83272-2e22-47dc-95ae-2ab9861c5925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa25ce12c-a8') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa25ce12c-a8, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapa25ce12c-a8, col_values=(('external_ids', {'iface-id': 'a25ce12c-a83d-4128-ac1e-62ca02ae31fd', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8f:41:ff', 'vm-uuid': 'b9751029-dfed-4342-ad92-9ae53d72fbc1'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:19 user nova-compute[231753]: INFO os_vif [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8f:41:ff,bridge_name='br-int',has_traffic_filtering=True,id=a25ce12c-a83d-4128-ac1e-62ca02ae31fd,network=Network(e1a83272-2e22-47dc-95ae-2ab9861c5925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa25ce12c-a8')
Jul 29 13:45:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:45:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] No VIF found with MAC fa:16:3e:8f:41:ff, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:45:20 user nova-compute[231753]: DEBUG nova.network.neutron [req-54be3834-1043-4056-84fa-16a4329f1cbc req-8b57a097-d942-49c3-a0d4-9df6e0b94087 service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Updated VIF entry in instance network info cache for port a25ce12c-a83d-4128-ac1e-62ca02ae31fd. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:45:20 user nova-compute[231753]: DEBUG nova.network.neutron [req-54be3834-1043-4056-84fa-16a4329f1cbc req-8b57a097-d942-49c3-a0d4-9df6e0b94087 service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Updating instance_info_cache with network_info: [{"id": "a25ce12c-a83d-4128-ac1e-62ca02ae31fd", "address": "fa:16:3e:8f:41:ff", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25ce12c-a8", "ovs_interfaceid": "a25ce12c-a83d-4128-ac1e-62ca02ae31fd", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:45:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-54be3834-1043-4056-84fa-16a4329f1cbc req-8b57a097-d942-49c3-a0d4-9df6e0b94087 service nova] Releasing lock "refresh_cache-b9751029-dfed-4342-ad92-9ae53d72fbc1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:45:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:21 user nova-compute[231753]: DEBUG nova.compute.manager [req-1ce27516-2414-424f-9935-fe73d6c4e030 req-fe0d46a8-c1d6-4c1e-b0fe-89bded5f856c service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Received event network-vif-plugged-a25ce12c-a83d-4128-ac1e-62ca02ae31fd {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:45:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-1ce27516-2414-424f-9935-fe73d6c4e030 req-fe0d46a8-c1d6-4c1e-b0fe-89bded5f856c service nova] Acquiring lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-1ce27516-2414-424f-9935-fe73d6c4e030 req-fe0d46a8-c1d6-4c1e-b0fe-89bded5f856c service nova] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-1ce27516-2414-424f-9935-fe73d6c4e030 req-fe0d46a8-c1d6-4c1e-b0fe-89bded5f856c service nova] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:21 user nova-compute[231753]: DEBUG nova.compute.manager [req-1ce27516-2414-424f-9935-fe73d6c4e030 req-fe0d46a8-c1d6-4c1e-b0fe-89bded5f856c service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] No waiting events found dispatching network-vif-plugged-a25ce12c-a83d-4128-ac1e-62ca02ae31fd {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:45:21 user nova-compute[231753]: WARNING nova.compute.manager [req-1ce27516-2414-424f-9935-fe73d6c4e030 req-fe0d46a8-c1d6-4c1e-b0fe-89bded5f856c service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Received unexpected event network-vif-plugged-a25ce12c-a83d-4128-ac1e-62ca02ae31fd for instance with vm_state building and task_state spawning.
Jul 29 13:45:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:23 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638323.4858317, b9751029-dfed-4342-ad92-9ae53d72fbc1 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:45:23 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] VM Resumed (Lifecycle Event)
Jul 29 13:45:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:45:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:45:23 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Instance spawned successfully.
Jul 29 13:45:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:45:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:45:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:45:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:45:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:45:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:45:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:45:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:45:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:45:23 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:45:23 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638323.487567, b9751029-dfed-4342-ad92-9ae53d72fbc1 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:45:23 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] VM Started (Lifecycle Event)
Jul 29 13:45:23 user nova-compute[231753]: DEBUG nova.compute.manager [req-c28da475-88db-4481-bcd8-fc950a1b7ad1 req-62aaf644-78ee-4da8-96c3-122ec7234c59 service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Received event network-vif-plugged-a25ce12c-a83d-4128-ac1e-62ca02ae31fd {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:45:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c28da475-88db-4481-bcd8-fc950a1b7ad1 req-62aaf644-78ee-4da8-96c3-122ec7234c59 service nova] Acquiring lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c28da475-88db-4481-bcd8-fc950a1b7ad1 req-62aaf644-78ee-4da8-96c3-122ec7234c59 service nova] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c28da475-88db-4481-bcd8-fc950a1b7ad1 req-62aaf644-78ee-4da8-96c3-122ec7234c59 service nova] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:23 user nova-compute[231753]: DEBUG nova.compute.manager [req-c28da475-88db-4481-bcd8-fc950a1b7ad1 req-62aaf644-78ee-4da8-96c3-122ec7234c59 service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] No waiting events found dispatching network-vif-plugged-a25ce12c-a83d-4128-ac1e-62ca02ae31fd {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:45:23 user nova-compute[231753]: WARNING nova.compute.manager [req-c28da475-88db-4481-bcd8-fc950a1b7ad1 req-62aaf644-78ee-4da8-96c3-122ec7234c59 service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Received unexpected event network-vif-plugged-a25ce12c-a83d-4128-ac1e-62ca02ae31fd for instance with vm_state building and task_state spawning.
Jul 29 13:45:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:45:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:45:23 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:45:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:23 user nova-compute[231753]: INFO nova.compute.manager [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Took 6.12 seconds to spawn the instance on the hypervisor.
Jul 29 13:45:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:45:23 user nova-compute[231753]: INFO nova.compute.manager [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Took 7.02 seconds to build instance.
Jul 29 13:45:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-eaabfdf0-64fe-4d59-bc44-3547da258712 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.182s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG nova.objects.instance [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lazy-loading 'flavor' on Instance uuid 8dd26572-fe6a-40fd-8c58-6af862b340c4 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "refresh_cache-8dd26572-fe6a-40fd-8c58-6af862b340c4" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquired lock "refresh_cache-8dd26572-fe6a-40fd-8c58-6af862b340c4" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG nova.network.neutron [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG nova.objects.instance [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lazy-loading 'info_cache' on Instance uuid 8dd26572-fe6a-40fd-8c58-6af862b340c4 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG nova.network.neutron [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Updating instance_info_cache with network_info: [{"id": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "address": "fa:16:3e:a7:22:05", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3e2ca8-62", "ovs_interfaceid": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Releasing lock "refresh_cache-8dd26572-fe6a-40fd-8c58-6af862b340c4" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:45:24 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Instance destroyed successfully.
Jul 29 13:45:24 user nova-compute[231753]: DEBUG nova.objects.instance [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lazy-loading 'resources' on Instance uuid 8dd26572-fe6a-40fd-8c58-6af862b340c4 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-307508049',display_name='tempest-AttachVolumeTestJSON-server-307508049',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-307508049',id=25,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoyUAgpcSSQTthO61utyiF8t7eniB6Jq0RtxtqYL+lvLbvmf3WG4z2Y5S66oY+znDIezboeDRUEwg+7djUWhx8vLQF2KnXuxcUYlwL/5sSfLakxOteY7b7lI0VU3lUVUA==',key_name='tempest-keypair-441207824',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:41:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4a8801c6bc4b46ef9b407426c5eb07e0',ramdisk_id='',reservation_id='r-tsz4sxhz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-695592502',owner_user_name='tempest-AttachVolumeTestJSON-695592502-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:43:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df1ccafc63e0418e9889541bb8ecd3d2',uuid=8dd26572-fe6a-40fd-8c58-6af862b340c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "address": "fa:16:3e:a7:22:05", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3e2ca8-62", "ovs_interfaceid": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Converting VIF {"id": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "address": "fa:16:3e:a7:22:05", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3e2ca8-62", "ovs_interfaceid": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:22:05,bridge_name='br-int',has_traffic_filtering=True,id=ef3e2ca8-6228-4cd8-b815-d06cf34e15e0,network=Network(dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef3e2ca8-62') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG os_vif [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:22:05,bridge_name='br-int',has_traffic_filtering=True,id=ef3e2ca8-6228-4cd8-b815-d06cf34e15e0,network=Network(dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef3e2ca8-62') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef3e2ca8-62, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:45:24 user nova-compute[231753]: INFO os_vif [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:22:05,bridge_name='br-int',has_traffic_filtering=True,id=ef3e2ca8-6228-4cd8-b815-d06cf34e15e0,network=Network(dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef3e2ca8-62')
Jul 29 13:45:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QAgBpCbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': True}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:45:24 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:45:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c0b3ce4-6ea0-4a21-948d-c89fc4f055ee]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:45:24 user nova-compute[231753]: No targets found.
Jul 29 13:45:24 user nova-compute[231753]: iSNS:
Jul 29 13:45:24 user nova-compute[231753]: No targets found.
Jul 29 13:45:24 user nova-compute[231753]: STATIC:
Jul 29 13:45:24 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea
Jul 29 13:45:24 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:45:24 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:45:24 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5
Jul 29 13:45:24 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:45:24 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:45:24 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef
Jul 29 13:45:24 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:45:24 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:45:24 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93
Jul 29 13:45:24 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:45:24 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:45:24 user nova-compute[231753]: FIRMWARE:
Jul 29 13:45:24 user nova-compute[231753]: No targets found.
Jul 29 13:45:24 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:45:24 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:45:24 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[92b45fcd-14ab-426e-bf64-049bfe4031d0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d985a5a-3520-4a8d-8182-c79cdc86fc14]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:45:24 user nova-compute[231753]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)
Jul 29 13:45:24 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:45:24 user nova-compute[231753]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)
Jul 29 13:45:24 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:45:24 user nova-compute[231753]: tcp: [29] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)
Jul 29 13:45:24 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:45:24 user nova-compute[231753]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)
Jul 29 13:45:24 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c8045e680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5'): ({'sdg'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Removing single pathed devices sdg {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[10eb6bf9-13e4-4256-87bf-93f0dccaf810]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[98769a9a-7c73-4448-b658-999898de4282]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Flushing IO for device /dev/sdg {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0fe840a-c15b-4122-a500-63df3e067b31]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.042s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e678bb-a19c-4275-8288-8c73b87d9c9a]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] SCSI volumes sdg have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:45:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.029s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea718a3a-bb37-4396-a690-c5d047e6cfa6]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d923a16e-9da9-4834-ad00-98a05948ba2d]: (4, ('Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5, portal: 172.16.0.220,3260]\nLogout of [sid: 29, target: iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 29, target: iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5, portal: 172.16.0.220,3260]
Jul 29 13:45:25 user nova-compute[231753]: Logout of [sid: 29, target: iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5, portal: 172.16.0.220,3260] successful.
Jul 29 13:45:25 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.029s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[23823310-05a1-42ff-ae06-ced63d2d1fc1]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] <== disconnect_volume: return (360ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Start _get_guest_xml network_info=[{"id": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "address": "fa:16:3e:a7:22:05", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3e2ca8-62", "ovs_interfaceid": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QAgBpCbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, 'status': 'reserved', 'instance': '8dd26572-fe6a-40fd-8c58-6af862b340c4', 'attached_at': '', 'detached_at': '', 'volume_id': 'c520bfb3-fffc-4de5-91c1-a2d62e91c2b5', 'serial': 'c520bfb3-fffc-4de5-91c1-a2d62e91c2b5'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '5a381ed7-603e-446f-a10e-18b6668519f0', 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG nova.objects.instance [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lazy-loading 'numa_topology' on Instance uuid 8dd26572-fe6a-40fd-8c58-6af862b340c4 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:45:25 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:45:25 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:45:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG nova.objects.instance [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8dd26572-fe6a-40fd-8c58-6af862b340c4 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QAgBpCbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:45:25 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:45:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:45:25 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:45:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:45:25 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2a1971-963b-43d2-8a0d-22eadbf0bbc7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:45:25 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[20641f19-4e2b-4fd4-b872-7e72c7eeb2c6]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5] added
Jul 29 13:45:25 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ee6bd1f-63b6-4b5c-9114-38a97dcaee37]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[44144c3a-d654-4747-8906-4963e02cad20]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QAgBpCbc {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v QAgBpCbc" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3fae9d7-04d2-43ca-8b90-2b9e93defa4f]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'QAgBpCbc'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[30e91cc2-776a-4d7b-b14e-d63cd7f9835e]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a6b241d-24f3-4240-b4a8-f519b57a636f]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:45:25 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:45:25 user nova-compute[231753]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)
Jul 29 13:45:25 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:45:25 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:45:25 user nova-compute[231753]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)
Jul 29 13:45:25 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[892685de-ac8d-4873-b9ff-b4ecdbac9432]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5, portal: 172.16.0.220,3260]
Jul 29 13:45:25 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5, portal: 172.16.0.220,3260] successful.
Jul 29 13:45:25 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[101dac63-f047-434f-bb10-54565b2b8616]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b459f4ce-1cea-42fc-a815-e8f11c5461d8]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:45:25 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:45:25 user nova-compute[231753]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)
Jul 29 13:45:25 user nova-compute[231753]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)
Jul 29 13:45:25 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:45:25 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:45:25 user nova-compute[231753]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)
Jul 29 13:45:25 user nova-compute[231753]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)
Jul 29 13:45:25 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.310s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] HCTL ('36', '-', '-', 0) found on session 33 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7619d49-7940-473e-8b75-42f947cab3c9]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Searching for a device in session 33 and hctl ['36', '*', '*', 0] yield: sde {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:45:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QAgBpCbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:45:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.355s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:45:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] <== connect_volume: return (1356ms) {'type': 'block', 'scsi_wwn': '23437353263336462', 'path': '/dev/sde'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:45:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23437353263336462', 'path': '/dev/sde'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:45:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-307508049',display_name='tempest-AttachVolumeTestJSON-server-307508049',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-307508049',id=25,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoyUAgpcSSQTthO61utyiF8t7eniB6Jq0RtxtqYL+lvLbvmf3WG4z2Y5S66oY+znDIezboeDRUEwg+7djUWhx8vLQF2KnXuxcUYlwL/5sSfLakxOteY7b7lI0VU3lUVUA==',key_name='tempest-keypair-441207824',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:41:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4a8801c6bc4b46ef9b407426c5eb07e0',ramdisk_id='',reservation_id='r-tsz4sxhz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-695592502',owner_user_name='tempest-AttachVolumeTestJSON-695592502-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:43:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df1ccafc63e0418e9889541bb8ecd3d2',uuid=8dd26572-fe6a-40fd-8c58-6af862b340c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "address": "fa:16:3e:a7:22:05", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3e2ca8-62", "ovs_interfaceid": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:45:26 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Converting VIF {"id": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "address": "fa:16:3e:a7:22:05", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3e2ca8-62", "ovs_interfaceid": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:45:26 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:22:05,bridge_name='br-int',has_traffic_filtering=True,id=ef3e2ca8-6228-4cd8-b815-d06cf34e15e0,network=Network(dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef3e2ca8-62') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:45:26 user nova-compute[231753]: DEBUG nova.objects.instance [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lazy-loading 'pci_devices' on Instance uuid 8dd26572-fe6a-40fd-8c58-6af862b340c4 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:45:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:45:26 user nova-compute[231753]:   <uuid>8dd26572-fe6a-40fd-8c58-6af862b340c4</uuid>
Jul 29 13:45:26 user nova-compute[231753]:   <name>instance-00000019</name>
Jul 29 13:45:26 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:45:26 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:45:26 user nova-compute[231753]:   <metadata>
Jul 29 13:45:26 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:45:26 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:45:26 user nova-compute[231753]:       <nova:name>tempest-AttachVolumeTestJSON-server-307508049</nova:name>
Jul 29 13:45:26 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:45:25</nova:creationTime>
Jul 29 13:45:26 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:45:26 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:45:26 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:45:26 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:45:26 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:45:26 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:45:26 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:45:26 user nova-compute[231753]:       <nova:owner>
Jul 29 13:45:26 user nova-compute[231753]:         <nova:user uuid="df1ccafc63e0418e9889541bb8ecd3d2">tempest-AttachVolumeTestJSON-695592502-project-member</nova:user>
Jul 29 13:45:26 user nova-compute[231753]:         <nova:project uuid="4a8801c6bc4b46ef9b407426c5eb07e0">tempest-AttachVolumeTestJSON-695592502</nova:project>
Jul 29 13:45:26 user nova-compute[231753]:       </nova:owner>
Jul 29 13:45:26 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:45:26 user nova-compute[231753]:       <nova:ports>
Jul 29 13:45:26 user nova-compute[231753]:         <nova:port uuid="ef3e2ca8-6228-4cd8-b815-d06cf34e15e0">
Jul 29 13:45:26 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 29 13:45:26 user nova-compute[231753]:         </nova:port>
Jul 29 13:45:26 user nova-compute[231753]:       </nova:ports>
Jul 29 13:45:26 user nova-compute[231753]:     </nova:instance>
Jul 29 13:45:26 user nova-compute[231753]:   </metadata>
Jul 29 13:45:26 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:45:26 user nova-compute[231753]:     <system>
Jul 29 13:45:26 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:45:26 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:45:26 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:45:26 user nova-compute[231753]:       <entry name="serial">8dd26572-fe6a-40fd-8c58-6af862b340c4</entry>
Jul 29 13:45:26 user nova-compute[231753]:       <entry name="uuid">8dd26572-fe6a-40fd-8c58-6af862b340c4</entry>
Jul 29 13:45:26 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:45:26 user nova-compute[231753]:     </system>
Jul 29 13:45:26 user nova-compute[231753]:   </sysinfo>
Jul 29 13:45:26 user nova-compute[231753]:   <os>
Jul 29 13:45:26 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:45:26 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:45:26 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:45:26 user nova-compute[231753]:   </os>
Jul 29 13:45:26 user nova-compute[231753]:   <features>
Jul 29 13:45:26 user nova-compute[231753]:     <acpi/>
Jul 29 13:45:26 user nova-compute[231753]:     <apic/>
Jul 29 13:45:26 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:45:26 user nova-compute[231753]:   </features>
Jul 29 13:45:26 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:45:26 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:45:26 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:45:26 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:45:26 user nova-compute[231753]:   </clock>
Jul 29 13:45:26 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:45:26 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:45:26 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:45:26 user nova-compute[231753]:   </cpu>
Jul 29 13:45:26 user nova-compute[231753]:   <devices>
Jul 29 13:45:26 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:45:26 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:45:26 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk"/>
Jul 29 13:45:26 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:45:26 user nova-compute[231753]:     </disk>
Jul 29 13:45:26 user nova-compute[231753]:     <disk type="block" device="disk">
Jul 29 13:45:26 user nova-compute[231753]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:45:26 user nova-compute[231753]:       <source dev="/dev/sde"/>
Jul 29 13:45:26 user nova-compute[231753]:       <target dev="vdb" bus="virtio"/>
Jul 29 13:45:26 user nova-compute[231753]:       <serial>c520bfb3-fffc-4de5-91c1-a2d62e91c2b5</serial>
Jul 29 13:45:26 user nova-compute[231753]:     </disk>
Jul 29 13:45:26 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:45:26 user nova-compute[231753]:       <mac address="fa:16:3e:a7:22:05"/>
Jul 29 13:45:26 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:45:26 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:45:26 user nova-compute[231753]:       <target dev="tapef3e2ca8-62"/>
Jul 29 13:45:26 user nova-compute[231753]:     </interface>
Jul 29 13:45:26 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:45:26 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/console.log" append="off"/>
Jul 29 13:45:26 user nova-compute[231753]:     </serial>
Jul 29 13:45:26 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:45:26 user nova-compute[231753]:     <video>
Jul 29 13:45:26 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:45:26 user nova-compute[231753]:     </video>
Jul 29 13:45:26 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:45:26 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:45:26 user nova-compute[231753]:     </rng>
Jul 29 13:45:26 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:45:26 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:45:26 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:45:26 user nova-compute[231753]:     </memballoon>
Jul 29 13:45:26 user nova-compute[231753]:   </devices>
Jul 29 13:45:26 user nova-compute[231753]: </domain>
Jul 29 13:45:26 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:45:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] skipping disk /dev/sde (vdb) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:45:26 user nova-compute[231753]: DEBUG nova.objects.instance [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8dd26572-fe6a-40fd-8c58-6af862b340c4 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:45:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.149s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:27 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:45:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:27 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Cannot resize image /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:45:27 user nova-compute[231753]: DEBUG nova.objects.instance [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lazy-loading 'migration_context' on Instance uuid 8dd26572-fe6a-40fd-8c58-6af862b340c4 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:45:27 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-307508049',display_name='tempest-AttachVolumeTestJSON-server-307508049',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-307508049',id=25,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoyUAgpcSSQTthO61utyiF8t7eniB6Jq0RtxtqYL+lvLbvmf3WG4z2Y5S66oY+znDIezboeDRUEwg+7djUWhx8vLQF2KnXuxcUYlwL/5sSfLakxOteY7b7lI0VU3lUVUA==',key_name='tempest-keypair-441207824',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:41:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='4a8801c6bc4b46ef9b407426c5eb07e0',ramdisk_id='',reservation_id='r-tsz4sxhz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-695592502',owner_user_name='tempest-AttachVolumeTestJSON-695592502-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:43:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df1ccafc63e0418e9889541bb8ecd3d2',uuid=8dd26572-fe6a-40fd-8c58-6af862b340c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "address": "fa:16:3e:a7:22:05", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3e2ca8-62", "ovs_interfaceid": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:45:27 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Converting VIF {"id": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "address": "fa:16:3e:a7:22:05", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3e2ca8-62", "ovs_interfaceid": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:45:27 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:22:05,bridge_name='br-int',has_traffic_filtering=True,id=ef3e2ca8-6228-4cd8-b815-d06cf34e15e0,network=Network(dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef3e2ca8-62') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:45:27 user nova-compute[231753]: DEBUG os_vif [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:22:05,bridge_name='br-int',has_traffic_filtering=True,id=ef3e2ca8-6228-4cd8-b815-d06cf34e15e0,network=Network(dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef3e2ca8-62') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:45:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:45:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:45:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef3e2ca8-62, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:45:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapef3e2ca8-62, col_values=(('external_ids', {'iface-id': 'ef3e2ca8-6228-4cd8-b815-d06cf34e15e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:22:05', 'vm-uuid': '8dd26572-fe6a-40fd-8c58-6af862b340c4'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:45:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:45:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:27 user nova-compute[231753]: INFO os_vif [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:22:05,bridge_name='br-int',has_traffic_filtering=True,id=ef3e2ca8-6228-4cd8-b815-d06cf34e15e0,network=Network(dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef3e2ca8-62')
Jul 29 13:45:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:29 user nova-compute[231753]: DEBUG nova.compute.manager [req-ea436808-244b-4bce-b74b-7b67f74dbada req-836a3310-c9d1-4cc9-bd09-8d3ac7224f16 service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Received event network-vif-plugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:45:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ea436808-244b-4bce-b74b-7b67f74dbada req-836a3310-c9d1-4cc9-bd09-8d3ac7224f16 service nova] Acquiring lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ea436808-244b-4bce-b74b-7b67f74dbada req-836a3310-c9d1-4cc9-bd09-8d3ac7224f16 service nova] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ea436808-244b-4bce-b74b-7b67f74dbada req-836a3310-c9d1-4cc9-bd09-8d3ac7224f16 service nova] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:29 user nova-compute[231753]: DEBUG nova.compute.manager [req-ea436808-244b-4bce-b74b-7b67f74dbada req-836a3310-c9d1-4cc9-bd09-8d3ac7224f16 service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] No waiting events found dispatching network-vif-plugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:45:29 user nova-compute[231753]: WARNING nova.compute.manager [req-ea436808-244b-4bce-b74b-7b67f74dbada req-836a3310-c9d1-4cc9-bd09-8d3ac7224f16 service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Received unexpected event network-vif-plugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 for instance with vm_state stopped and task_state powering-on.
Jul 29 13:45:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:31 user nova-compute[231753]: DEBUG nova.compute.manager [req-7f1dc2d7-bd1e-40bc-a583-d0ef2e4c30f4 req-f84c6f36-49f5-4cd8-bf03-7fd3e9458708 service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Received event network-vif-plugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:45:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7f1dc2d7-bd1e-40bc-a583-d0ef2e4c30f4 req-f84c6f36-49f5-4cd8-bf03-7fd3e9458708 service nova] Acquiring lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7f1dc2d7-bd1e-40bc-a583-d0ef2e4c30f4 req-f84c6f36-49f5-4cd8-bf03-7fd3e9458708 service nova] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7f1dc2d7-bd1e-40bc-a583-d0ef2e4c30f4 req-f84c6f36-49f5-4cd8-bf03-7fd3e9458708 service nova] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:31 user nova-compute[231753]: DEBUG nova.compute.manager [req-7f1dc2d7-bd1e-40bc-a583-d0ef2e4c30f4 req-f84c6f36-49f5-4cd8-bf03-7fd3e9458708 service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] No waiting events found dispatching network-vif-plugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:45:31 user nova-compute[231753]: WARNING nova.compute.manager [req-7f1dc2d7-bd1e-40bc-a583-d0ef2e4c30f4 req-f84c6f36-49f5-4cd8-bf03-7fd3e9458708 service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Received unexpected event network-vif-plugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 for instance with vm_state stopped and task_state powering-on.
Jul 29 13:45:31 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638331.4864497, 8dd26572-fe6a-40fd-8c58-6af862b340c4 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:45:31 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] VM Resumed (Lifecycle Event)
Jul 29 13:45:31 user nova-compute[231753]: DEBUG nova.compute.manager [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:45:31 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Instance rebooted successfully.
Jul 29 13:45:31 user nova-compute[231753]: DEBUG nova.compute.manager [None req-3b06e30e-f0d0-4f35-8fac-8489215c436f tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:45:31 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:45:31 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:45:31 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] During sync_power_state the instance has a pending task (powering-on). Skip.
Jul 29 13:45:31 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638331.4949884, 8dd26572-fe6a-40fd-8c58-6af862b340c4 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:45:31 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] VM Started (Lifecycle Event)
Jul 29 13:45:31 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:45:31 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:45:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "8a61a780-6403-4aed-9c4a-2af01965f5d2" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "8a61a780-6403-4aed-9c4a-2af01965f5d2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:34 user nova-compute[231753]: DEBUG nova.compute.manager [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:45:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:34 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:45:34 user nova-compute[231753]: INFO nova.compute.claims [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Claim successful on node user
Jul 29 13:45:34 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:45:34 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:45:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.856s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:34 user nova-compute[231753]: DEBUG nova.compute.manager [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:45:35 user nova-compute[231753]: DEBUG nova.compute.manager [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:45:35 user nova-compute[231753]: DEBUG nova.network.neutron [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:45:35 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:45:35 user nova-compute[231753]: DEBUG nova.compute.manager [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:45:35 user nova-compute[231753]: DEBUG nova.policy [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a09de75c8ab742fe951604b612ea5839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3122196c4504a82a2a01774ab60406a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:45:35 user nova-compute[231753]: DEBUG nova.compute.manager [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:45:35 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:45:35 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Creating image(s)
Jul 29 13:45:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "/opt/stack/data/nova/instances/8a61a780-6403-4aed-9c4a-2af01965f5d2/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "/opt/stack/data/nova/instances/8a61a780-6403-4aed-9c4a-2af01965f5d2/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "/opt/stack/data/nova/instances/8a61a780-6403-4aed-9c4a-2af01965f5d2/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.155s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.137s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/8a61a780-6403-4aed-9c4a-2af01965f5d2/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/8a61a780-6403-4aed-9c4a-2af01965f5d2/disk 1073741824" returned: 0 in 0.076s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.223s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.170s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:35 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8a61a780-6403-4aed-9c4a-2af01965f5d2/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:45:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a61a780-6403-4aed-9c4a-2af01965f5d2/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:45:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-a7ee3d4c-e919-4233-b73f-824c32a88efb tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Acquiring lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-a7ee3d4c-e919-4233-b73f-824c32a88efb tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-a7ee3d4c-e919-4233-b73f-824c32a88efb tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Acquiring lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-a7ee3d4c-e919-4233-b73f-824c32a88efb tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-a7ee3d4c-e919-4233-b73f-824c32a88efb tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7a72820f-dcb6-4b62-a5fa-a5d11f39e0e2 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Acquiring lock "91a2fb70-1fc7-475b-af56-6cff04794ef7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7a72820f-dcb6-4b62-a5fa-a5d11f39e0e2 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Lock "91a2fb70-1fc7-475b-af56-6cff04794ef7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7a72820f-dcb6-4b62-a5fa-a5d11f39e0e2 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Acquiring lock "91a2fb70-1fc7-475b-af56-6cff04794ef7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7a72820f-dcb6-4b62-a5fa-a5d11f39e0e2 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Lock "91a2fb70-1fc7-475b-af56-6cff04794ef7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7a72820f-dcb6-4b62-a5fa-a5d11f39e0e2 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Lock "91a2fb70-1fc7-475b-af56-6cff04794ef7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:35 user nova-compute[231753]: INFO nova.compute.manager [None req-a7ee3d4c-e919-4233-b73f-824c32a88efb tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Terminating instance
Jul 29 13:45:35 user nova-compute[231753]: INFO nova.compute.manager [None req-7a72820f-dcb6-4b62-a5fa-a5d11f39e0e2 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Terminating instance
Jul 29 13:45:35 user nova-compute[231753]: DEBUG nova.compute.manager [None req-a7ee3d4c-e919-4233-b73f-824c32a88efb tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:45:35 user nova-compute[231753]: DEBUG nova.compute.manager [None req-7a72820f-dcb6-4b62-a5fa-a5d11f39e0e2 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:45:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a61a780-6403-4aed-9c4a-2af01965f5d2/disk --force-share --output=json" returned: 0 in 0.225s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:45:36 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Cannot resize image /opt/stack/data/nova/instances/8a61a780-6403-4aed-9c4a-2af01965f5d2/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:45:36 user nova-compute[231753]: DEBUG nova.objects.instance [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lazy-loading 'migration_context' on Instance uuid 8a61a780-6403-4aed-9c4a-2af01965f5d2 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:45:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:45:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Ensure instance console log exists: /opt/stack/data/nova/instances/8a61a780-6403-4aed-9c4a-2af01965f5d2/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:45:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:36 user nova-compute[231753]: DEBUG nova.compute.manager [req-1ee0f8a8-0790-4f11-9cb1-aa6c3d06521c req-8515d1aa-1ced-4c94-a42e-a5692d1a18ac service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Received event network-vif-unplugged-20213688-43ed-4115-bd0d-bc74791d95c4 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:45:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-1ee0f8a8-0790-4f11-9cb1-aa6c3d06521c req-8515d1aa-1ced-4c94-a42e-a5692d1a18ac service nova] Acquiring lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-1ee0f8a8-0790-4f11-9cb1-aa6c3d06521c req-8515d1aa-1ced-4c94-a42e-a5692d1a18ac service nova] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-1ee0f8a8-0790-4f11-9cb1-aa6c3d06521c req-8515d1aa-1ced-4c94-a42e-a5692d1a18ac service nova] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:36 user nova-compute[231753]: DEBUG nova.compute.manager [req-1ee0f8a8-0790-4f11-9cb1-aa6c3d06521c req-8515d1aa-1ced-4c94-a42e-a5692d1a18ac service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] No waiting events found dispatching network-vif-unplugged-20213688-43ed-4115-bd0d-bc74791d95c4 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:45:36 user nova-compute[231753]: DEBUG nova.compute.manager [req-1ee0f8a8-0790-4f11-9cb1-aa6c3d06521c req-8515d1aa-1ced-4c94-a42e-a5692d1a18ac service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Received event network-vif-unplugged-20213688-43ed-4115-bd0d-bc74791d95c4 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:45:36 user nova-compute[231753]: DEBUG nova.compute.manager [req-f44beae8-0d07-4d1a-ae81-1f187071b865 req-2d36e56b-929e-4d9c-a1c2-35cabe183670 service nova] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Received event network-vif-unplugged-c517e924-5a02-4b05-8e1e-ae1ff75e6d82 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:45:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-f44beae8-0d07-4d1a-ae81-1f187071b865 req-2d36e56b-929e-4d9c-a1c2-35cabe183670 service nova] Acquiring lock "91a2fb70-1fc7-475b-af56-6cff04794ef7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-f44beae8-0d07-4d1a-ae81-1f187071b865 req-2d36e56b-929e-4d9c-a1c2-35cabe183670 service nova] Lock "91a2fb70-1fc7-475b-af56-6cff04794ef7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-f44beae8-0d07-4d1a-ae81-1f187071b865 req-2d36e56b-929e-4d9c-a1c2-35cabe183670 service nova] Lock "91a2fb70-1fc7-475b-af56-6cff04794ef7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:36 user nova-compute[231753]: DEBUG nova.compute.manager [req-f44beae8-0d07-4d1a-ae81-1f187071b865 req-2d36e56b-929e-4d9c-a1c2-35cabe183670 service nova] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] No waiting events found dispatching network-vif-unplugged-c517e924-5a02-4b05-8e1e-ae1ff75e6d82 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:45:36 user nova-compute[231753]: DEBUG nova.compute.manager [req-f44beae8-0d07-4d1a-ae81-1f187071b865 req-2d36e56b-929e-4d9c-a1c2-35cabe183670 service nova] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Received event network-vif-unplugged-c517e924-5a02-4b05-8e1e-ae1ff75e6d82 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:45:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:37 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Instance destroyed successfully.
Jul 29 13:45:37 user nova-compute[231753]: DEBUG nova.objects.instance [None req-a7ee3d4c-e919-4233-b73f-824c32a88efb tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lazy-loading 'resources' on Instance uuid 55bfcd1f-2b51-4e10-84a3-e132b96111e3 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:45:37 user nova-compute[231753]: DEBUG nova.network.neutron [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Successfully created port: 89495dd5-c711-4ec9-b2f4-bb166a0a4a7b {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:45:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-a7ee3d4c-e919-4233-b73f-824c32a88efb tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:38:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerStableDeviceRescueTest-server-822050220',display_name='tempest-ServerStableDeviceRescueTest-server-822050220',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverstabledevicerescuetest-server-822050220',id=18,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLyGCBaoHjvQRU5y6VqE87h4pGKr395VS9nv3boXPwLjzRxAJ8a8DweQMoJzuHlYTrldK2HJUMuE4Q1Aln3tvz5msHzQk2ShH+h/Nolt0WeNgGFtEEy1LahJXGP/vcc1rA==',key_name='tempest-keypair-1028300193',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:42:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='12b08b115e89482f9b81e621485c5eb6',ramdisk_id='',reservation_id='r-80ua53lw',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerStableDeviceRescueTest-1348314180',owner_user_name='tempest-ServerStableDeviceRescueTest-1348314180-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:44:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='7f8f87b5aaeb4b18b013a85a579ac48b',uuid=55bfcd1f-2b51-4e10-84a3-e132b96111e3,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "20213688-43ed-4115-bd0d-bc74791d95c4", "address": "fa:16:3e:5b:23:7c", "network": {"id": "e8ad7fa5-6e98-46f4-8062-0b9eddaa76a6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-253010414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b08b115e89482f9b81e621485c5eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20213688-43", "ovs_interfaceid": "20213688-43ed-4115-bd0d-bc74791d95c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:45:37 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-a7ee3d4c-e919-4233-b73f-824c32a88efb tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Converting VIF {"id": "20213688-43ed-4115-bd0d-bc74791d95c4", "address": "fa:16:3e:5b:23:7c", "network": {"id": "e8ad7fa5-6e98-46f4-8062-0b9eddaa76a6", "bridge": "br-int", "label": "tempest-ServerStableDeviceRescueTest-253010414-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.112", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "12b08b115e89482f9b81e621485c5eb6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap20213688-43", "ovs_interfaceid": "20213688-43ed-4115-bd0d-bc74791d95c4", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:45:37 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-a7ee3d4c-e919-4233-b73f-824c32a88efb tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5b:23:7c,bridge_name='br-int',has_traffic_filtering=True,id=20213688-43ed-4115-bd0d-bc74791d95c4,network=Network(e8ad7fa5-6e98-46f4-8062-0b9eddaa76a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20213688-43') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:45:37 user nova-compute[231753]: DEBUG os_vif [None req-a7ee3d4c-e919-4233-b73f-824c32a88efb tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:23:7c,bridge_name='br-int',has_traffic_filtering=True,id=20213688-43ed-4115-bd0d-bc74791d95c4,network=Network(e8ad7fa5-6e98-46f4-8062-0b9eddaa76a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20213688-43') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:45:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap20213688-43, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:45:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:45:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:37 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Instance destroyed successfully.
Jul 29 13:45:37 user nova-compute[231753]: DEBUG nova.objects.instance [None req-7a72820f-dcb6-4b62-a5fa-a5d11f39e0e2 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Lazy-loading 'resources' on Instance uuid 91a2fb70-1fc7-475b-af56-6cff04794ef7 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:45:37 user nova-compute[231753]: INFO os_vif [None req-a7ee3d4c-e919-4233-b73f-824c32a88efb tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:5b:23:7c,bridge_name='br-int',has_traffic_filtering=True,id=20213688-43ed-4115-bd0d-bc74791d95c4,network=Network(e8ad7fa5-6e98-46f4-8062-0b9eddaa76a6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap20213688-43')
Jul 29 13:45:37 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-a7ee3d4c-e919-4233-b73f-824c32a88efb tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Deleting instance files /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3_del
Jul 29 13:45:37 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-a7ee3d4c-e919-4233-b73f-824c32a88efb tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Deletion of /opt/stack/data/nova/instances/55bfcd1f-2b51-4e10-84a3-e132b96111e3_del complete
Jul 29 13:45:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-7a72820f-dcb6-4b62-a5fa-a5d11f39e0e2 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:43:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-1108088075',display_name='tempest-VolumesActionsTest-instance-1108088075',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-1108088075',id=28,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:43:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='2cf21430995e4002851510b0a609b32e',ramdisk_id='',reservation_id='r-lfvh6npi',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-984220826',owner_user_name='tempest-VolumesActionsTest-984220826-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:43:41Z,user_data=None,user_id='cc6d5982e15c447c8fb846d125948a3b',uuid=91a2fb70-1fc7-475b-af56-6cff04794ef7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c517e924-5a02-4b05-8e1e-ae1ff75e6d82", "address": "fa:16:3e:5b:0f:36", "network": {"id": "0a5ae49f-57e8-4915-b0ce-78599a8fecd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1637833367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cf21430995e4002851510b0a609b32e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc517e924-5a", "ovs_interfaceid": "c517e924-5a02-4b05-8e1e-ae1ff75e6d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:45:37 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-7a72820f-dcb6-4b62-a5fa-a5d11f39e0e2 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Converting VIF {"id": "c517e924-5a02-4b05-8e1e-ae1ff75e6d82", "address": "fa:16:3e:5b:0f:36", "network": {"id": "0a5ae49f-57e8-4915-b0ce-78599a8fecd4", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1637833367-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "2cf21430995e4002851510b0a609b32e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc517e924-5a", "ovs_interfaceid": "c517e924-5a02-4b05-8e1e-ae1ff75e6d82", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:45:37 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-7a72820f-dcb6-4b62-a5fa-a5d11f39e0e2 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5b:0f:36,bridge_name='br-int',has_traffic_filtering=True,id=c517e924-5a02-4b05-8e1e-ae1ff75e6d82,network=Network(0a5ae49f-57e8-4915-b0ce-78599a8fecd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc517e924-5a') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:45:37 user nova-compute[231753]: DEBUG os_vif [None req-7a72820f-dcb6-4b62-a5fa-a5d11f39e0e2 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:0f:36,bridge_name='br-int',has_traffic_filtering=True,id=c517e924-5a02-4b05-8e1e-ae1ff75e6d82,network=Network(0a5ae49f-57e8-4915-b0ce-78599a8fecd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc517e924-5a') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:45:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc517e924-5a, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:45:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:45:37 user nova-compute[231753]: INFO os_vif [None req-7a72820f-dcb6-4b62-a5fa-a5d11f39e0e2 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5b:0f:36,bridge_name='br-int',has_traffic_filtering=True,id=c517e924-5a02-4b05-8e1e-ae1ff75e6d82,network=Network(0a5ae49f-57e8-4915-b0ce-78599a8fecd4),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc517e924-5a')
Jul 29 13:45:37 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-7a72820f-dcb6-4b62-a5fa-a5d11f39e0e2 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Deleting instance files /opt/stack/data/nova/instances/91a2fb70-1fc7-475b-af56-6cff04794ef7_del
Jul 29 13:45:37 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-7a72820f-dcb6-4b62-a5fa-a5d11f39e0e2 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Deletion of /opt/stack/data/nova/instances/91a2fb70-1fc7-475b-af56-6cff04794ef7_del complete
Jul 29 13:45:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:37 user nova-compute[231753]: INFO nova.compute.manager [None req-a7ee3d4c-e919-4233-b73f-824c32a88efb tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Took 1.44 seconds to destroy the instance on the hypervisor.
Jul 29 13:45:37 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-a7ee3d4c-e919-4233-b73f-824c32a88efb tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:45:37 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:45:37 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:45:37 user nova-compute[231753]: INFO nova.compute.manager [None req-7a72820f-dcb6-4b62-a5fa-a5d11f39e0e2 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Took 1.53 seconds to destroy the instance on the hypervisor.
Jul 29 13:45:37 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-7a72820f-dcb6-4b62-a5fa-a5d11f39e0e2 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:45:37 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:45:37 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:45:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:38 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:45:38 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Took 0.91 seconds to deallocate network for instance.
Jul 29 13:45:38 user nova-compute[231753]: DEBUG nova.compute.manager [req-a5e5b00c-feef-4420-8930-3fce3954e4f0 req-e0214a7f-943e-4553-abce-394a80eb9c63 service nova] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Received event network-vif-deleted-c517e924-5a02-4b05-8e1e-ae1ff75e6d82 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:45:38 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:45:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7a72820f-dcb6-4b62-a5fa-a5d11f39e0e2 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7a72820f-dcb6-4b62-a5fa-a5d11f39e0e2 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:38 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Took 1.11 seconds to deallocate network for instance.
Jul 29 13:45:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-a7ee3d4c-e919-4233-b73f-824c32a88efb tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:38 user nova-compute[231753]: DEBUG nova.compute.manager [req-6deded9f-c763-4265-b1a9-ef7ae37dc322 req-cb2cbda2-8934-4b8a-ac27-40d6b3e7b1c0 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Received event network-vif-plugged-20213688-43ed-4115-bd0d-bc74791d95c4 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:45:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6deded9f-c763-4265-b1a9-ef7ae37dc322 req-cb2cbda2-8934-4b8a-ac27-40d6b3e7b1c0 service nova] Acquiring lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6deded9f-c763-4265-b1a9-ef7ae37dc322 req-cb2cbda2-8934-4b8a-ac27-40d6b3e7b1c0 service nova] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6deded9f-c763-4265-b1a9-ef7ae37dc322 req-cb2cbda2-8934-4b8a-ac27-40d6b3e7b1c0 service nova] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:38 user nova-compute[231753]: DEBUG nova.compute.manager [req-6deded9f-c763-4265-b1a9-ef7ae37dc322 req-cb2cbda2-8934-4b8a-ac27-40d6b3e7b1c0 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] No waiting events found dispatching network-vif-plugged-20213688-43ed-4115-bd0d-bc74791d95c4 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:45:38 user nova-compute[231753]: WARNING nova.compute.manager [req-6deded9f-c763-4265-b1a9-ef7ae37dc322 req-cb2cbda2-8934-4b8a-ac27-40d6b3e7b1c0 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Received unexpected event network-vif-plugged-20213688-43ed-4115-bd0d-bc74791d95c4 for instance with vm_state deleted and task_state None.
Jul 29 13:45:38 user nova-compute[231753]: DEBUG nova.compute.manager [req-6deded9f-c763-4265-b1a9-ef7ae37dc322 req-cb2cbda2-8934-4b8a-ac27-40d6b3e7b1c0 service nova] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Received event network-vif-deleted-20213688-43ed-4115-bd0d-bc74791d95c4 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:45:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.compute.manager [req-31780a6c-36ed-4fe0-981f-b15b5f250bda req-2b884202-7d2e-416b-9679-55c7a1792b7e service nova] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Received event network-vif-plugged-c517e924-5a02-4b05-8e1e-ae1ff75e6d82 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-31780a6c-36ed-4fe0-981f-b15b5f250bda req-2b884202-7d2e-416b-9679-55c7a1792b7e service nova] Acquiring lock "91a2fb70-1fc7-475b-af56-6cff04794ef7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-31780a6c-36ed-4fe0-981f-b15b5f250bda req-2b884202-7d2e-416b-9679-55c7a1792b7e service nova] Lock "91a2fb70-1fc7-475b-af56-6cff04794ef7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-31780a6c-36ed-4fe0-981f-b15b5f250bda req-2b884202-7d2e-416b-9679-55c7a1792b7e service nova] Lock "91a2fb70-1fc7-475b-af56-6cff04794ef7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.compute.manager [req-31780a6c-36ed-4fe0-981f-b15b5f250bda req-2b884202-7d2e-416b-9679-55c7a1792b7e service nova] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] No waiting events found dispatching network-vif-plugged-c517e924-5a02-4b05-8e1e-ae1ff75e6d82 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:45:39 user nova-compute[231753]: WARNING nova.compute.manager [req-31780a6c-36ed-4fe0-981f-b15b5f250bda req-2b884202-7d2e-416b-9679-55c7a1792b7e service nova] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Received unexpected event network-vif-plugged-c517e924-5a02-4b05-8e1e-ae1ff75e6d82 for instance with vm_state deleted and task_state None.
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.compute.manager [req-31780a6c-36ed-4fe0-981f-b15b5f250bda req-2b884202-7d2e-416b-9679-55c7a1792b7e service nova] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Received event network-vif-plugged-c517e924-5a02-4b05-8e1e-ae1ff75e6d82 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-31780a6c-36ed-4fe0-981f-b15b5f250bda req-2b884202-7d2e-416b-9679-55c7a1792b7e service nova] Acquiring lock "91a2fb70-1fc7-475b-af56-6cff04794ef7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-31780a6c-36ed-4fe0-981f-b15b5f250bda req-2b884202-7d2e-416b-9679-55c7a1792b7e service nova] Lock "91a2fb70-1fc7-475b-af56-6cff04794ef7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-31780a6c-36ed-4fe0-981f-b15b5f250bda req-2b884202-7d2e-416b-9679-55c7a1792b7e service nova] Lock "91a2fb70-1fc7-475b-af56-6cff04794ef7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.compute.manager [req-31780a6c-36ed-4fe0-981f-b15b5f250bda req-2b884202-7d2e-416b-9679-55c7a1792b7e service nova] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] No waiting events found dispatching network-vif-plugged-c517e924-5a02-4b05-8e1e-ae1ff75e6d82 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:45:39 user nova-compute[231753]: WARNING nova.compute.manager [req-31780a6c-36ed-4fe0-981f-b15b5f250bda req-2b884202-7d2e-416b-9679-55c7a1792b7e service nova] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Received unexpected event network-vif-plugged-c517e924-5a02-4b05-8e1e-ae1ff75e6d82 for instance with vm_state deleted and task_state None.
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.network.neutron [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Successfully updated port: 89495dd5-c711-4ec9-b2f4-bb166a0a4a7b {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "refresh_cache-8a61a780-6403-4aed-9c4a-2af01965f5d2" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquired lock "refresh_cache-8a61a780-6403-4aed-9c4a-2af01965f5d2" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.network.neutron [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-7a72820f-dcb6-4b62-a5fa-a5d11f39e0e2 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-7a72820f-dcb6-4b62-a5fa-a5d11f39e0e2 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.network.neutron [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7a72820f-dcb6-4b62-a5fa-a5d11f39e0e2 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.649s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-a7ee3d4c-e919-4233-b73f-824c32a88efb tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.544s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:39 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-7a72820f-dcb6-4b62-a5fa-a5d11f39e0e2 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Deleted allocations for instance 91a2fb70-1fc7-475b-af56-6cff04794ef7
Jul 29 13:45:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7a72820f-dcb6-4b62-a5fa-a5d11f39e0e2 tempest-VolumesActionsTest-984220826 tempest-VolumesActionsTest-984220826-project-member] Lock "91a2fb70-1fc7-475b-af56-6cff04794ef7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.378s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.network.neutron [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Updating instance_info_cache with network_info: [{"id": "89495dd5-c711-4ec9-b2f4-bb166a0a4a7b", "address": "fa:16:3e:cb:ee:63", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89495dd5-c7", "ovs_interfaceid": "89495dd5-c711-4ec9-b2f4-bb166a0a4a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Releasing lock "refresh_cache-8a61a780-6403-4aed-9c4a-2af01965f5d2" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.compute.manager [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Instance network_info: |[{"id": "89495dd5-c711-4ec9-b2f4-bb166a0a4a7b", "address": "fa:16:3e:cb:ee:63", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89495dd5-c7", "ovs_interfaceid": "89495dd5-c711-4ec9-b2f4-bb166a0a4a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Start _get_guest_xml network_info=[{"id": "89495dd5-c711-4ec9-b2f4-bb166a0a4a7b", "address": "fa:16:3e:cb:ee:63", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89495dd5-c7", "ovs_interfaceid": "89495dd5-c711-4ec9-b2f4-bb166a0a4a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:45:39 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:45:39 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:45:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1325470665',display_name='tempest-AttachVolumeNegativeTest-server-1325470665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1325470665',id=31,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfnSb8cbu5OETbWcAKwBDoUDBXOx6Z8rJjqi/6q4SgJInpdA2hwKRIOIwxuoEoRhWB8soyI6dob83rSNnrZg7CagBD0oJ2fZcA6tTvIE2y0qLmG72DhfNvwgkA/c13nPw==',key_name='tempest-keypair-169969578',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3122196c4504a82a2a01774ab60406a',ramdisk_id='',reservation_id='r-e34728zo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1031975907',owner_user_name='tempest-AttachVolumeNegativeTest-1031975907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:45:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a09de75c8ab742fe951604b612ea5839',uuid=8a61a780-6403-4aed-9c4a-2af01965f5d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89495dd5-c711-4ec9-b2f4-bb166a0a4a7b", "address": "fa:16:3e:cb:ee:63", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89495dd5-c7", "ovs_interfaceid": "89495dd5-c711-4ec9-b2f4-bb166a0a4a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Converting VIF {"id": "89495dd5-c711-4ec9-b2f4-bb166a0a4a7b", "address": "fa:16:3e:cb:ee:63", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89495dd5-c7", "ovs_interfaceid": "89495dd5-c711-4ec9-b2f4-bb166a0a4a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ee:63,bridge_name='br-int',has_traffic_filtering=True,id=89495dd5-c711-4ec9-b2f4-bb166a0a4a7b,network=Network(1ff03660-77ea-4ec6-8eeb-55df7e78096b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89495dd5-c7') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.objects.instance [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a61a780-6403-4aed-9c4a-2af01965f5d2 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:45:39 user nova-compute[231753]:   <uuid>8a61a780-6403-4aed-9c4a-2af01965f5d2</uuid>
Jul 29 13:45:39 user nova-compute[231753]:   <name>instance-0000001f</name>
Jul 29 13:45:39 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:45:39 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:45:39 user nova-compute[231753]:   <metadata>
Jul 29 13:45:39 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:45:39 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:45:39 user nova-compute[231753]:       <nova:name>tempest-AttachVolumeNegativeTest-server-1325470665</nova:name>
Jul 29 13:45:39 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:45:39</nova:creationTime>
Jul 29 13:45:39 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:45:39 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:45:39 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:45:39 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:45:39 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:45:39 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:45:39 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:45:39 user nova-compute[231753]:       <nova:owner>
Jul 29 13:45:39 user nova-compute[231753]:         <nova:user uuid="a09de75c8ab742fe951604b612ea5839">tempest-AttachVolumeNegativeTest-1031975907-project-member</nova:user>
Jul 29 13:45:39 user nova-compute[231753]:         <nova:project uuid="f3122196c4504a82a2a01774ab60406a">tempest-AttachVolumeNegativeTest-1031975907</nova:project>
Jul 29 13:45:39 user nova-compute[231753]:       </nova:owner>
Jul 29 13:45:39 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:45:39 user nova-compute[231753]:       <nova:ports>
Jul 29 13:45:39 user nova-compute[231753]:         <nova:port uuid="89495dd5-c711-4ec9-b2f4-bb166a0a4a7b">
Jul 29 13:45:39 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.5" ipVersion="4"/>
Jul 29 13:45:39 user nova-compute[231753]:         </nova:port>
Jul 29 13:45:39 user nova-compute[231753]:       </nova:ports>
Jul 29 13:45:39 user nova-compute[231753]:     </nova:instance>
Jul 29 13:45:39 user nova-compute[231753]:   </metadata>
Jul 29 13:45:39 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:45:39 user nova-compute[231753]:     <system>
Jul 29 13:45:39 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:45:39 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:45:39 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:45:39 user nova-compute[231753]:       <entry name="serial">8a61a780-6403-4aed-9c4a-2af01965f5d2</entry>
Jul 29 13:45:39 user nova-compute[231753]:       <entry name="uuid">8a61a780-6403-4aed-9c4a-2af01965f5d2</entry>
Jul 29 13:45:39 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:45:39 user nova-compute[231753]:     </system>
Jul 29 13:45:39 user nova-compute[231753]:   </sysinfo>
Jul 29 13:45:39 user nova-compute[231753]:   <os>
Jul 29 13:45:39 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:45:39 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:45:39 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:45:39 user nova-compute[231753]:   </os>
Jul 29 13:45:39 user nova-compute[231753]:   <features>
Jul 29 13:45:39 user nova-compute[231753]:     <acpi/>
Jul 29 13:45:39 user nova-compute[231753]:     <apic/>
Jul 29 13:45:39 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:45:39 user nova-compute[231753]:   </features>
Jul 29 13:45:39 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:45:39 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:45:39 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:45:39 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:45:39 user nova-compute[231753]:   </clock>
Jul 29 13:45:39 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:45:39 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:45:39 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:45:39 user nova-compute[231753]:   </cpu>
Jul 29 13:45:39 user nova-compute[231753]:   <devices>
Jul 29 13:45:39 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:45:39 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:45:39 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/8a61a780-6403-4aed-9c4a-2af01965f5d2/disk"/>
Jul 29 13:45:39 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:45:39 user nova-compute[231753]:     </disk>
Jul 29 13:45:39 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:45:39 user nova-compute[231753]:       <mac address="fa:16:3e:cb:ee:63"/>
Jul 29 13:45:39 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:45:39 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:45:39 user nova-compute[231753]:       <target dev="tap89495dd5-c7"/>
Jul 29 13:45:39 user nova-compute[231753]:     </interface>
Jul 29 13:45:39 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:45:39 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/8a61a780-6403-4aed-9c4a-2af01965f5d2/console.log" append="off"/>
Jul 29 13:45:39 user nova-compute[231753]:     </serial>
Jul 29 13:45:39 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:45:39 user nova-compute[231753]:     <video>
Jul 29 13:45:39 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:45:39 user nova-compute[231753]:     </video>
Jul 29 13:45:39 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:45:39 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:45:39 user nova-compute[231753]:     </rng>
Jul 29 13:45:39 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:45:39 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:45:39 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:45:39 user nova-compute[231753]:     </memballoon>
Jul 29 13:45:39 user nova-compute[231753]:   </devices>
Jul 29 13:45:39 user nova-compute[231753]: </domain>
Jul 29 13:45:39 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:45:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1325470665',display_name='tempest-AttachVolumeNegativeTest-server-1325470665',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1325470665',id=31,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfnSb8cbu5OETbWcAKwBDoUDBXOx6Z8rJjqi/6q4SgJInpdA2hwKRIOIwxuoEoRhWB8soyI6dob83rSNnrZg7CagBD0oJ2fZcA6tTvIE2y0qLmG72DhfNvwgkA/c13nPw==',key_name='tempest-keypair-169969578',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3122196c4504a82a2a01774ab60406a',ramdisk_id='',reservation_id='r-e34728zo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1031975907',owner_user_name='tempest-AttachVolumeNegativeTest-1031975907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:45:35Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a09de75c8ab742fe951604b612ea5839',uuid=8a61a780-6403-4aed-9c4a-2af01965f5d2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89495dd5-c711-4ec9-b2f4-bb166a0a4a7b", "address": "fa:16:3e:cb:ee:63", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89495dd5-c7", "ovs_interfaceid": "89495dd5-c711-4ec9-b2f4-bb166a0a4a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Converting VIF {"id": "89495dd5-c711-4ec9-b2f4-bb166a0a4a7b", "address": "fa:16:3e:cb:ee:63", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89495dd5-c7", "ovs_interfaceid": "89495dd5-c711-4ec9-b2f4-bb166a0a4a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ee:63,bridge_name='br-int',has_traffic_filtering=True,id=89495dd5-c711-4ec9-b2f4-bb166a0a4a7b,network=Network(1ff03660-77ea-4ec6-8eeb-55df7e78096b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89495dd5-c7') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG os_vif [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ee:63,bridge_name='br-int',has_traffic_filtering=True,id=89495dd5-c711-4ec9-b2f4-bb166a0a4a7b,network=Network(1ff03660-77ea-4ec6-8eeb-55df7e78096b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89495dd5-c7') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89495dd5-c7, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap89495dd5-c7, col_values=(('external_ids', {'iface-id': '89495dd5-c711-4ec9-b2f4-bb166a0a4a7b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:ee:63', 'vm-uuid': '8a61a780-6403-4aed-9c4a-2af01965f5d2'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:39 user nova-compute[231753]: INFO os_vif [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:ee:63,bridge_name='br-int',has_traffic_filtering=True,id=89495dd5-c711-4ec9-b2f4-bb166a0a4a7b,network=Network(1ff03660-77ea-4ec6-8eeb-55df7e78096b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89495dd5-c7')
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] No VIF found with MAC fa:16:3e:cb:ee:63, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-a7ee3d4c-e919-4233-b73f-824c32a88efb tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-a7ee3d4c-e919-4233-b73f-824c32a88efb tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:45:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-a7ee3d4c-e919-4233-b73f-824c32a88efb tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.713s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:39 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-a7ee3d4c-e919-4233-b73f-824c32a88efb tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Deleted allocations for instance 55bfcd1f-2b51-4e10-84a3-e132b96111e3
Jul 29 13:45:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-a7ee3d4c-e919-4233-b73f-824c32a88efb tempest-ServerStableDeviceRescueTest-1348314180 tempest-ServerStableDeviceRescueTest-1348314180-project-member] Lock "55bfcd1f-2b51-4e10-84a3-e132b96111e3" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.062s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:41 user nova-compute[231753]: DEBUG nova.compute.manager [req-b9c48d7e-9b80-46d0-8c8d-2811d682f2c8 req-e2d91c53-f9c7-4fa7-bcda-ae628b442e16 service nova] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Received event network-changed-89495dd5-c711-4ec9-b2f4-bb166a0a4a7b {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:45:41 user nova-compute[231753]: DEBUG nova.compute.manager [req-b9c48d7e-9b80-46d0-8c8d-2811d682f2c8 req-e2d91c53-f9c7-4fa7-bcda-ae628b442e16 service nova] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Refreshing instance network info cache due to event network-changed-89495dd5-c711-4ec9-b2f4-bb166a0a4a7b. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:45:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b9c48d7e-9b80-46d0-8c8d-2811d682f2c8 req-e2d91c53-f9c7-4fa7-bcda-ae628b442e16 service nova] Acquiring lock "refresh_cache-8a61a780-6403-4aed-9c4a-2af01965f5d2" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:45:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b9c48d7e-9b80-46d0-8c8d-2811d682f2c8 req-e2d91c53-f9c7-4fa7-bcda-ae628b442e16 service nova] Acquired lock "refresh_cache-8a61a780-6403-4aed-9c4a-2af01965f5d2" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:45:41 user nova-compute[231753]: DEBUG nova.network.neutron [req-b9c48d7e-9b80-46d0-8c8d-2811d682f2c8 req-e2d91c53-f9c7-4fa7-bcda-ae628b442e16 service nova] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Refreshing network info cache for port 89495dd5-c711-4ec9-b2f4-bb166a0a4a7b {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:45:41 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:41 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:41 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:41 user nova-compute[231753]: DEBUG nova.compute.manager [req-72187d5e-b452-4dd9-8dde-3f775dccce76 req-ea8fad51-cab6-443d-8d89-7e029ccfc15b service nova] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Received event network-vif-plugged-89495dd5-c711-4ec9-b2f4-bb166a0a4a7b {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:45:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-72187d5e-b452-4dd9-8dde-3f775dccce76 req-ea8fad51-cab6-443d-8d89-7e029ccfc15b service nova] Acquiring lock "8a61a780-6403-4aed-9c4a-2af01965f5d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-72187d5e-b452-4dd9-8dde-3f775dccce76 req-ea8fad51-cab6-443d-8d89-7e029ccfc15b service nova] Lock "8a61a780-6403-4aed-9c4a-2af01965f5d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-72187d5e-b452-4dd9-8dde-3f775dccce76 req-ea8fad51-cab6-443d-8d89-7e029ccfc15b service nova] Lock "8a61a780-6403-4aed-9c4a-2af01965f5d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:41 user nova-compute[231753]: DEBUG nova.compute.manager [req-72187d5e-b452-4dd9-8dde-3f775dccce76 req-ea8fad51-cab6-443d-8d89-7e029ccfc15b service nova] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] No waiting events found dispatching network-vif-plugged-89495dd5-c711-4ec9-b2f4-bb166a0a4a7b {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:45:41 user nova-compute[231753]: WARNING nova.compute.manager [req-72187d5e-b452-4dd9-8dde-3f775dccce76 req-ea8fad51-cab6-443d-8d89-7e029ccfc15b service nova] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Received unexpected event network-vif-plugged-89495dd5-c711-4ec9-b2f4-bb166a0a4a7b for instance with vm_state building and task_state spawning.
Jul 29 13:45:41 user nova-compute[231753]: DEBUG nova.network.neutron [req-b9c48d7e-9b80-46d0-8c8d-2811d682f2c8 req-e2d91c53-f9c7-4fa7-bcda-ae628b442e16 service nova] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Updated VIF entry in instance network info cache for port 89495dd5-c711-4ec9-b2f4-bb166a0a4a7b. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:45:41 user nova-compute[231753]: DEBUG nova.network.neutron [req-b9c48d7e-9b80-46d0-8c8d-2811d682f2c8 req-e2d91c53-f9c7-4fa7-bcda-ae628b442e16 service nova] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Updating instance_info_cache with network_info: [{"id": "89495dd5-c711-4ec9-b2f4-bb166a0a4a7b", "address": "fa:16:3e:cb:ee:63", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89495dd5-c7", "ovs_interfaceid": "89495dd5-c711-4ec9-b2f4-bb166a0a4a7b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:45:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b9c48d7e-9b80-46d0-8c8d-2811d682f2c8 req-e2d91c53-f9c7-4fa7-bcda-ae628b442e16 service nova] Releasing lock "refresh_cache-8a61a780-6403-4aed-9c4a-2af01965f5d2" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:45:41 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:41 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:41 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:43 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638343.3814483, 8a61a780-6403-4aed-9c4a-2af01965f5d2 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:45:43 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] VM Resumed (Lifecycle Event)
Jul 29 13:45:43 user nova-compute[231753]: DEBUG nova.compute.manager [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:45:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:45:43 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Instance spawned successfully.
Jul 29 13:45:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:45:43 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:45:43 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:45:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:45:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:45:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:45:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:45:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:45:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:45:43 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:45:43 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638343.3827994, 8a61a780-6403-4aed-9c4a-2af01965f5d2 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:45:43 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] VM Started (Lifecycle Event)
Jul 29 13:45:43 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:45:43 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:45:43 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:45:43 user nova-compute[231753]: DEBUG nova.compute.manager [req-ad4e005a-31f0-4787-9809-2f052d07925d req-05297a6a-8023-44dc-9a4f-66c641af91ed service nova] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Received event network-vif-plugged-89495dd5-c711-4ec9-b2f4-bb166a0a4a7b {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:45:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ad4e005a-31f0-4787-9809-2f052d07925d req-05297a6a-8023-44dc-9a4f-66c641af91ed service nova] Acquiring lock "8a61a780-6403-4aed-9c4a-2af01965f5d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ad4e005a-31f0-4787-9809-2f052d07925d req-05297a6a-8023-44dc-9a4f-66c641af91ed service nova] Lock "8a61a780-6403-4aed-9c4a-2af01965f5d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ad4e005a-31f0-4787-9809-2f052d07925d req-05297a6a-8023-44dc-9a4f-66c641af91ed service nova] Lock "8a61a780-6403-4aed-9c4a-2af01965f5d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:43 user nova-compute[231753]: DEBUG nova.compute.manager [req-ad4e005a-31f0-4787-9809-2f052d07925d req-05297a6a-8023-44dc-9a4f-66c641af91ed service nova] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] No waiting events found dispatching network-vif-plugged-89495dd5-c711-4ec9-b2f4-bb166a0a4a7b {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:45:43 user nova-compute[231753]: WARNING nova.compute.manager [req-ad4e005a-31f0-4787-9809-2f052d07925d req-05297a6a-8023-44dc-9a4f-66c641af91ed service nova] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Received unexpected event network-vif-plugged-89495dd5-c711-4ec9-b2f4-bb166a0a4a7b for instance with vm_state building and task_state spawning.
Jul 29 13:45:43 user nova-compute[231753]: INFO nova.compute.manager [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Took 8.31 seconds to spawn the instance on the hypervisor.
Jul 29 13:45:43 user nova-compute[231753]: DEBUG nova.compute.manager [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:45:43 user nova-compute[231753]: INFO nova.compute.manager [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Took 9.53 seconds to build instance.
Jul 29 13:45:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2bf7307e-05d4-4be4-bcf6-9b671735e0fb tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "8a61a780-6403-4aed-9c4a-2af01965f5d2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 9.640s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-840a3bfa-6c96-4741-b923-6fa1b7fe41fd tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-840a3bfa-6c96-4741-b923-6fa1b7fe41fd tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1" acquired by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:49 user nova-compute[231753]: DEBUG nova.compute.manager [None req-840a3bfa-6c96-4741-b923-6fa1b7fe41fd tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Going to confirm migration 2 {{(pid=231753) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:4694}}
Jul 29 13:45:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-840a3bfa-6c96-4741-b923-6fa1b7fe41fd tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "refresh_cache-f62c7904-d9d1-4bfc-bef8-9b1c241134f1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:45:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-840a3bfa-6c96-4741-b923-6fa1b7fe41fd tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquired lock "refresh_cache-f62c7904-d9d1-4bfc-bef8-9b1c241134f1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:45:49 user nova-compute[231753]: DEBUG nova.network.neutron [None req-840a3bfa-6c96-4741-b923-6fa1b7fe41fd tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:45:49 user nova-compute[231753]: DEBUG nova.objects.instance [None req-840a3bfa-6c96-4741-b923-6fa1b7fe41fd tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lazy-loading 'info_cache' on Instance uuid f62c7904-d9d1-4bfc-bef8-9b1c241134f1 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:45:50 user nova-compute[231753]: DEBUG nova.network.neutron [None req-840a3bfa-6c96-4741-b923-6fa1b7fe41fd tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Updating instance_info_cache with network_info: [{"id": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "address": "fa:16:3e:ed:37:b6", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f751e1-b3", "ovs_interfaceid": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:45:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-840a3bfa-6c96-4741-b923-6fa1b7fe41fd tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Releasing lock "refresh_cache-f62c7904-d9d1-4bfc-bef8-9b1c241134f1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:45:50 user nova-compute[231753]: DEBUG nova.objects.instance [None req-840a3bfa-6c96-4741-b923-6fa1b7fe41fd tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lazy-loading 'migration_context' on Instance uuid f62c7904-d9d1-4bfc-bef8-9b1c241134f1 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:45:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-840a3bfa-6c96-4741-b923-6fa1b7fe41fd tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:45:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-840a3bfa-6c96-4741-b923-6fa1b7fe41fd tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:45:51 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-840a3bfa-6c96-4741-b923-6fa1b7fe41fd tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:45:51 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-840a3bfa-6c96-4741-b923-6fa1b7fe41fd tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:45:51 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-840a3bfa-6c96-4741-b923-6fa1b7fe41fd tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 0.473s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:51 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-840a3bfa-6c96-4741-b923-6fa1b7fe41fd tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Deleted allocation for migration 17162dcf-3b46-4c6d-93b0-992f16d1a960
Jul 29 13:45:51 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-840a3bfa-6c96-4741-b923-6fa1b7fe41fd tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1" "released" by "nova.compute.manager.ComputeManager.confirm_resize.<locals>.do_confirm_resize" :: held 1.595s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:45:52 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690638337.1954284, 55bfcd1f-2b51-4e10-84a3-e132b96111e3 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:45:52 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] VM Stopped (Lifecycle Event)
Jul 29 13:45:52 user nova-compute[231753]: DEBUG nova.compute.manager [None req-cd92470e-e473-4e75-90e1-ba73064e8ac0 None None] [instance: 55bfcd1f-2b51-4e10-84a3-e132b96111e3] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:45:52 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690638337.232398, 91a2fb70-1fc7-475b-af56-6cff04794ef7 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:45:52 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] VM Stopped (Lifecycle Event)
Jul 29 13:45:52 user nova-compute[231753]: DEBUG nova.compute.manager [None req-c21cf3f6-2ca4-496e-919c-8cbf0d452804 None None] [instance: 91a2fb70-1fc7-475b-af56-6cff04794ef7] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:45:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:45:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:08 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:08 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:46:08 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 13:46:08 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:09 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:46:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:46:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:46:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:46:09 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 13:46:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:46:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:46:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json" returned: 0 in 0.161s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json" returned: 0 in 0.160s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk --force-share --output=json" returned: 0 in 0.184s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:46:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:46:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a61a780-6403-4aed-9c4a-2af01965f5d2/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a61a780-6403-4aed-9c4a-2af01965f5d2/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a61a780-6403-4aed-9c4a-2af01965f5d2/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a61a780-6403-4aed-9c4a-2af01965f5d2/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:13 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:46:13 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:46:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=6620MB free_disk=25.037700653076172GB free_vcpus=-1 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 13:46:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:46:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:46:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:46:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 7e2615c1-b03e-4076-bcd9-3585fb11b8ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:46:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8ea52d41-7ec3-44d7-8421-133000ee887b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:46:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance cf326e80-7293-4764-9411-ed05a5aeba23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:46:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 576f5002-4e4d-4236-8b0f-9b8788246de2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:46:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b99a72ba-73e2-4be7-b52b-7797351daa5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:46:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8dd26572-fe6a-40fd-8c58-6af862b340c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:46:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 37fbc873-537c-4bbc-a57b-2c44e47ecf30 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:46:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance f62c7904-d9d1-4bfc-bef8-9b1c241134f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:46:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 16097b06-976f-4fcd-a449-7b1ec8f739d1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:46:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance aee15bbf-4d52-4611-9e75-6443c2384913 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:46:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b9751029-dfed-4342-ad92-9ae53d72fbc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:46:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8a61a780-6403-4aed-9c4a-2af01965f5d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:46:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 13 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 13:46:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=8704MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=13 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 13:46:13 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:13 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:46:13 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:46:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 13:46:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.558s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:46:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:15 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:46:15 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:46:15 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 13:46:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "refresh_cache-3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:46:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquired lock "refresh_cache-3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:46:16 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Forcefully refreshing network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 13:46:16 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Updating instance_info_cache with network_info: [{"id": "2a7981fb-647d-4610-9da2-3b162f366dfe", "address": "fa:16:3e:0c:e3:a3", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7981fb-64", "ovs_interfaceid": "2a7981fb-647d-4610-9da2-3b162f366dfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:46:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Releasing lock "refresh_cache-3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:46:16 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Updated the network info_cache for instance {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 13:46:16 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:46:16 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:46:16 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:46:16 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:46:16 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:46:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:46:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-aef83ba2-f86d-499a-9cdb-446aea9357ef tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "16097b06-976f-4fcd-a449-7b1ec8f739d1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:46:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-aef83ba2-f86d-499a-9cdb-446aea9357ef tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "16097b06-976f-4fcd-a449-7b1ec8f739d1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:46:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-aef83ba2-f86d-499a-9cdb-446aea9357ef tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "16097b06-976f-4fcd-a449-7b1ec8f739d1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:46:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-aef83ba2-f86d-499a-9cdb-446aea9357ef tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "16097b06-976f-4fcd-a449-7b1ec8f739d1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:46:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-aef83ba2-f86d-499a-9cdb-446aea9357ef tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "16097b06-976f-4fcd-a449-7b1ec8f739d1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:46:20 user nova-compute[231753]: INFO nova.compute.manager [None req-aef83ba2-f86d-499a-9cdb-446aea9357ef tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Terminating instance
Jul 29 13:46:20 user nova-compute[231753]: DEBUG nova.compute.manager [None req-aef83ba2-f86d-499a-9cdb-446aea9357ef tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:46:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:21 user nova-compute[231753]: DEBUG nova.compute.manager [req-495c3dec-918d-4463-ae5b-a6b96067efe2 req-4a237d74-a17b-431c-83f1-921b3ba19050 service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Received event network-vif-unplugged-7066a691-9911-48c6-a50c-de2e25f08f1d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:46:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-495c3dec-918d-4463-ae5b-a6b96067efe2 req-4a237d74-a17b-431c-83f1-921b3ba19050 service nova] Acquiring lock "16097b06-976f-4fcd-a449-7b1ec8f739d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:46:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-495c3dec-918d-4463-ae5b-a6b96067efe2 req-4a237d74-a17b-431c-83f1-921b3ba19050 service nova] Lock "16097b06-976f-4fcd-a449-7b1ec8f739d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:46:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-495c3dec-918d-4463-ae5b-a6b96067efe2 req-4a237d74-a17b-431c-83f1-921b3ba19050 service nova] Lock "16097b06-976f-4fcd-a449-7b1ec8f739d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:46:21 user nova-compute[231753]: DEBUG nova.compute.manager [req-495c3dec-918d-4463-ae5b-a6b96067efe2 req-4a237d74-a17b-431c-83f1-921b3ba19050 service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] No waiting events found dispatching network-vif-unplugged-7066a691-9911-48c6-a50c-de2e25f08f1d {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:46:21 user nova-compute[231753]: DEBUG nova.compute.manager [req-495c3dec-918d-4463-ae5b-a6b96067efe2 req-4a237d74-a17b-431c-83f1-921b3ba19050 service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Received event network-vif-unplugged-7066a691-9911-48c6-a50c-de2e25f08f1d for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:46:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:21 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Instance destroyed successfully.
Jul 29 13:46:21 user nova-compute[231753]: DEBUG nova.objects.instance [None req-aef83ba2-f86d-499a-9cdb-446aea9357ef tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lazy-loading 'resources' on Instance uuid 16097b06-976f-4fcd-a449-7b1ec8f739d1 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:46:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-aef83ba2-f86d-499a-9cdb-446aea9357ef tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-29T13:40:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1785686519',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumeshelvetestjson-server-1785686519',id=22,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIltVyANnBLQo5ZkaO2rhyJWlvJIw2quOPh0zhPSCEV5HqmmGHMXccTyUpnsRkyvdMtse0ovY8hkA/H4UxPyXE0wALQj07YRnF9pVYigWhQcgRInlw5MXYbG0KJZyckXbw==',key_name='tempest-keypair-1407725312',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:44:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='d53ebbb5f2e440dfa0cf3950232b4853',ramdisk_id='',reservation_id='r-u7dl5zqm',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-460717858',owner_user_name='tempest-AttachVolumeShelveTestJSON-460717858-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:44:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='932b5bd757f94be29d52035fd9f70293',uuid=16097b06-976f-4fcd-a449-7b1ec8f739d1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "7066a691-9911-48c6-a50c-de2e25f08f1d", "address": "fa:16:3e:33:c2:0b", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7066a691-99", "ovs_interfaceid": "7066a691-9911-48c6-a50c-de2e25f08f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:46:21 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-aef83ba2-f86d-499a-9cdb-446aea9357ef tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Converting VIF {"id": "7066a691-9911-48c6-a50c-de2e25f08f1d", "address": "fa:16:3e:33:c2:0b", "network": {"id": "9be19067-cc29-4c67-95a0-cf37f95f9fc0", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-899615413-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.57", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "d53ebbb5f2e440dfa0cf3950232b4853", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap7066a691-99", "ovs_interfaceid": "7066a691-9911-48c6-a50c-de2e25f08f1d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:46:21 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-aef83ba2-f86d-499a-9cdb-446aea9357ef tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:33:c2:0b,bridge_name='br-int',has_traffic_filtering=True,id=7066a691-9911-48c6-a50c-de2e25f08f1d,network=Network(9be19067-cc29-4c67-95a0-cf37f95f9fc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7066a691-99') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:46:21 user nova-compute[231753]: DEBUG os_vif [None req-aef83ba2-f86d-499a-9cdb-446aea9357ef tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:c2:0b,bridge_name='br-int',has_traffic_filtering=True,id=7066a691-9911-48c6-a50c-de2e25f08f1d,network=Network(9be19067-cc29-4c67-95a0-cf37f95f9fc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7066a691-99') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:46:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap7066a691-99, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:46:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:46:21 user nova-compute[231753]: INFO os_vif [None req-aef83ba2-f86d-499a-9cdb-446aea9357ef tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:33:c2:0b,bridge_name='br-int',has_traffic_filtering=True,id=7066a691-9911-48c6-a50c-de2e25f08f1d,network=Network(9be19067-cc29-4c67-95a0-cf37f95f9fc0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7066a691-99')
Jul 29 13:46:21 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-aef83ba2-f86d-499a-9cdb-446aea9357ef tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Deleting instance files /opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1_del
Jul 29 13:46:21 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-aef83ba2-f86d-499a-9cdb-446aea9357ef tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Deletion of /opt/stack/data/nova/instances/16097b06-976f-4fcd-a449-7b1ec8f739d1_del complete
Jul 29 13:46:21 user nova-compute[231753]: INFO nova.compute.manager [None req-aef83ba2-f86d-499a-9cdb-446aea9357ef tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Took 0.72 seconds to destroy the instance on the hypervisor.
Jul 29 13:46:21 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-aef83ba2-f86d-499a-9cdb-446aea9357ef tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:46:21 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:46:21 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:46:22 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:46:22 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Took 0.91 seconds to deallocate network for instance.
Jul 29 13:46:22 user nova-compute[231753]: DEBUG nova.compute.manager [req-6f461535-90ad-4932-9ed6-9b7dd061450a req-28b04b3e-46ce-4b95-b1c4-4a85c222b367 service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Received event network-vif-deleted-7066a691-9911-48c6-a50c-de2e25f08f1d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:46:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-aef83ba2-f86d-499a-9cdb-446aea9357ef tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:46:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-aef83ba2-f86d-499a-9cdb-446aea9357ef tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:46:22 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-aef83ba2-f86d-499a-9cdb-446aea9357ef tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:46:22 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-aef83ba2-f86d-499a-9cdb-446aea9357ef tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:46:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-aef83ba2-f86d-499a-9cdb-446aea9357ef tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.438s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:46:23 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-aef83ba2-f86d-499a-9cdb-446aea9357ef tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Deleted allocations for instance 16097b06-976f-4fcd-a449-7b1ec8f739d1
Jul 29 13:46:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-aef83ba2-f86d-499a-9cdb-446aea9357ef tempest-AttachVolumeShelveTestJSON-460717858 tempest-AttachVolumeShelveTestJSON-460717858-project-member] Lock "16097b06-976f-4fcd-a449-7b1ec8f739d1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.269s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:46:23 user nova-compute[231753]: DEBUG nova.compute.manager [req-1165bdbe-852f-49eb-bb76-b210bab3b4de req-66f44cbc-8f88-49f9-ba48-24db3232a69f service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Received event network-vif-plugged-7066a691-9911-48c6-a50c-de2e25f08f1d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:46:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-1165bdbe-852f-49eb-bb76-b210bab3b4de req-66f44cbc-8f88-49f9-ba48-24db3232a69f service nova] Acquiring lock "16097b06-976f-4fcd-a449-7b1ec8f739d1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:46:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-1165bdbe-852f-49eb-bb76-b210bab3b4de req-66f44cbc-8f88-49f9-ba48-24db3232a69f service nova] Lock "16097b06-976f-4fcd-a449-7b1ec8f739d1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:46:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-1165bdbe-852f-49eb-bb76-b210bab3b4de req-66f44cbc-8f88-49f9-ba48-24db3232a69f service nova] Lock "16097b06-976f-4fcd-a449-7b1ec8f739d1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:46:23 user nova-compute[231753]: DEBUG nova.compute.manager [req-1165bdbe-852f-49eb-bb76-b210bab3b4de req-66f44cbc-8f88-49f9-ba48-24db3232a69f service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] No waiting events found dispatching network-vif-plugged-7066a691-9911-48c6-a50c-de2e25f08f1d {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:46:23 user nova-compute[231753]: WARNING nova.compute.manager [req-1165bdbe-852f-49eb-bb76-b210bab3b4de req-66f44cbc-8f88-49f9-ba48-24db3232a69f service nova] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Received unexpected event network-vif-plugged-7066a691-9911-48c6-a50c-de2e25f08f1d for instance with vm_state deleted and task_state None.
Jul 29 13:46:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Acquiring lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:46:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:46:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Acquiring lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:46:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:46:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:46:24 user nova-compute[231753]: INFO nova.compute.manager [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Terminating instance
Jul 29 13:46:24 user nova-compute[231753]: DEBUG nova.compute.manager [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:46:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:24 user nova-compute[231753]: DEBUG nova.compute.manager [req-c924e319-8c52-44b3-9dbf-32ac57b24746 req-1c433fa9-84ee-405f-a901-2370563d4e09 service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Received event network-vif-unplugged-78884930-2bc7-430e-b250-851ff726d5f8 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:46:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c924e319-8c52-44b3-9dbf-32ac57b24746 req-1c433fa9-84ee-405f-a901-2370563d4e09 service nova] Acquiring lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:46:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c924e319-8c52-44b3-9dbf-32ac57b24746 req-1c433fa9-84ee-405f-a901-2370563d4e09 service nova] Lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:46:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c924e319-8c52-44b3-9dbf-32ac57b24746 req-1c433fa9-84ee-405f-a901-2370563d4e09 service nova] Lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:46:24 user nova-compute[231753]: DEBUG nova.compute.manager [req-c924e319-8c52-44b3-9dbf-32ac57b24746 req-1c433fa9-84ee-405f-a901-2370563d4e09 service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] No waiting events found dispatching network-vif-unplugged-78884930-2bc7-430e-b250-851ff726d5f8 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:46:24 user nova-compute[231753]: DEBUG nova.compute.manager [req-c924e319-8c52-44b3-9dbf-32ac57b24746 req-1c433fa9-84ee-405f-a901-2370563d4e09 service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Received event network-vif-unplugged-78884930-2bc7-430e-b250-851ff726d5f8 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:46:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:24 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Instance destroyed successfully.
Jul 29 13:46:24 user nova-compute[231753]: DEBUG nova.objects.instance [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lazy-loading 'resources' on Instance uuid 37fbc873-537c-4bbc-a57b-2c44e47ecf30 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:46:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-29T13:42:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-565491757',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1951457883',id=27,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDc03FdfB1WkJMQ+OFlTQGDyqI+vnX8r38QSC1X3+I46SKYhhpq2ELYDYwCr+yT2E/7oa4VZ/8HKFoV3Qq+q1XdXsiLTiNzAVeDrjcozJkO0FAkqdQDw0IZWfQrN8WwQag==',key_name='tempest-keypair-386440795',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:45:08Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='876fbcda354d47c197ce14ca4ed7ead6',ramdisk_id='',reservation_id='r-8m5l27cs',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1385583979',owner_user_name='tempest-ServerActionsV293TestJSON-1385583979-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:45:08Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3330125060d64234bce343af655e58e3',uuid=37fbc873-537c-4bbc-a57b-2c44e47ecf30,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "78884930-2bc7-430e-b250-851ff726d5f8", "address": "fa:16:3e:0e:5d:f8", "network": {"id": "c8ebc7da-3ffe-45a0-b7f5-bb85261852ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1496462371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876fbcda354d47c197ce14ca4ed7ead6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78884930-2b", "ovs_interfaceid": "78884930-2bc7-430e-b250-851ff726d5f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:46:24 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Converting VIF {"id": "78884930-2bc7-430e-b250-851ff726d5f8", "address": "fa:16:3e:0e:5d:f8", "network": {"id": "c8ebc7da-3ffe-45a0-b7f5-bb85261852ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1496462371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.254", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876fbcda354d47c197ce14ca4ed7ead6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap78884930-2b", "ovs_interfaceid": "78884930-2bc7-430e-b250-851ff726d5f8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:46:24 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:5d:f8,bridge_name='br-int',has_traffic_filtering=True,id=78884930-2bc7-430e-b250-851ff726d5f8,network=Network(c8ebc7da-3ffe-45a0-b7f5-bb85261852ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78884930-2b') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:46:24 user nova-compute[231753]: DEBUG os_vif [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:5d:f8,bridge_name='br-int',has_traffic_filtering=True,id=78884930-2bc7-430e-b250-851ff726d5f8,network=Network(c8ebc7da-3ffe-45a0-b7f5-bb85261852ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78884930-2b') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:46:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap78884930-2b, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:46:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:46:24 user nova-compute[231753]: INFO os_vif [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0e:5d:f8,bridge_name='br-int',has_traffic_filtering=True,id=78884930-2bc7-430e-b250-851ff726d5f8,network=Network(c8ebc7da-3ffe-45a0-b7f5-bb85261852ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap78884930-2b')
Jul 29 13:46:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:46:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'ogpdWmcA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:46:24 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:46:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:46:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:46:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:24 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd6d73bc-fce2-436e-b23a-2618109021a4]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:46:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:46:24 user nova-compute[231753]: No targets found.
Jul 29 13:46:24 user nova-compute[231753]: iSNS:
Jul 29 13:46:24 user nova-compute[231753]: No targets found.
Jul 29 13:46:24 user nova-compute[231753]: STATIC:
Jul 29 13:46:24 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea
Jul 29 13:46:24 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:46:24 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:46:24 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5
Jul 29 13:46:24 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:46:24 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:46:24 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef
Jul 29 13:46:24 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:46:24 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:46:24 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93
Jul 29 13:46:24 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:46:24 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:46:24 user nova-compute[231753]: FIRMWARE:
Jul 29 13:46:24 user nova-compute[231753]: No targets found.
Jul 29 13:46:24 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:46:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:46:24 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:46:24 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:46:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:46:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:24 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5420ab80-ca51-4b5d-91fc-934f326f1422]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:46:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d22f6956-841a-49e7-b9ca-7267c9c5db12]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)\ntcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:46:25 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:46:25 user nova-compute[231753]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)
Jul 29 13:46:25 user nova-compute[231753]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)
Jul 29 13:46:25 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:46:25 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:46:25 user nova-compute[231753]: tcp: [32] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 (non-flash)
Jul 29 13:46:25 user nova-compute[231753]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)
Jul 29 13:46:25 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c8033e0e0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93'): ({'sdb'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Removing single pathed devices sdb {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ad9fd1-3bd1-4be1-9094-469b59cc4071]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd408ea-c697-4e23-b3ca-53a0bccfde45]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Flushing IO for device /dev/sdb {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[84037485-8e26-420f-8027-2127a17975f1]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.096s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[be9556ae-4a91-4bbb-a337-362bdf2a36a4]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] SCSI volumes sdb have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb60078-00fd-468b-ab3e-63a060af575e]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a38b22d-18d7-431f-9f08-b42608e31287]: (4, ('Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93, portal: 172.16.0.220,3260]\nLogout of [sid: 32, target: iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93, portal: 172.16.0.220,3260]
Jul 29 13:46:25 user nova-compute[231753]: Logout of [sid: 32, target: iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93, portal: 172.16.0.220,3260] successful.
Jul 29 13:46:25 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:ab44b913-5e3b-47fc-bd32-bd84e4d88f93 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[26411c3b-a05d-4b45-9c50-d6dc9452a60b]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.385s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] <== disconnect_volume: return (386ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:46:25 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Deleting instance files /opt/stack/data/nova/instances/37fbc873-537c-4bbc-a57b-2c44e47ecf30_del
Jul 29 13:46:25 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Deletion of /opt/stack/data/nova/instances/37fbc873-537c-4bbc-a57b-2c44e47ecf30_del complete
Jul 29 13:46:25 user nova-compute[231753]: INFO nova.compute.manager [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Took 1.23 seconds to destroy the instance on the hypervisor.
Jul 29 13:46:25 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:46:25 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:46:26 user nova-compute[231753]: DEBUG nova.compute.manager [req-dcba6974-41a7-41e8-9845-03ba61488968 req-91ca346e-35ba-40cf-b94f-83c025fb123b service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Received event network-vif-plugged-78884930-2bc7-430e-b250-851ff726d5f8 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:46:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-dcba6974-41a7-41e8-9845-03ba61488968 req-91ca346e-35ba-40cf-b94f-83c025fb123b service nova] Acquiring lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:46:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-dcba6974-41a7-41e8-9845-03ba61488968 req-91ca346e-35ba-40cf-b94f-83c025fb123b service nova] Lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:46:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-dcba6974-41a7-41e8-9845-03ba61488968 req-91ca346e-35ba-40cf-b94f-83c025fb123b service nova] Lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:46:26 user nova-compute[231753]: DEBUG nova.compute.manager [req-dcba6974-41a7-41e8-9845-03ba61488968 req-91ca346e-35ba-40cf-b94f-83c025fb123b service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] No waiting events found dispatching network-vif-plugged-78884930-2bc7-430e-b250-851ff726d5f8 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:46:26 user nova-compute[231753]: WARNING nova.compute.manager [req-dcba6974-41a7-41e8-9845-03ba61488968 req-91ca346e-35ba-40cf-b94f-83c025fb123b service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Received unexpected event network-vif-plugged-78884930-2bc7-430e-b250-851ff726d5f8 for instance with vm_state active and task_state deleting.
Jul 29 13:46:26 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:46:27 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Took 1.64 seconds to deallocate network for instance.
Jul 29 13:46:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-3746d54d-7a94-4d53-b1be-58a78849cc93 req-a279030b-2f9d-4504-b204-e338d5d520c2 service nova] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Received event network-vif-deleted-78884930-2bc7-430e-b250-851ff726d5f8 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:46:27 user nova-compute[231753]: INFO nova.compute.manager [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Took 0.84 seconds to detach 1 volumes for instance.
Jul 29 13:46:27 user nova-compute[231753]: DEBUG nova.compute.manager [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Deleting volume: ab44b913-5e3b-47fc-bd32-bd84e4d88f93 {{(pid=231753) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 29 13:46:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:46:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:46:28 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:46:28 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:46:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.412s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:46:28 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Deleted allocations for instance 37fbc873-537c-4bbc-a57b-2c44e47ecf30
Jul 29 13:46:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0a8e724c-246e-4560-b29a-23801f5d7931 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "37fbc873-537c-4bbc-a57b-2c44e47ecf30" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 4.412s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:46:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:30 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:36 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690638381.4314888, 16097b06-976f-4fcd-a449-7b1ec8f739d1 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:46:36 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] VM Stopped (Lifecycle Event)
Jul 29 13:46:36 user nova-compute[231753]: DEBUG nova.compute.manager [None req-3b66447d-e5f4-4a12-b17d-954619ed3982 None None] [instance: 16097b06-976f-4fcd-a449-7b1ec8f739d1] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:46:39 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690638384.8890903, 37fbc873-537c-4bbc-a57b-2c44e47ecf30 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:46:39 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] VM Stopped (Lifecycle Event)
Jul 29 13:46:39 user nova-compute[231753]: DEBUG nova.compute.manager [None req-a0a1cccc-e7e8-4779-900c-3add3f578522 None None] [instance: 37fbc873-537c-4bbc-a57b-2c44e47ecf30] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:46:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "b6be450b-ebe7-4385-b162-2d072237aa97" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:46:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "b6be450b-ebe7-4385-b162-2d072237aa97" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:46:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:46:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:46:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:46:42 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:46:42 user nova-compute[231753]: INFO nova.compute.claims [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Claim successful on node user
Jul 29 13:46:42 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:46:42 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:46:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.658s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:46:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:46:43 user nova-compute[231753]: DEBUG nova.compute.manager [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:46:43 user nova-compute[231753]: DEBUG nova.network.neutron [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:46:43 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:46:43 user nova-compute[231753]: DEBUG nova.compute.manager [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:46:43 user nova-compute[231753]: DEBUG nova.policy [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '618ce2d56c3c4ee8ace871d308ca45fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01165e83a3143ad83f050790f2b63fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:46:43 user nova-compute[231753]: DEBUG nova.compute.manager [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:46:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:46:43 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Creating image(s)
Jul 29 13:46:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "/opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:46:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "/opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:46:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "/opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.004s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:46:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.137s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:46:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:46:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.141s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk 1073741824" returned: 0 in 0.050s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.199s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:46:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.138s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:43 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Checking if we can resize image /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:46:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:46:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:46:43 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Cannot resize image /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:46:43 user nova-compute[231753]: DEBUG nova.objects.instance [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lazy-loading 'migration_context' on Instance uuid b6be450b-ebe7-4385-b162-2d072237aa97 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:46:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:46:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Ensure instance console log exists: /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:46:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:46:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:46:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:46:43 user nova-compute[231753]: DEBUG nova.network.neutron [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Successfully created port: 89f0da4e-b00a-4840-b7d3-0b455f6ed266 {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:46:44 user nova-compute[231753]: DEBUG nova.network.neutron [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Successfully updated port: 89f0da4e-b00a-4840-b7d3-0b455f6ed266 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:46:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "refresh_cache-b6be450b-ebe7-4385-b162-2d072237aa97" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:46:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquired lock "refresh_cache-b6be450b-ebe7-4385-b162-2d072237aa97" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:46:44 user nova-compute[231753]: DEBUG nova.network.neutron [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:46:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-35bbf8a9-80d7-4bf5-b07a-de4803e171f8 req-e331c59d-9305-414c-9ead-c07279609e07 service nova] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Received event network-changed-89f0da4e-b00a-4840-b7d3-0b455f6ed266 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:46:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-35bbf8a9-80d7-4bf5-b07a-de4803e171f8 req-e331c59d-9305-414c-9ead-c07279609e07 service nova] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Refreshing instance network info cache due to event network-changed-89f0da4e-b00a-4840-b7d3-0b455f6ed266. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:46:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-35bbf8a9-80d7-4bf5-b07a-de4803e171f8 req-e331c59d-9305-414c-9ead-c07279609e07 service nova] Acquiring lock "refresh_cache-b6be450b-ebe7-4385-b162-2d072237aa97" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:46:44 user nova-compute[231753]: DEBUG nova.network.neutron [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:46:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG nova.network.neutron [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Updating instance_info_cache with network_info: [{"id": "89f0da4e-b00a-4840-b7d3-0b455f6ed266", "address": "fa:16:3e:73:e6:fa", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f0da4e-b0", "ovs_interfaceid": "89f0da4e-b00a-4840-b7d3-0b455f6ed266", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Releasing lock "refresh_cache-b6be450b-ebe7-4385-b162-2d072237aa97" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG nova.compute.manager [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Instance network_info: |[{"id": "89f0da4e-b00a-4840-b7d3-0b455f6ed266", "address": "fa:16:3e:73:e6:fa", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f0da4e-b0", "ovs_interfaceid": "89f0da4e-b00a-4840-b7d3-0b455f6ed266", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-35bbf8a9-80d7-4bf5-b07a-de4803e171f8 req-e331c59d-9305-414c-9ead-c07279609e07 service nova] Acquired lock "refresh_cache-b6be450b-ebe7-4385-b162-2d072237aa97" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG nova.network.neutron [req-35bbf8a9-80d7-4bf5-b07a-de4803e171f8 req-e331c59d-9305-414c-9ead-c07279609e07 service nova] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Refreshing network info cache for port 89f0da4e-b00a-4840-b7d3-0b455f6ed266 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Start _get_guest_xml network_info=[{"id": "89f0da4e-b00a-4840-b7d3-0b455f6ed266", "address": "fa:16:3e:73:e6:fa", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f0da4e-b0", "ovs_interfaceid": "89f0da4e-b00a-4840-b7d3-0b455f6ed266", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:46:45 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:46:45 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:46:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:46:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1809390612',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1809390612',id=32,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c01165e83a3143ad83f050790f2b63fe',ramdisk_id='',reservation_id='r-ewzymtzu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-93506270',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:46:43Z,user_data=None,user_id='618ce2d56c3c4ee8ace871d308ca45fb',uuid=b6be450b-ebe7-4385-b162-2d072237aa97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89f0da4e-b00a-4840-b7d3-0b455f6ed266", "address": "fa:16:3e:73:e6:fa", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f0da4e-b0", "ovs_interfaceid": "89f0da4e-b00a-4840-b7d3-0b455f6ed266", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Converting VIF {"id": "89f0da4e-b00a-4840-b7d3-0b455f6ed266", "address": "fa:16:3e:73:e6:fa", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f0da4e-b0", "ovs_interfaceid": "89f0da4e-b00a-4840-b7d3-0b455f6ed266", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:e6:fa,bridge_name='br-int',has_traffic_filtering=True,id=89f0da4e-b00a-4840-b7d3-0b455f6ed266,network=Network(03362fcb-afd6-4b0a-af44-a54a848c59f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f0da4e-b0') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG nova.objects.instance [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lazy-loading 'pci_devices' on Instance uuid b6be450b-ebe7-4385-b162-2d072237aa97 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:46:45 user nova-compute[231753]:   <uuid>b6be450b-ebe7-4385-b162-2d072237aa97</uuid>
Jul 29 13:46:45 user nova-compute[231753]:   <name>instance-00000020</name>
Jul 29 13:46:45 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:46:45 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:46:45 user nova-compute[231753]:   <metadata>
Jul 29 13:46:45 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:46:45 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:46:45 user nova-compute[231753]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1809390612</nova:name>
Jul 29 13:46:45 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:46:45</nova:creationTime>
Jul 29 13:46:45 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:46:45 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:46:45 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:46:45 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:46:45 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:46:45 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:46:45 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:46:45 user nova-compute[231753]:       <nova:owner>
Jul 29 13:46:45 user nova-compute[231753]:         <nova:user uuid="618ce2d56c3c4ee8ace871d308ca45fb">tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member</nova:user>
Jul 29 13:46:45 user nova-compute[231753]:         <nova:project uuid="c01165e83a3143ad83f050790f2b63fe">tempest-ServerBootFromVolumeStableRescueTest-93506270</nova:project>
Jul 29 13:46:45 user nova-compute[231753]:       </nova:owner>
Jul 29 13:46:45 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:46:45 user nova-compute[231753]:       <nova:ports>
Jul 29 13:46:45 user nova-compute[231753]:         <nova:port uuid="89f0da4e-b00a-4840-b7d3-0b455f6ed266">
Jul 29 13:46:45 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 29 13:46:45 user nova-compute[231753]:         </nova:port>
Jul 29 13:46:45 user nova-compute[231753]:       </nova:ports>
Jul 29 13:46:45 user nova-compute[231753]:     </nova:instance>
Jul 29 13:46:45 user nova-compute[231753]:   </metadata>
Jul 29 13:46:45 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:46:45 user nova-compute[231753]:     <system>
Jul 29 13:46:45 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:46:45 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:46:45 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:46:45 user nova-compute[231753]:       <entry name="serial">b6be450b-ebe7-4385-b162-2d072237aa97</entry>
Jul 29 13:46:45 user nova-compute[231753]:       <entry name="uuid">b6be450b-ebe7-4385-b162-2d072237aa97</entry>
Jul 29 13:46:45 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:46:45 user nova-compute[231753]:     </system>
Jul 29 13:46:45 user nova-compute[231753]:   </sysinfo>
Jul 29 13:46:45 user nova-compute[231753]:   <os>
Jul 29 13:46:45 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:46:45 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:46:45 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:46:45 user nova-compute[231753]:   </os>
Jul 29 13:46:45 user nova-compute[231753]:   <features>
Jul 29 13:46:45 user nova-compute[231753]:     <acpi/>
Jul 29 13:46:45 user nova-compute[231753]:     <apic/>
Jul 29 13:46:45 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:46:45 user nova-compute[231753]:   </features>
Jul 29 13:46:45 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:46:45 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:46:45 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:46:45 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:46:45 user nova-compute[231753]:   </clock>
Jul 29 13:46:45 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:46:45 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:46:45 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:46:45 user nova-compute[231753]:   </cpu>
Jul 29 13:46:45 user nova-compute[231753]:   <devices>
Jul 29 13:46:45 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:46:45 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:46:45 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk"/>
Jul 29 13:46:45 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:46:45 user nova-compute[231753]:     </disk>
Jul 29 13:46:45 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:46:45 user nova-compute[231753]:       <mac address="fa:16:3e:73:e6:fa"/>
Jul 29 13:46:45 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:46:45 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:46:45 user nova-compute[231753]:       <target dev="tap89f0da4e-b0"/>
Jul 29 13:46:45 user nova-compute[231753]:     </interface>
Jul 29 13:46:45 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:46:45 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/console.log" append="off"/>
Jul 29 13:46:45 user nova-compute[231753]:     </serial>
Jul 29 13:46:45 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:46:45 user nova-compute[231753]:     <video>
Jul 29 13:46:45 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:46:45 user nova-compute[231753]:     </video>
Jul 29 13:46:45 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:46:45 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:46:45 user nova-compute[231753]:     </rng>
Jul 29 13:46:45 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:46:45 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:46:45 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:46:45 user nova-compute[231753]:     </memballoon>
Jul 29 13:46:45 user nova-compute[231753]:   </devices>
Jul 29 13:46:45 user nova-compute[231753]: </domain>
Jul 29 13:46:45 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:46:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1809390612',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1809390612',id=32,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c01165e83a3143ad83f050790f2b63fe',ramdisk_id='',reservation_id='r-ewzymtzu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-93506270',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:46:43Z,user_data=None,user_id='618ce2d56c3c4ee8ace871d308ca45fb',uuid=b6be450b-ebe7-4385-b162-2d072237aa97,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "89f0da4e-b00a-4840-b7d3-0b455f6ed266", "address": "fa:16:3e:73:e6:fa", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f0da4e-b0", "ovs_interfaceid": "89f0da4e-b00a-4840-b7d3-0b455f6ed266", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Converting VIF {"id": "89f0da4e-b00a-4840-b7d3-0b455f6ed266", "address": "fa:16:3e:73:e6:fa", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f0da4e-b0", "ovs_interfaceid": "89f0da4e-b00a-4840-b7d3-0b455f6ed266", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:73:e6:fa,bridge_name='br-int',has_traffic_filtering=True,id=89f0da4e-b00a-4840-b7d3-0b455f6ed266,network=Network(03362fcb-afd6-4b0a-af44-a54a848c59f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f0da4e-b0') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG os_vif [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:e6:fa,bridge_name='br-int',has_traffic_filtering=True,id=89f0da4e-b00a-4840-b7d3-0b455f6ed266,network=Network(03362fcb-afd6-4b0a-af44-a54a848c59f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f0da4e-b0') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap89f0da4e-b0, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap89f0da4e-b0, col_values=(('external_ids', {'iface-id': '89f0da4e-b00a-4840-b7d3-0b455f6ed266', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:73:e6:fa', 'vm-uuid': 'b6be450b-ebe7-4385-b162-2d072237aa97'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:45 user nova-compute[231753]: INFO os_vif [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:73:e6:fa,bridge_name='br-int',has_traffic_filtering=True,id=89f0da4e-b00a-4840-b7d3-0b455f6ed266,network=Network(03362fcb-afd6-4b0a-af44-a54a848c59f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f0da4e-b0')
Jul 29 13:46:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] No VIF found with MAC fa:16:3e:73:e6:fa, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG nova.network.neutron [req-35bbf8a9-80d7-4bf5-b07a-de4803e171f8 req-e331c59d-9305-414c-9ead-c07279609e07 service nova] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Updated VIF entry in instance network info cache for port 89f0da4e-b00a-4840-b7d3-0b455f6ed266. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG nova.network.neutron [req-35bbf8a9-80d7-4bf5-b07a-de4803e171f8 req-e331c59d-9305-414c-9ead-c07279609e07 service nova] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Updating instance_info_cache with network_info: [{"id": "89f0da4e-b00a-4840-b7d3-0b455f6ed266", "address": "fa:16:3e:73:e6:fa", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f0da4e-b0", "ovs_interfaceid": "89f0da4e-b00a-4840-b7d3-0b455f6ed266", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:46:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-35bbf8a9-80d7-4bf5-b07a-de4803e171f8 req-e331c59d-9305-414c-9ead-c07279609e07 service nova] Releasing lock "refresh_cache-b6be450b-ebe7-4385-b162-2d072237aa97" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:46:46 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:47 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:47 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:47 user nova-compute[231753]: DEBUG nova.compute.manager [req-0f4d4d0a-e890-472b-ac8c-5d3840616f34 req-160efce8-02f0-46b9-abf1-04a0abe4e52f service nova] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Received event network-vif-plugged-89f0da4e-b00a-4840-b7d3-0b455f6ed266 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:46:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0f4d4d0a-e890-472b-ac8c-5d3840616f34 req-160efce8-02f0-46b9-abf1-04a0abe4e52f service nova] Acquiring lock "b6be450b-ebe7-4385-b162-2d072237aa97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:46:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0f4d4d0a-e890-472b-ac8c-5d3840616f34 req-160efce8-02f0-46b9-abf1-04a0abe4e52f service nova] Lock "b6be450b-ebe7-4385-b162-2d072237aa97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:46:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0f4d4d0a-e890-472b-ac8c-5d3840616f34 req-160efce8-02f0-46b9-abf1-04a0abe4e52f service nova] Lock "b6be450b-ebe7-4385-b162-2d072237aa97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:46:47 user nova-compute[231753]: DEBUG nova.compute.manager [req-0f4d4d0a-e890-472b-ac8c-5d3840616f34 req-160efce8-02f0-46b9-abf1-04a0abe4e52f service nova] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] No waiting events found dispatching network-vif-plugged-89f0da4e-b00a-4840-b7d3-0b455f6ed266 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:46:47 user nova-compute[231753]: WARNING nova.compute.manager [req-0f4d4d0a-e890-472b-ac8c-5d3840616f34 req-160efce8-02f0-46b9-abf1-04a0abe4e52f service nova] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Received unexpected event network-vif-plugged-89f0da4e-b00a-4840-b7d3-0b455f6ed266 for instance with vm_state building and task_state spawning.
Jul 29 13:46:47 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:47 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:49 user nova-compute[231753]: DEBUG nova.compute.manager [req-dd657429-c830-4fba-bd35-a468f89f7513 req-45721d4f-ea86-47cc-9502-8747b31f140e service nova] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Received event network-vif-plugged-89f0da4e-b00a-4840-b7d3-0b455f6ed266 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:46:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-dd657429-c830-4fba-bd35-a468f89f7513 req-45721d4f-ea86-47cc-9502-8747b31f140e service nova] Acquiring lock "b6be450b-ebe7-4385-b162-2d072237aa97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:46:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-dd657429-c830-4fba-bd35-a468f89f7513 req-45721d4f-ea86-47cc-9502-8747b31f140e service nova] Lock "b6be450b-ebe7-4385-b162-2d072237aa97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:46:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-dd657429-c830-4fba-bd35-a468f89f7513 req-45721d4f-ea86-47cc-9502-8747b31f140e service nova] Lock "b6be450b-ebe7-4385-b162-2d072237aa97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:46:49 user nova-compute[231753]: DEBUG nova.compute.manager [req-dd657429-c830-4fba-bd35-a468f89f7513 req-45721d4f-ea86-47cc-9502-8747b31f140e service nova] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] No waiting events found dispatching network-vif-plugged-89f0da4e-b00a-4840-b7d3-0b455f6ed266 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:46:49 user nova-compute[231753]: WARNING nova.compute.manager [req-dd657429-c830-4fba-bd35-a468f89f7513 req-45721d4f-ea86-47cc-9502-8747b31f140e service nova] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Received unexpected event network-vif-plugged-89f0da4e-b00a-4840-b7d3-0b455f6ed266 for instance with vm_state building and task_state spawning.
Jul 29 13:46:49 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638409.5109587, b6be450b-ebe7-4385-b162-2d072237aa97 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:46:49 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] VM Resumed (Lifecycle Event)
Jul 29 13:46:49 user nova-compute[231753]: DEBUG nova.compute.manager [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:46:49 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:46:49 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Instance spawned successfully.
Jul 29 13:46:49 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:46:49 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:46:49 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:46:49 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:46:49 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:46:49 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:46:49 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:46:49 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:46:49 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:46:49 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:46:49 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638409.5130386, b6be450b-ebe7-4385-b162-2d072237aa97 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:46:49 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] VM Started (Lifecycle Event)
Jul 29 13:46:49 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:46:49 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:46:49 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:46:49 user nova-compute[231753]: INFO nova.compute.manager [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Took 6.45 seconds to spawn the instance on the hypervisor.
Jul 29 13:46:49 user nova-compute[231753]: DEBUG nova.compute.manager [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:46:49 user nova-compute[231753]: INFO nova.compute.manager [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Took 7.47 seconds to build instance.
Jul 29 13:46:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-aa85498a-aaeb-42c7-8c66-81c32bda0b45 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "b6be450b-ebe7-4385-b162-2d072237aa97" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.565s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:46:50 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:46:55 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:00 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:00 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "aee15bbf-4d52-4611-9e75-6443c2384913" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "aee15bbf-4d52-4611-9e75-6443c2384913" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:00 user nova-compute[231753]: DEBUG nova.objects.instance [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lazy-loading 'flavor' on Instance uuid aee15bbf-4d52-4611-9e75-6443c2384913 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:47:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "aee15bbf-4d52-4611-9e75-6443c2384913" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.070s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "aee15bbf-4d52-4611-9e75-6443c2384913" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "aee15bbf-4d52-4611-9e75-6443c2384913" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:00 user nova-compute[231753]: INFO nova.compute.manager [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Attaching volume f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 to /dev/vdb
Jul 29 13:47:01 user nova-compute[231753]: DEBUG os_brick.utils [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:47:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:01 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0ae0ab6-3798-461d-b9e9-0fbe86346b17]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:01 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[011de14f-2683-4ac7-bcdb-94265518df29]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:01 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d50f9dc-9dbe-42ee-9ece-f61ced2f09f0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:01 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f8a9cc2-7ef7-4026-b1ee-1cd16f36ec3c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:47:01 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:47:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:47:01 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:47:01 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6820e70e-9820-4a2a-82da-094e2dd86936]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:01 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:47:01 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:47:01 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:47:01 user nova-compute[231753]: DEBUG os_brick.utils [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:47:01 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Updating existing volume attachment record: cdd48dc6-bd93-4949-be31-e88b637e4a3d {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:47:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:05 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:06 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:07 user nova-compute[231753]: DEBUG nova.compute.manager [req-ff9adcae-6b9c-4191-be75-50462a65844a req-f2bfd6bb-bada-4887-b5fd-89384646c778 service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Received event network-changed-a25ce12c-a83d-4128-ac1e-62ca02ae31fd {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:47:07 user nova-compute[231753]: DEBUG nova.compute.manager [req-ff9adcae-6b9c-4191-be75-50462a65844a req-f2bfd6bb-bada-4887-b5fd-89384646c778 service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Refreshing instance network info cache due to event network-changed-a25ce12c-a83d-4128-ac1e-62ca02ae31fd. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:47:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ff9adcae-6b9c-4191-be75-50462a65844a req-f2bfd6bb-bada-4887-b5fd-89384646c778 service nova] Acquiring lock "refresh_cache-b9751029-dfed-4342-ad92-9ae53d72fbc1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:47:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ff9adcae-6b9c-4191-be75-50462a65844a req-f2bfd6bb-bada-4887-b5fd-89384646c778 service nova] Acquired lock "refresh_cache-b9751029-dfed-4342-ad92-9ae53d72fbc1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:47:07 user nova-compute[231753]: DEBUG nova.network.neutron [req-ff9adcae-6b9c-4191-be75-50462a65844a req-f2bfd6bb-bada-4887-b5fd-89384646c778 service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Refreshing network info cache for port a25ce12c-a83d-4128-ac1e-62ca02ae31fd {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:47:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "b9751029-dfed-4342-ad92-9ae53d72fbc1" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:08 user nova-compute[231753]: DEBUG nova.objects.instance [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lazy-loading 'flavor' on Instance uuid b9751029-dfed-4342-ad92-9ae53d72fbc1 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:47:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "b9751029-dfed-4342-ad92-9ae53d72fbc1" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:08 user nova-compute[231753]: INFO nova.compute.manager [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Attaching volume c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 to /dev/vdb
Jul 29 13:47:08 user nova-compute[231753]: DEBUG os_brick.utils [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:47:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:08 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5aac365-3da0-445b-b3b7-bf4bff00dd22]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:08 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee941bf7-0744-4962-8017-44d8df5593b0]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:08 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[afdc4f5a-a338-4114-90fd-02ccb8c3863b]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:08 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4dbeef-d11a-429b-8f52-939789ec98a3]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:47:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:47:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:47:08 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:47:08 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[15184e6d-dd26-41f5-9dc6-95320d4a508a]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:47:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:47:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:47:08 user nova-compute[231753]: DEBUG os_brick.utils [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] <== get_connector_properties: return (140ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:47:08 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Updating existing volume attachment record: f0d2fe3d-b3fc-4721-9361-7b291872246a {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:47:08 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZBkfiDa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:47:09 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:47:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:47:09 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:47:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:47:09 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d624815f-6f57-4be8-ab14-e43ba311abe5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:47:09 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.028s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[61da4d7a-7ed7-4744-8e7c-adc4256d35b5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4] added
Jul 29 13:47:09 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2b1d13-a374-497a-84cb-1cd8fa57512e]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[cace9bb4-9e08-4e91-9950-88d1d89fa295]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tZBkfiDa {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tZBkfiDa" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[11afb12b-1b07-4222-8e4a-58307a6b6001]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tZBkfiDa'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[04605859-6dd6-40b8-8bb3-5ea4956cee4b]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d2ba8de-72bd-4c21-aaa7-3dd3ce83919f]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:47:09 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:47:09 user nova-compute[231753]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)
Jul 29 13:47:09 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:47:09 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:47:09 user nova-compute[231753]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)
Jul 29 13:47:09 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.081s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[00cd0ad5-41fa-4621-a463-86338e315dea]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4, portal: 172.16.0.220,3260]
Jul 29 13:47:09 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4, portal: 172.16.0.220,3260] successful.
Jul 29 13:47:09 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[53407bfd-505e-4881-b87e-dcf00bb55763]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[73339241-7eaa-4f6a-a7d2-320c01ffb2fd]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:47:09 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:47:09 user nova-compute[231753]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)
Jul 29 13:47:09 user nova-compute[231753]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)
Jul 29 13:47:09 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:47:09 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:47:09 user nova-compute[231753]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)
Jul 29 13:47:09 user nova-compute[231753]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)
Jul 29 13:47:09 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.352s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] HCTL ('33', '-', '-', 0) found on session 34 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[76204717-de3c-463e-a030-8fdc0de2c3aa]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: None {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG nova.network.neutron [req-ff9adcae-6b9c-4191-be75-50462a65844a req-f2bfd6bb-bada-4887-b5fd-89384646c778 service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Updated VIF entry in instance network info cache for port a25ce12c-a83d-4128-ac1e-62ca02ae31fd. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG nova.network.neutron [req-ff9adcae-6b9c-4191-be75-50462a65844a req-f2bfd6bb-bada-4887-b5fd-89384646c778 service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Updating instance_info_cache with network_info: [{"id": "a25ce12c-a83d-4128-ac1e-62ca02ae31fd", "address": "fa:16:3e:8f:41:ff", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25ce12c-a8", "ovs_interfaceid": "a25ce12c-a83d-4128-ac1e-62ca02ae31fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ff9adcae-6b9c-4191-be75-50462a65844a req-f2bfd6bb-bada-4887-b5fd-89384646c778 service nova] Releasing lock "refresh_cache-b9751029-dfed-4342-ad92-9ae53d72fbc1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:47:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk --force-share --output=json" returned: 0 in 0.158s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:10 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Searching for a device in session 34 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:47:10 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZBkfiDa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:47:10 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.392s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:47:10 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] <== connect_volume: return (1394ms) {'type': 'block', 'scsi_wwn': '26135313033636133', 'path': '/dev/sdb'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:47:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135313033636133', 'path': '/dev/sdb'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:47:10 user nova-compute[231753]: DEBUG nova.objects.instance [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lazy-loading 'flavor' on Instance uuid aee15bbf-4d52-4611-9e75-6443c2384913 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:47:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 13:47:10 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:47:10 user nova-compute[231753]:   <source dev="/dev/sdb"/>
Jul 29 13:47:10 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:47:10 user nova-compute[231753]:   <serial>f522e219-aad8-4eb2-b6e6-5cceb04ba4c4</serial>
Jul 29 13:47:10 user nova-compute[231753]: </disk>
Jul 29 13:47:10 user nova-compute[231753]:  {{(pid=231753) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 13:47:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk --force-share --output=json" returned: 0 in 0.245s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:47:11 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] No BDM found with device name vdb, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:47:11 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] No VIF found with MAC fa:16:3e:ae:ff:c5, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:47:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-da61e274-58dd-4fdf-a1b8-665705488209 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "aee15bbf-4d52-4611-9e75-6443c2384913" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.254s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:11 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json" returned: 0 in 0.157s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:47:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:47:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a61a780-6403-4aed-9c4a-2af01965f5d2/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a61a780-6403-4aed-9c4a-2af01965f5d2/disk --force-share --output=json" returned: 0 in 0.209s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a61a780-6403-4aed-9c4a-2af01965f5d2/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a61a780-6403-4aed-9c4a-2af01965f5d2/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.177s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:14 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:47:14 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:47:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=6967MB free_disk=25.02539825439453GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 13:47:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:47:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 7e2615c1-b03e-4076-bcd9-3585fb11b8ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:47:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8ea52d41-7ec3-44d7-8421-133000ee887b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:47:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance cf326e80-7293-4764-9411-ed05a5aeba23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:47:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 576f5002-4e4d-4236-8b0f-9b8788246de2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:47:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b99a72ba-73e2-4be7-b52b-7797351daa5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:47:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8dd26572-fe6a-40fd-8c58-6af862b340c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:47:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance f62c7904-d9d1-4bfc-bef8-9b1c241134f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:47:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance aee15bbf-4d52-4611-9e75-6443c2384913 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:47:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b9751029-dfed-4342-ad92-9ae53d72fbc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:47:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8a61a780-6403-4aed-9c4a-2af01965f5d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:47:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b6be450b-ebe7-4385-b162-2d072237aa97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:47:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 13:47:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 13:47:14 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:47:14 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:47:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 13:47:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.670s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:15 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b9a9d498-1fc4-46fd-8407-c9df01b85dbb tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "8dd26572-fe6a-40fd-8c58-6af862b340c4" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b9a9d498-1fc4-46fd-8407-c9df01b85dbb tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:15 user nova-compute[231753]: INFO nova.compute.manager [None req-b9a9d498-1fc4-46fd-8407-c9df01b85dbb tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Detaching volume c520bfb3-fffc-4de5-91c1-a2d62e91c2b5
Jul 29 13:47:15 user nova-compute[231753]: INFO nova.virt.block_device [None req-b9a9d498-1fc4-46fd-8407-c9df01b85dbb tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Attempting to driver detach volume c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 from mountpoint /dev/vdb
Jul 29 13:47:15 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b9a9d498-1fc4-46fd-8407-c9df01b85dbb tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Attempting to detach device vdb from instance 8dd26572-fe6a-40fd-8c58-6af862b340c4 from the persistent domain config. {{(pid=231753) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 13:47:15 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-b9a9d498-1fc4-46fd-8407-c9df01b85dbb tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:47:15 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:47:15 user nova-compute[231753]:   <source dev="/dev/sde"/>
Jul 29 13:47:15 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:47:15 user nova-compute[231753]:   <serial>c520bfb3-fffc-4de5-91c1-a2d62e91c2b5</serial>
Jul 29 13:47:15 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 29 13:47:15 user nova-compute[231753]: </disk>
Jul 29 13:47:15 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:47:15 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-b9a9d498-1fc4-46fd-8407-c9df01b85dbb tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Successfully detached device vdb from instance 8dd26572-fe6a-40fd-8c58-6af862b340c4 from the persistent domain config.
Jul 29 13:47:15 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b9a9d498-1fc4-46fd-8407-c9df01b85dbb tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8dd26572-fe6a-40fd-8c58-6af862b340c4 from the live domain config. {{(pid=231753) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 13:47:15 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-b9a9d498-1fc4-46fd-8407-c9df01b85dbb tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:47:15 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:47:15 user nova-compute[231753]:   <source dev="/dev/sde"/>
Jul 29 13:47:15 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:47:15 user nova-compute[231753]:   <serial>c520bfb3-fffc-4de5-91c1-a2d62e91c2b5</serial>
Jul 29 13:47:15 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 29 13:47:15 user nova-compute[231753]: </disk>
Jul 29 13:47:15 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:47:15 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:47:15 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 13:47:15 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Rebuilding the list of instances to heal {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 13:47:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "refresh_cache-3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:47:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquired lock "refresh_cache-3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:47:15 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Forcefully refreshing network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 13:47:15 user nova-compute[231753]: DEBUG nova.objects.instance [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lazy-loading 'info_cache' on Instance uuid 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-536d7579-3165-4816-89d7-968a8523c227 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Acquiring lock "576f5002-4e4d-4236-8b0f-9b8788246de2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-536d7579-3165-4816-89d7-968a8523c227 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "576f5002-4e4d-4236-8b0f-9b8788246de2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-536d7579-3165-4816-89d7-968a8523c227 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Acquiring lock "576f5002-4e4d-4236-8b0f-9b8788246de2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-536d7579-3165-4816-89d7-968a8523c227 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "576f5002-4e4d-4236-8b0f-9b8788246de2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-536d7579-3165-4816-89d7-968a8523c227 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "576f5002-4e4d-4236-8b0f-9b8788246de2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:16 user nova-compute[231753]: INFO nova.compute.manager [None req-536d7579-3165-4816-89d7-968a8523c227 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Terminating instance
Jul 29 13:47:16 user nova-compute[231753]: DEBUG nova.compute.manager [None req-536d7579-3165-4816-89d7-968a8523c227 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Received event <DeviceRemovedEvent: 1690638436.0643823, 8dd26572-fe6a-40fd-8c58-6af862b340c4 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=231753) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b9a9d498-1fc4-46fd-8407-c9df01b85dbb tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8dd26572-fe6a-40fd-8c58-6af862b340c4 {{(pid=231753) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 13:47:16 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-b9a9d498-1fc4-46fd-8407-c9df01b85dbb tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Successfully detached device vdb from instance 8dd26572-fe6a-40fd-8c58-6af862b340c4 from the live domain config.
Jul 29 13:47:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9a9d498-1fc4-46fd-8407-c9df01b85dbb tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9a9d498-1fc4-46fd-8407-c9df01b85dbb tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QAgBpCbc', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:47:16 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-b9a9d498-1fc4-46fd-8407-c9df01b85dbb tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:47:16 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-b9a9d498-1fc4-46fd-8407-c9df01b85dbb tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-b9a9d498-1fc4-46fd-8407-c9df01b85dbb tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b7f8a8-64ca-4b31-989a-4ab306a3aea3]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9a9d498-1fc4-46fd-8407-c9df01b85dbb tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:47:16 user nova-compute[231753]: No targets found.
Jul 29 13:47:16 user nova-compute[231753]: iSNS:
Jul 29 13:47:16 user nova-compute[231753]: No targets found.
Jul 29 13:47:16 user nova-compute[231753]: STATIC:
Jul 29 13:47:16 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea
Jul 29 13:47:16 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:47:16 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:47:16 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4
Jul 29 13:47:16 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:47:16 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:47:16 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5
Jul 29 13:47:16 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:47:16 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:47:16 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef
Jul 29 13:47:16 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:47:16 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:47:16 user nova-compute[231753]: FIRMWARE:
Jul 29 13:47:16 user nova-compute[231753]: No targets found.
Jul 29 13:47:16 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9a9d498-1fc4-46fd-8407-c9df01b85dbb tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:47:16 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:47:16 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9a9d498-1fc4-46fd-8407-c9df01b85dbb tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[603949c1-7e1e-4dee-acd8-460dcc9d6000]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[88db68eb-8c48-45a6-aab5-71a1e4634360]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)\ntcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9a9d498-1fc4-46fd-8407-c9df01b85dbb tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:47:16 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:47:16 user nova-compute[231753]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)
Jul 29 13:47:16 user nova-compute[231753]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)
Jul 29 13:47:16 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9a9d498-1fc4-46fd-8407-c9df01b85dbb tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:47:16 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:47:16 user nova-compute[231753]: tcp: [33] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 (non-flash)
Jul 29 13:47:16 user nova-compute[231753]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)
Jul 29 13:47:16 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9a9d498-1fc4-46fd-8407-c9df01b85dbb tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ca69a7010>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5'): ({'sde'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-b9a9d498-1fc4-46fd-8407-c9df01b85dbb tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Removing single pathed devices sde {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d3abd13-cf0b-4823-8cfa-c69b08707dfb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[90dcff1e-2eb3-4e55-ba39-b4a4fe160619]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-b9a9d498-1fc4-46fd-8407-c9df01b85dbb tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Flushing IO for device /dev/sde {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.027s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae688e8c-ac99-4830-904b-53af727bebb5]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-b9a9d498-1fc4-46fd-8407-c9df01b85dbb tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.059s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c4e0e73-36b7-42f1-97b7-68fa9b6114d0]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-b9a9d498-1fc4-46fd-8407-c9df01b85dbb tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-b9a9d498-1fc4-46fd-8407-c9df01b85dbb tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] SCSI volumes sde have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9a9d498-1fc4-46fd-8407-c9df01b85dbb tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Acquiring lock "afd6468c-465d-49c9-b01c-93734f2a3e17" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "afd6468c-465d-49c9-b01c-93734f2a3e17" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG nova.compute.manager [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7856b1aa-3a5f-4af4-abd1-4ed27cbf8826]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9a9d498-1fc4-46fd-8407-c9df01b85dbb tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --logout" returned: 0 in 0.085s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e96a2df-3875-47bf-b78c-518b426cca63]: (4, ('Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5, portal: 172.16.0.220,3260]\nLogout of [sid: 33, target: iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9a9d498-1fc4-46fd-8407-c9df01b85dbb tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5, portal: 172.16.0.220,3260]
Jul 29 13:47:16 user nova-compute[231753]: Logout of [sid: 33, target: iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5, portal: 172.16.0.220,3260] successful.
Jul 29 13:47:16 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG nova.compute.manager [req-4457a575-b021-4240-a0d5-8f62b717885d req-b3c5731e-ceb4-476c-ab94-3ea4a758dd26 service nova] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Received event network-vif-unplugged-89a6c6db-c40f-428c-8739-3f780154f935 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4457a575-b021-4240-a0d5-8f62b717885d req-b3c5731e-ceb4-476c-ab94-3ea4a758dd26 service nova] Acquiring lock "576f5002-4e4d-4236-8b0f-9b8788246de2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4457a575-b021-4240-a0d5-8f62b717885d req-b3c5731e-ceb4-476c-ab94-3ea4a758dd26 service nova] Lock "576f5002-4e4d-4236-8b0f-9b8788246de2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4457a575-b021-4240-a0d5-8f62b717885d req-b3c5731e-ceb4-476c-ab94-3ea4a758dd26 service nova] Lock "576f5002-4e4d-4236-8b0f-9b8788246de2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG nova.compute.manager [req-4457a575-b021-4240-a0d5-8f62b717885d req-b3c5731e-ceb4-476c-ab94-3ea4a758dd26 service nova] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] No waiting events found dispatching network-vif-unplugged-89a6c6db-c40f-428c-8739-3f780154f935 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG nova.compute.manager [req-4457a575-b021-4240-a0d5-8f62b717885d req-b3c5731e-ceb4-476c-ab94-3ea4a758dd26 service nova] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Received event network-vif-unplugged-89a6c6db-c40f-428c-8739-3f780154f935 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:47:16 user nova-compute[231753]: INFO nova.compute.claims [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Claim successful on node user
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c520bfb3-fffc-4de5-91c1-a2d62e91c2b5 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[32e89c02-82c6-429a-9051-f22242137377]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9a9d498-1fc4-46fd-8407-c9df01b85dbb tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-b9a9d498-1fc4-46fd-8407-c9df01b85dbb tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.442s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b9a9d498-1fc4-46fd-8407-c9df01b85dbb tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] <== disconnect_volume: return (443ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b9a9d498-1fc4-46fd-8407-c9df01b85dbb tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Updating instance_info_cache with network_info: [{"id": "2a7981fb-647d-4610-9da2-3b162f366dfe", "address": "fa:16:3e:0c:e3:a3", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7981fb-64", "ovs_interfaceid": "2a7981fb-647d-4610-9da2-3b162f366dfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:47:16 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Instance destroyed successfully.
Jul 29 13:47:16 user nova-compute[231753]: DEBUG nova.objects.instance [None req-536d7579-3165-4816-89d7-968a8523c227 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lazy-loading 'resources' on Instance uuid 576f5002-4e4d-4236-8b0f-9b8788246de2 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Releasing lock "refresh_cache-3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Updated the network info_cache for instance {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-536d7579-3165-4816-89d7-968a8523c227 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:40:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-1355663658',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionsv293testjson-server-1355663658',id=21,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEfXpH2RnoHEl8tlTCSXkRfawa9eiuCdOUHYAaG4NQXZan6vLxBaEtIPr7wVGpyz5DltTEyJzaREkh2cXVCInuJ6dn1UhGgsq7Ktg8mBUfdq5DvLdw0PRjlIdqg/qxUXdg==',key_name='tempest-keypair-722483403',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:40:44Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='876fbcda354d47c197ce14ca4ed7ead6',ramdisk_id='',reservation_id='r-wlhg00zc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1385583979',owner_user_name='tempest-ServerActionsV293TestJSON-1385583979-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:40:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3330125060d64234bce343af655e58e3',uuid=576f5002-4e4d-4236-8b0f-9b8788246de2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89a6c6db-c40f-428c-8739-3f780154f935", "address": "fa:16:3e:73:e5:d2", "network": {"id": "c8ebc7da-3ffe-45a0-b7f5-bb85261852ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1496462371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876fbcda354d47c197ce14ca4ed7ead6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a6c6db-c4", "ovs_interfaceid": "89a6c6db-c40f-428c-8739-3f780154f935", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-536d7579-3165-4816-89d7-968a8523c227 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Converting VIF {"id": "89a6c6db-c40f-428c-8739-3f780154f935", "address": "fa:16:3e:73:e5:d2", "network": {"id": "c8ebc7da-3ffe-45a0-b7f5-bb85261852ff", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-1496462371-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.89", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "876fbcda354d47c197ce14ca4ed7ead6", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89a6c6db-c4", "ovs_interfaceid": "89a6c6db-c40f-428c-8739-3f780154f935", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-536d7579-3165-4816-89d7-968a8523c227 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:e5:d2,bridge_name='br-int',has_traffic_filtering=True,id=89a6c6db-c40f-428c-8739-3f780154f935,network=Network(c8ebc7da-3ffe-45a0-b7f5-bb85261852ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89a6c6db-c4') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG os_vif [None req-536d7579-3165-4816-89d7-968a8523c227 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:e5:d2,bridge_name='br-int',has_traffic_filtering=True,id=89a6c6db-c40f-428c-8739-3f780154f935,network=Network(c8ebc7da-3ffe-45a0-b7f5-bb85261852ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89a6c6db-c4') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89a6c6db-c4, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:16 user nova-compute[231753]: INFO os_vif [None req-536d7579-3165-4816-89d7-968a8523c227 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:e5:d2,bridge_name='br-int',has_traffic_filtering=True,id=89a6c6db-c40f-428c-8739-3f780154f935,network=Network(c8ebc7da-3ffe-45a0-b7f5-bb85261852ff),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89a6c6db-c4')
Jul 29 13:47:16 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-536d7579-3165-4816-89d7-968a8523c227 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Deleting instance files /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2_del
Jul 29 13:47:16 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-536d7579-3165-4816-89d7-968a8523c227 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Deletion of /opt/stack/data/nova/instances/576f5002-4e4d-4236-8b0f-9b8788246de2_del complete
Jul 29 13:47:16 user nova-compute[231753]: INFO nova.compute.manager [None req-536d7579-3165-4816-89d7-968a8523c227 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Took 0.90 seconds to destroy the instance on the hypervisor.
Jul 29 13:47:16 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-536d7579-3165-4816-89d7-968a8523c227 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:47:16 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.786s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG nova.compute.manager [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG nova.compute.manager [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG nova.network.neutron [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:47:17 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:47:17 user nova-compute[231753]: DEBUG nova.compute.manager [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG nova.objects.instance [None req-b9a9d498-1fc4-46fd-8407-c9df01b85dbb tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lazy-loading 'flavor' on Instance uuid 8dd26572-fe6a-40fd-8c58-6af862b340c4 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b9a9d498-1fc4-46fd-8407-c9df01b85dbb tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.037s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG nova.policy [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '799028ef2fe14bebac752577fd148047', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9f0063caba494df79d23ee7ab6cca952', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG nova.compute.manager [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:47:17 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Creating image(s)
Jul 29 13:47:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Acquiring lock "/opt/stack/data/nova/instances/afd6468c-465d-49c9-b01c-93734f2a3e17/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "/opt/stack/data/nova/instances/afd6468c-465d-49c9-b01c-93734f2a3e17/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "/opt/stack/data/nova/instances/afd6468c-465d-49c9-b01c-93734f2a3e17/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.147s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CoWzsqPE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:47:17 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:47:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:47:17 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:47:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:47:17 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:47:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[accc4cc6-f780-49b5-aa60-c20901750611]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:47:17 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1461091e-242f-4b9e-bf41-9f1bb47e8d73 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "8dd26572-fe6a-40fd-8c58-6af862b340c4" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1461091e-242f-4b9e-bf41-9f1bb47e8d73 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4" acquired by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG nova.compute.manager [None req-1461091e-242f-4b9e-bf41-9f1bb47e8d73 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.036s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f70a6ba-b394-425a-96d2-d86869a1bbb3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43] added
Jul 29 13:47:17 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG nova.compute.manager [None req-1461091e-242f-4b9e-bf41-9f1bb47e8d73 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Stopping instance; current vm_state: active, current task_state: powering-off, current DB power_state: 1, current VM power_state: 1 {{(pid=231753) do_stop_instance /opt/stack/nova/nova/compute/manager.py:3342}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG nova.objects.instance [None req-1461091e-242f-4b9e-bf41-9f1bb47e8d73 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lazy-loading 'flavor' on Instance uuid 8dd26572-fe6a-40fd-8c58-6af862b340c4 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.162s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/afd6468c-465d-49c9-b01c-93734f2a3e17/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.032s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2305c9-3e41-462e-9467-5449b25e40cc]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/afd6468c-465d-49c9-b01c-93734f2a3e17/disk 1073741824" returned: 0 in 0.063s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.230s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe75d577-216f-49ec-b09d-cf7e1ecc7d40]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CoWzsqPE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v CoWzsqPE" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[65d26d34-05e6-4926-bbe0-0ee6865ef6f7]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'CoWzsqPE'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.035s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f89c54ff-de54-4abb-b668-b2d9aa14b947]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef497a5e-9452-46c1-a1a6-cfe3452ae468]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:47:18 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:47:18 user nova-compute[231753]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)
Jul 29 13:47:18 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:47:18 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:47:18 user nova-compute[231753]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)
Jul 29 13:47:18 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.153s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Checking if we can resize image /opt/stack/data/nova/instances/afd6468c-465d-49c9-b01c-93734f2a3e17/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afd6468c-465d-49c9-b01c-93734f2a3e17/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d83f2e12-dafb-4b9b-98d8-4900be3e686b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43, portal: 172.16.0.220,3260]
Jul 29 13:47:18 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43, portal: 172.16.0.220,3260] successful.
Jul 29 13:47:18 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[81bc9046-1572-41b6-92c4-54178783e7ce]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5868f583-132b-4205-bb6e-644f387a9323]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:47:18 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:47:18 user nova-compute[231753]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)
Jul 29 13:47:18 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:47:18 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:47:18 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:47:18 user nova-compute[231753]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)
Jul 29 13:47:18 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:47:18 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.459s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] HCTL ('36', '-', '-', 0) found on session 35 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.038s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[75041b8b-05eb-48c1-a984-159690ba8350]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Searching for a device in session 35 and hctl ['36', '*', '*', 0] yield: sde {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CoWzsqPE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afd6468c-465d-49c9-b01c-93734f2a3e17/disk --force-share --output=json" returned: 0 in 0.234s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Cannot resize image /opt/stack/data/nova/instances/afd6468c-465d-49c9-b01c-93734f2a3e17/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG nova.objects.instance [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lazy-loading 'migration_context' on Instance uuid afd6468c-465d-49c9-b01c-93734f2a3e17 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG nova.compute.manager [req-77613bab-858d-4749-8fd7-bfe5611ede97 req-95495358-0484-4804-b28c-55b637530176 service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Received event network-vif-unplugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-77613bab-858d-4749-8fd7-bfe5611ede97 req-95495358-0484-4804-b28c-55b637530176 service nova] Acquiring lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-77613bab-858d-4749-8fd7-bfe5611ede97 req-95495358-0484-4804-b28c-55b637530176 service nova] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-77613bab-858d-4749-8fd7-bfe5611ede97 req-95495358-0484-4804-b28c-55b637530176 service nova] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG nova.compute.manager [req-77613bab-858d-4749-8fd7-bfe5611ede97 req-95495358-0484-4804-b28c-55b637530176 service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] No waiting events found dispatching network-vif-unplugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:47:18 user nova-compute[231753]: WARNING nova.compute.manager [req-77613bab-858d-4749-8fd7-bfe5611ede97 req-95495358-0484-4804-b28c-55b637530176 service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Received unexpected event network-vif-unplugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 for instance with vm_state active and task_state powering-off.
Jul 29 13:47:18 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Ensure instance console log exists: /opt/stack/data/nova/instances/afd6468c-465d-49c9-b01c-93734f2a3e17/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG nova.network.neutron [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Successfully created port: c940d941-2958-47b0-a186-d56be39e524f {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG nova.compute.manager [req-d1db58e7-eb9e-464e-b1ca-193844de8431 req-ad521ac2-f956-420d-a10e-3a9e903fe490 service nova] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Received event network-vif-plugged-89a6c6db-c40f-428c-8739-3f780154f935 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d1db58e7-eb9e-464e-b1ca-193844de8431 req-ad521ac2-f956-420d-a10e-3a9e903fe490 service nova] Acquiring lock "576f5002-4e4d-4236-8b0f-9b8788246de2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d1db58e7-eb9e-464e-b1ca-193844de8431 req-ad521ac2-f956-420d-a10e-3a9e903fe490 service nova] Lock "576f5002-4e4d-4236-8b0f-9b8788246de2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d1db58e7-eb9e-464e-b1ca-193844de8431 req-ad521ac2-f956-420d-a10e-3a9e903fe490 service nova] Lock "576f5002-4e4d-4236-8b0f-9b8788246de2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG nova.compute.manager [req-d1db58e7-eb9e-464e-b1ca-193844de8431 req-ad521ac2-f956-420d-a10e-3a9e903fe490 service nova] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] No waiting events found dispatching network-vif-plugged-89a6c6db-c40f-428c-8739-3f780154f935 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:47:18 user nova-compute[231753]: WARNING nova.compute.manager [req-d1db58e7-eb9e-464e-b1ca-193844de8431 req-ad521ac2-f956-420d-a10e-3a9e903fe490 service nova] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Received unexpected event network-vif-plugged-89a6c6db-c40f-428c-8739-3f780154f935 for instance with vm_state active and task_state deleting.
Jul 29 13:47:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:18 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Instance destroyed successfully.
Jul 29 13:47:18 user nova-compute[231753]: DEBUG nova.compute.manager [None req-1461091e-242f-4b9e-bf41-9f1bb47e8d73 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:47:18 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Took 1.90 seconds to deallocate network for instance.
Jul 29 13:47:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1461091e-242f-4b9e-bf41-9f1bb47e8d73 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4" "released" by "nova.compute.manager.ComputeManager.stop_instance.<locals>.do_stop_instance" :: held 1.024s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG nova.compute.manager [req-f6c4eabe-b913-4a35-9848-a8af8f066663 req-d2af8d35-1482-47f4-a38a-8b5d9ffc8de5 service nova] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Received event network-vif-deleted-89a6c6db-c40f-428c-8739-3f780154f935 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-536d7579-3165-4816-89d7-968a8523c227 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-536d7579-3165-4816-89d7-968a8523c227 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.520s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] <== connect_volume: return (1523ms) {'type': 'block', 'scsi_wwn': '23434383634343565', 'path': '/dev/sde'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23434383634343565', 'path': '/dev/sde'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG nova.objects.instance [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lazy-loading 'flavor' on Instance uuid b9751029-dfed-4342-ad92-9ae53d72fbc1 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-536d7579-3165-4816-89d7-968a8523c227 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-536d7579-3165-4816-89d7-968a8523c227 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 13:47:19 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:47:19 user nova-compute[231753]:   <source dev="/dev/sde"/>
Jul 29 13:47:19 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:47:19 user nova-compute[231753]:   <serial>c2fb3633-09eb-4b75-84b7-cdd15d3ceb43</serial>
Jul 29 13:47:19 user nova-compute[231753]: </disk>
Jul 29 13:47:19 user nova-compute[231753]:  {{(pid=231753) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-536d7579-3165-4816-89d7-968a8523c227 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.455s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:19 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-536d7579-3165-4816-89d7-968a8523c227 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Deleted allocations for instance 576f5002-4e4d-4236-8b0f-9b8788246de2
Jul 29 13:47:19 user nova-compute[231753]: DEBUG nova.network.neutron [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Successfully updated port: c940d941-2958-47b0-a186-d56be39e524f {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Acquiring lock "refresh_cache-afd6468c-465d-49c9-b01c-93734f2a3e17" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Acquired lock "refresh_cache-afd6468c-465d-49c9-b01c-93734f2a3e17" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG nova.network.neutron [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG nova.network.neutron [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-536d7579-3165-4816-89d7-968a8523c227 tempest-ServerActionsV293TestJSON-1385583979 tempest-ServerActionsV293TestJSON-1385583979-project-member] Lock "576f5002-4e4d-4236-8b0f-9b8788246de2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.525s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] No BDM found with device name vdb, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] No VIF found with MAC fa:16:3e:8f:41:ff, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG nova.network.neutron [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Updating instance_info_cache with network_info: [{"id": "c940d941-2958-47b0-a186-d56be39e524f", "address": "fa:16:3e:ad:34:94", "network": {"id": "e07105bf-cfaf-4a04-be90-27b9f5a1dce1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2002932258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f0063caba494df79d23ee7ab6cca952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc940d941-29", "ovs_interfaceid": "c940d941-2958-47b0-a186-d56be39e524f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Releasing lock "refresh_cache-afd6468c-465d-49c9-b01c-93734f2a3e17" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG nova.compute.manager [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Instance network_info: |[{"id": "c940d941-2958-47b0-a186-d56be39e524f", "address": "fa:16:3e:ad:34:94", "network": {"id": "e07105bf-cfaf-4a04-be90-27b9f5a1dce1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2002932258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f0063caba494df79d23ee7ab6cca952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc940d941-29", "ovs_interfaceid": "c940d941-2958-47b0-a186-d56be39e524f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Start _get_guest_xml network_info=[{"id": "c940d941-2958-47b0-a186-d56be39e524f", "address": "fa:16:3e:ad:34:94", "network": {"id": "e07105bf-cfaf-4a04-be90-27b9f5a1dce1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2002932258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f0063caba494df79d23ee7ab6cca952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc940d941-29", "ovs_interfaceid": "c940d941-2958-47b0-a186-d56be39e524f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:47:19 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:47:19 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:47:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:47:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1481110770',display_name='tempest-TestServerVolumeAttachmentScenario-server-1481110770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1481110770',id=33,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/kDOAHpIapUpqn7h3NHfDM6ynEXAJ8jYQGkyLGs0GIeOss8BfqqQrNLNTRb3sHEsNZLEeq8fwO0YmpqI8DKBs/11c50sMi6qFf4jbutrdpPLlbmNaDftzOO3CPShnsTQ==',key_name='tempest-keypair-1581638911',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f0063caba494df79d23ee7ab6cca952',ramdisk_id='',reservation_id='r-iiyrv4ei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-112712067',owner_user_name='tempest-TestServerVolumeAttachmentScenario-112712067-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:47:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='799028ef2fe14bebac752577fd148047',uuid=afd6468c-465d-49c9-b01c-93734f2a3e17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c940d941-2958-47b0-a186-d56be39e524f", "address": "fa:16:3e:ad:34:94", "network": {"id": "e07105bf-cfaf-4a04-be90-27b9f5a1dce1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2002932258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f0063caba494df79d23ee7ab6cca952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc940d941-29", "ovs_interfaceid": "c940d941-2958-47b0-a186-d56be39e524f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Converting VIF {"id": "c940d941-2958-47b0-a186-d56be39e524f", "address": "fa:16:3e:ad:34:94", "network": {"id": "e07105bf-cfaf-4a04-be90-27b9f5a1dce1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2002932258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f0063caba494df79d23ee7ab6cca952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc940d941-29", "ovs_interfaceid": "c940d941-2958-47b0-a186-d56be39e524f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:34:94,bridge_name='br-int',has_traffic_filtering=True,id=c940d941-2958-47b0-a186-d56be39e524f,network=Network(e07105bf-cfaf-4a04-be90-27b9f5a1dce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc940d941-29') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:47:19 user nova-compute[231753]: DEBUG nova.objects.instance [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lazy-loading 'pci_devices' on Instance uuid afd6468c-465d-49c9-b01c-93734f2a3e17 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2da1729d-c279-4a05-b567-769bf05abcda tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.588s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:47:20 user nova-compute[231753]:   <uuid>afd6468c-465d-49c9-b01c-93734f2a3e17</uuid>
Jul 29 13:47:20 user nova-compute[231753]:   <name>instance-00000021</name>
Jul 29 13:47:20 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:47:20 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:47:20 user nova-compute[231753]:   <metadata>
Jul 29 13:47:20 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:47:20 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:47:20 user nova-compute[231753]:       <nova:name>tempest-TestServerVolumeAttachmentScenario-server-1481110770</nova:name>
Jul 29 13:47:20 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:47:19</nova:creationTime>
Jul 29 13:47:20 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:47:20 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:47:20 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:47:20 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:47:20 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:47:20 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:47:20 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:47:20 user nova-compute[231753]:       <nova:owner>
Jul 29 13:47:20 user nova-compute[231753]:         <nova:user uuid="799028ef2fe14bebac752577fd148047">tempest-TestServerVolumeAttachmentScenario-112712067-project-member</nova:user>
Jul 29 13:47:20 user nova-compute[231753]:         <nova:project uuid="9f0063caba494df79d23ee7ab6cca952">tempest-TestServerVolumeAttachmentScenario-112712067</nova:project>
Jul 29 13:47:20 user nova-compute[231753]:       </nova:owner>
Jul 29 13:47:20 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:47:20 user nova-compute[231753]:       <nova:ports>
Jul 29 13:47:20 user nova-compute[231753]:         <nova:port uuid="c940d941-2958-47b0-a186-d56be39e524f">
Jul 29 13:47:20 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.13" ipVersion="4"/>
Jul 29 13:47:20 user nova-compute[231753]:         </nova:port>
Jul 29 13:47:20 user nova-compute[231753]:       </nova:ports>
Jul 29 13:47:20 user nova-compute[231753]:     </nova:instance>
Jul 29 13:47:20 user nova-compute[231753]:   </metadata>
Jul 29 13:47:20 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:47:20 user nova-compute[231753]:     <system>
Jul 29 13:47:20 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:47:20 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:47:20 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:47:20 user nova-compute[231753]:       <entry name="serial">afd6468c-465d-49c9-b01c-93734f2a3e17</entry>
Jul 29 13:47:20 user nova-compute[231753]:       <entry name="uuid">afd6468c-465d-49c9-b01c-93734f2a3e17</entry>
Jul 29 13:47:20 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:47:20 user nova-compute[231753]:     </system>
Jul 29 13:47:20 user nova-compute[231753]:   </sysinfo>
Jul 29 13:47:20 user nova-compute[231753]:   <os>
Jul 29 13:47:20 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:47:20 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:47:20 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:47:20 user nova-compute[231753]:   </os>
Jul 29 13:47:20 user nova-compute[231753]:   <features>
Jul 29 13:47:20 user nova-compute[231753]:     <acpi/>
Jul 29 13:47:20 user nova-compute[231753]:     <apic/>
Jul 29 13:47:20 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:47:20 user nova-compute[231753]:   </features>
Jul 29 13:47:20 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:47:20 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:47:20 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:47:20 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:47:20 user nova-compute[231753]:   </clock>
Jul 29 13:47:20 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:47:20 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:47:20 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:47:20 user nova-compute[231753]:   </cpu>
Jul 29 13:47:20 user nova-compute[231753]:   <devices>
Jul 29 13:47:20 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:47:20 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:47:20 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/afd6468c-465d-49c9-b01c-93734f2a3e17/disk"/>
Jul 29 13:47:20 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:47:20 user nova-compute[231753]:     </disk>
Jul 29 13:47:20 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:47:20 user nova-compute[231753]:       <mac address="fa:16:3e:ad:34:94"/>
Jul 29 13:47:20 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:47:20 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:47:20 user nova-compute[231753]:       <target dev="tapc940d941-29"/>
Jul 29 13:47:20 user nova-compute[231753]:     </interface>
Jul 29 13:47:20 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:47:20 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/afd6468c-465d-49c9-b01c-93734f2a3e17/console.log" append="off"/>
Jul 29 13:47:20 user nova-compute[231753]:     </serial>
Jul 29 13:47:20 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:47:20 user nova-compute[231753]:     <video>
Jul 29 13:47:20 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:47:20 user nova-compute[231753]:     </video>
Jul 29 13:47:20 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:47:20 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:47:20 user nova-compute[231753]:     </rng>
Jul 29 13:47:20 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:47:20 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:47:20 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:47:20 user nova-compute[231753]:     </memballoon>
Jul 29 13:47:20 user nova-compute[231753]:   </devices>
Jul 29 13:47:20 user nova-compute[231753]: </domain>
Jul 29 13:47:20 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:47:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1481110770',display_name='tempest-TestServerVolumeAttachmentScenario-server-1481110770',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1481110770',id=33,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/kDOAHpIapUpqn7h3NHfDM6ynEXAJ8jYQGkyLGs0GIeOss8BfqqQrNLNTRb3sHEsNZLEeq8fwO0YmpqI8DKBs/11c50sMi6qFf4jbutrdpPLlbmNaDftzOO3CPShnsTQ==',key_name='tempest-keypair-1581638911',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='9f0063caba494df79d23ee7ab6cca952',ramdisk_id='',reservation_id='r-iiyrv4ei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachmentScenario-112712067',owner_user_name='tempest-TestServerVolumeAttachmentScenario-112712067-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:47:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='799028ef2fe14bebac752577fd148047',uuid=afd6468c-465d-49c9-b01c-93734f2a3e17,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c940d941-2958-47b0-a186-d56be39e524f", "address": "fa:16:3e:ad:34:94", "network": {"id": "e07105bf-cfaf-4a04-be90-27b9f5a1dce1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2002932258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f0063caba494df79d23ee7ab6cca952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc940d941-29", "ovs_interfaceid": "c940d941-2958-47b0-a186-d56be39e524f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Converting VIF {"id": "c940d941-2958-47b0-a186-d56be39e524f", "address": "fa:16:3e:ad:34:94", "network": {"id": "e07105bf-cfaf-4a04-be90-27b9f5a1dce1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2002932258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f0063caba494df79d23ee7ab6cca952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc940d941-29", "ovs_interfaceid": "c940d941-2958-47b0-a186-d56be39e524f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ad:34:94,bridge_name='br-int',has_traffic_filtering=True,id=c940d941-2958-47b0-a186-d56be39e524f,network=Network(e07105bf-cfaf-4a04-be90-27b9f5a1dce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc940d941-29') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG os_vif [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:34:94,bridge_name='br-int',has_traffic_filtering=True,id=c940d941-2958-47b0-a186-d56be39e524f,network=Network(e07105bf-cfaf-4a04-be90-27b9f5a1dce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc940d941-29') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc940d941-29, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapc940d941-29, col_values=(('external_ids', {'iface-id': 'c940d941-2958-47b0-a186-d56be39e524f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ad:34:94', 'vm-uuid': 'afd6468c-465d-49c9-b01c-93734f2a3e17'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:20 user nova-compute[231753]: INFO os_vif [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ad:34:94,bridge_name='br-int',has_traffic_filtering=True,id=c940d941-2958-47b0-a186-d56be39e524f,network=Network(e07105bf-cfaf-4a04-be90-27b9f5a1dce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc940d941-29')
Jul 29 13:47:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] No VIF found with MAC fa:16:3e:ad:34:94, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG nova.compute.manager [req-009e6d9f-5a5e-4ad8-9afc-16094df85e95 req-a48dce9c-aee2-4db7-bcc8-ee43c32a96b3 service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Received event network-vif-plugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-009e6d9f-5a5e-4ad8-9afc-16094df85e95 req-a48dce9c-aee2-4db7-bcc8-ee43c32a96b3 service nova] Acquiring lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-009e6d9f-5a5e-4ad8-9afc-16094df85e95 req-a48dce9c-aee2-4db7-bcc8-ee43c32a96b3 service nova] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-009e6d9f-5a5e-4ad8-9afc-16094df85e95 req-a48dce9c-aee2-4db7-bcc8-ee43c32a96b3 service nova] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG nova.compute.manager [req-009e6d9f-5a5e-4ad8-9afc-16094df85e95 req-a48dce9c-aee2-4db7-bcc8-ee43c32a96b3 service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] No waiting events found dispatching network-vif-plugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:47:20 user nova-compute[231753]: WARNING nova.compute.manager [req-009e6d9f-5a5e-4ad8-9afc-16094df85e95 req-a48dce9c-aee2-4db7-bcc8-ee43c32a96b3 service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Received unexpected event network-vif-plugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 for instance with vm_state stopped and task_state None.
Jul 29 13:47:20 user nova-compute[231753]: DEBUG nova.compute.manager [req-009e6d9f-5a5e-4ad8-9afc-16094df85e95 req-a48dce9c-aee2-4db7-bcc8-ee43c32a96b3 service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Received event network-vif-plugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-009e6d9f-5a5e-4ad8-9afc-16094df85e95 req-a48dce9c-aee2-4db7-bcc8-ee43c32a96b3 service nova] Acquiring lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-009e6d9f-5a5e-4ad8-9afc-16094df85e95 req-a48dce9c-aee2-4db7-bcc8-ee43c32a96b3 service nova] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-009e6d9f-5a5e-4ad8-9afc-16094df85e95 req-a48dce9c-aee2-4db7-bcc8-ee43c32a96b3 service nova] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG nova.compute.manager [req-009e6d9f-5a5e-4ad8-9afc-16094df85e95 req-a48dce9c-aee2-4db7-bcc8-ee43c32a96b3 service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] No waiting events found dispatching network-vif-plugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:47:20 user nova-compute[231753]: WARNING nova.compute.manager [req-009e6d9f-5a5e-4ad8-9afc-16094df85e95 req-a48dce9c-aee2-4db7-bcc8-ee43c32a96b3 service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Received unexpected event network-vif-plugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 for instance with vm_state stopped and task_state None.
Jul 29 13:47:20 user nova-compute[231753]: DEBUG nova.compute.manager [req-009e6d9f-5a5e-4ad8-9afc-16094df85e95 req-a48dce9c-aee2-4db7-bcc8-ee43c32a96b3 service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Received event network-vif-plugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-009e6d9f-5a5e-4ad8-9afc-16094df85e95 req-a48dce9c-aee2-4db7-bcc8-ee43c32a96b3 service nova] Acquiring lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-009e6d9f-5a5e-4ad8-9afc-16094df85e95 req-a48dce9c-aee2-4db7-bcc8-ee43c32a96b3 service nova] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-009e6d9f-5a5e-4ad8-9afc-16094df85e95 req-a48dce9c-aee2-4db7-bcc8-ee43c32a96b3 service nova] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG nova.compute.manager [req-009e6d9f-5a5e-4ad8-9afc-16094df85e95 req-a48dce9c-aee2-4db7-bcc8-ee43c32a96b3 service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] No waiting events found dispatching network-vif-plugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:47:20 user nova-compute[231753]: WARNING nova.compute.manager [req-009e6d9f-5a5e-4ad8-9afc-16094df85e95 req-a48dce9c-aee2-4db7-bcc8-ee43c32a96b3 service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Received unexpected event network-vif-plugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 for instance with vm_state stopped and task_state None.
Jul 29 13:47:20 user nova-compute[231753]: DEBUG nova.compute.manager [req-009e6d9f-5a5e-4ad8-9afc-16094df85e95 req-a48dce9c-aee2-4db7-bcc8-ee43c32a96b3 service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Received event network-vif-unplugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-009e6d9f-5a5e-4ad8-9afc-16094df85e95 req-a48dce9c-aee2-4db7-bcc8-ee43c32a96b3 service nova] Acquiring lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-009e6d9f-5a5e-4ad8-9afc-16094df85e95 req-a48dce9c-aee2-4db7-bcc8-ee43c32a96b3 service nova] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-009e6d9f-5a5e-4ad8-9afc-16094df85e95 req-a48dce9c-aee2-4db7-bcc8-ee43c32a96b3 service nova] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG nova.compute.manager [req-009e6d9f-5a5e-4ad8-9afc-16094df85e95 req-a48dce9c-aee2-4db7-bcc8-ee43c32a96b3 service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] No waiting events found dispatching network-vif-unplugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:47:20 user nova-compute[231753]: WARNING nova.compute.manager [req-009e6d9f-5a5e-4ad8-9afc-16094df85e95 req-a48dce9c-aee2-4db7-bcc8-ee43c32a96b3 service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Received unexpected event network-vif-unplugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 for instance with vm_state stopped and task_state None.
Jul 29 13:47:20 user nova-compute[231753]: DEBUG nova.compute.manager [req-009e6d9f-5a5e-4ad8-9afc-16094df85e95 req-a48dce9c-aee2-4db7-bcc8-ee43c32a96b3 service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Received event network-vif-plugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-009e6d9f-5a5e-4ad8-9afc-16094df85e95 req-a48dce9c-aee2-4db7-bcc8-ee43c32a96b3 service nova] Acquiring lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-009e6d9f-5a5e-4ad8-9afc-16094df85e95 req-a48dce9c-aee2-4db7-bcc8-ee43c32a96b3 service nova] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-009e6d9f-5a5e-4ad8-9afc-16094df85e95 req-a48dce9c-aee2-4db7-bcc8-ee43c32a96b3 service nova] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG nova.compute.manager [req-009e6d9f-5a5e-4ad8-9afc-16094df85e95 req-a48dce9c-aee2-4db7-bcc8-ee43c32a96b3 service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] No waiting events found dispatching network-vif-plugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:47:20 user nova-compute[231753]: WARNING nova.compute.manager [req-009e6d9f-5a5e-4ad8-9afc-16094df85e95 req-a48dce9c-aee2-4db7-bcc8-ee43c32a96b3 service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Received unexpected event network-vif-plugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 for instance with vm_state stopped and task_state None.
Jul 29 13:47:20 user nova-compute[231753]: DEBUG nova.compute.manager [req-78e537e1-6fef-443a-a604-6cf1029f7ee0 req-d0c74735-2b90-4c14-b472-d4ede5d58934 service nova] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Received event network-changed-c940d941-2958-47b0-a186-d56be39e524f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG nova.compute.manager [req-78e537e1-6fef-443a-a604-6cf1029f7ee0 req-d0c74735-2b90-4c14-b472-d4ede5d58934 service nova] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Refreshing instance network info cache due to event network-changed-c940d941-2958-47b0-a186-d56be39e524f. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-78e537e1-6fef-443a-a604-6cf1029f7ee0 req-d0c74735-2b90-4c14-b472-d4ede5d58934 service nova] Acquiring lock "refresh_cache-afd6468c-465d-49c9-b01c-93734f2a3e17" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-78e537e1-6fef-443a-a604-6cf1029f7ee0 req-d0c74735-2b90-4c14-b472-d4ede5d58934 service nova] Acquired lock "refresh_cache-afd6468c-465d-49c9-b01c-93734f2a3e17" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:47:20 user nova-compute[231753]: DEBUG nova.network.neutron [req-78e537e1-6fef-443a-a604-6cf1029f7ee0 req-d0c74735-2b90-4c14-b472-d4ede5d58934 service nova] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Refreshing network info cache for port c940d941-2958-47b0-a186-d56be39e524f {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:47:21 user nova-compute[231753]: DEBUG nova.compute.manager [req-cd0156d1-ad50-4735-a30e-082633bad64d req-611ea2aa-f655-455f-8959-ac5c52456b98 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Received event network-changed-351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:47:21 user nova-compute[231753]: DEBUG nova.compute.manager [req-cd0156d1-ad50-4735-a30e-082633bad64d req-611ea2aa-f655-455f-8959-ac5c52456b98 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Refreshing instance network info cache due to event network-changed-351f3080-98ce-4f1f-a53f-d4415327255f. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:47:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-cd0156d1-ad50-4735-a30e-082633bad64d req-611ea2aa-f655-455f-8959-ac5c52456b98 service nova] Acquiring lock "refresh_cache-aee15bbf-4d52-4611-9e75-6443c2384913" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:47:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-cd0156d1-ad50-4735-a30e-082633bad64d req-611ea2aa-f655-455f-8959-ac5c52456b98 service nova] Acquired lock "refresh_cache-aee15bbf-4d52-4611-9e75-6443c2384913" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:47:21 user nova-compute[231753]: DEBUG nova.network.neutron [req-cd0156d1-ad50-4735-a30e-082633bad64d req-611ea2aa-f655-455f-8959-ac5c52456b98 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Refreshing network info cache for port 351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:47:21 user nova-compute[231753]: INFO nova.compute.manager [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Rescuing
Jul 29 13:47:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "refresh_cache-b9751029-dfed-4342-ad92-9ae53d72fbc1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:47:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquired lock "refresh_cache-b9751029-dfed-4342-ad92-9ae53d72fbc1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:47:21 user nova-compute[231753]: DEBUG nova.network.neutron [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:47:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:21 user nova-compute[231753]: DEBUG nova.network.neutron [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Updating instance_info_cache with network_info: [{"id": "a25ce12c-a83d-4128-ac1e-62ca02ae31fd", "address": "fa:16:3e:8f:41:ff", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25ce12c-a8", "ovs_interfaceid": "a25ce12c-a83d-4128-ac1e-62ca02ae31fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:47:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Releasing lock "refresh_cache-b9751029-dfed-4342-ad92-9ae53d72fbc1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:47:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:21 user nova-compute[231753]: DEBUG nova.network.neutron [req-cd0156d1-ad50-4735-a30e-082633bad64d req-611ea2aa-f655-455f-8959-ac5c52456b98 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Updated VIF entry in instance network info cache for port 351f3080-98ce-4f1f-a53f-d4415327255f. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:47:21 user nova-compute[231753]: DEBUG nova.network.neutron [req-cd0156d1-ad50-4735-a30e-082633bad64d req-611ea2aa-f655-455f-8959-ac5c52456b98 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Updating instance_info_cache with network_info: [{"id": "351f3080-98ce-4f1f-a53f-d4415327255f", "address": "fa:16:3e:ae:ff:c5", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351f3080-98", "ovs_interfaceid": "351f3080-98ce-4f1f-a53f-d4415327255f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:47:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-cd0156d1-ad50-4735-a30e-082633bad64d req-611ea2aa-f655-455f-8959-ac5c52456b98 service nova] Releasing lock "refresh_cache-aee15bbf-4d52-4611-9e75-6443c2384913" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:47:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG nova.network.neutron [req-78e537e1-6fef-443a-a604-6cf1029f7ee0 req-d0c74735-2b90-4c14-b472-d4ede5d58934 service nova] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Updated VIF entry in instance network info cache for port c940d941-2958-47b0-a186-d56be39e524f. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG nova.network.neutron [req-78e537e1-6fef-443a-a604-6cf1029f7ee0 req-d0c74735-2b90-4c14-b472-d4ede5d58934 service nova] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Updating instance_info_cache with network_info: [{"id": "c940d941-2958-47b0-a186-d56be39e524f", "address": "fa:16:3e:ad:34:94", "network": {"id": "e07105bf-cfaf-4a04-be90-27b9f5a1dce1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2002932258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f0063caba494df79d23ee7ab6cca952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc940d941-29", "ovs_interfaceid": "c940d941-2958-47b0-a186-d56be39e524f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-78e537e1-6fef-443a-a604-6cf1029f7ee0 req-d0c74735-2b90-4c14-b472-d4ede5d58934 service nova] Releasing lock "refresh_cache-afd6468c-465d-49c9-b01c-93734f2a3e17" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG nova.compute.manager [req-8be0fe9c-5cd3-405c-bd3f-d57662295fbf req-774ec315-0df4-404e-a06f-1db0f34e641a service nova] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Received event network-vif-plugged-c940d941-2958-47b0-a186-d56be39e524f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8be0fe9c-5cd3-405c-bd3f-d57662295fbf req-774ec315-0df4-404e-a06f-1db0f34e641a service nova] Acquiring lock "afd6468c-465d-49c9-b01c-93734f2a3e17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8be0fe9c-5cd3-405c-bd3f-d57662295fbf req-774ec315-0df4-404e-a06f-1db0f34e641a service nova] Lock "afd6468c-465d-49c9-b01c-93734f2a3e17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8be0fe9c-5cd3-405c-bd3f-d57662295fbf req-774ec315-0df4-404e-a06f-1db0f34e641a service nova] Lock "afd6468c-465d-49c9-b01c-93734f2a3e17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG nova.compute.manager [req-8be0fe9c-5cd3-405c-bd3f-d57662295fbf req-774ec315-0df4-404e-a06f-1db0f34e641a service nova] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] No waiting events found dispatching network-vif-plugged-c940d941-2958-47b0-a186-d56be39e524f {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:47:22 user nova-compute[231753]: WARNING nova.compute.manager [req-8be0fe9c-5cd3-405c-bd3f-d57662295fbf req-774ec315-0df4-404e-a06f-1db0f34e641a service nova] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Received unexpected event network-vif-plugged-c940d941-2958-47b0-a186-d56be39e524f for instance with vm_state building and task_state spawning.
Jul 29 13:47:22 user nova-compute[231753]: DEBUG nova.compute.manager [req-8be0fe9c-5cd3-405c-bd3f-d57662295fbf req-774ec315-0df4-404e-a06f-1db0f34e641a service nova] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Received event network-vif-plugged-c940d941-2958-47b0-a186-d56be39e524f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8be0fe9c-5cd3-405c-bd3f-d57662295fbf req-774ec315-0df4-404e-a06f-1db0f34e641a service nova] Acquiring lock "afd6468c-465d-49c9-b01c-93734f2a3e17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8be0fe9c-5cd3-405c-bd3f-d57662295fbf req-774ec315-0df4-404e-a06f-1db0f34e641a service nova] Lock "afd6468c-465d-49c9-b01c-93734f2a3e17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8be0fe9c-5cd3-405c-bd3f-d57662295fbf req-774ec315-0df4-404e-a06f-1db0f34e641a service nova] Lock "afd6468c-465d-49c9-b01c-93734f2a3e17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG nova.compute.manager [req-8be0fe9c-5cd3-405c-bd3f-d57662295fbf req-774ec315-0df4-404e-a06f-1db0f34e641a service nova] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] No waiting events found dispatching network-vif-plugged-c940d941-2958-47b0-a186-d56be39e524f {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:47:22 user nova-compute[231753]: WARNING nova.compute.manager [req-8be0fe9c-5cd3-405c-bd3f-d57662295fbf req-774ec315-0df4-404e-a06f-1db0f34e641a service nova] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Received unexpected event network-vif-plugged-c940d941-2958-47b0-a186-d56be39e524f for instance with vm_state building and task_state spawning.
Jul 29 13:47:22 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Instance destroyed successfully.
Jul 29 13:47:22 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Attempting rescue
Jul 29 13:47:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=231753) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Instance directory exists: not creating {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 29 13:47:22 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Creating image(s)
Jul 29 13:47:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "/opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "/opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "/opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG nova.objects.instance [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lazy-loading 'trusted_certs' on Instance uuid b9751029-dfed-4342-ad92-9ae53d72fbc1 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.136s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk.rescue {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk.rescue" returned: 0 in 0.064s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG nova.objects.instance [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lazy-loading 'migration_context' on Instance uuid b9751029-dfed-4342-ad92-9ae53d72fbc1 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Start _get_guest_xml network_info=[{"id": "a25ce12c-a83d-4128-ac1e-62ca02ae31fd", "address": "fa:16:3e:8f:41:ff", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "vif_mac": "fa:16:3e:8f:41:ff"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25ce12c-a8", "ovs_interfaceid": "a25ce12c-a83d-4128-ac1e-62ca02ae31fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=None {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG nova.objects.instance [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lazy-loading 'resources' on Instance uuid b9751029-dfed-4342-ad92-9ae53d72fbc1 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG nova.objects.instance [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lazy-loading 'numa_topology' on Instance uuid b9751029-dfed-4342-ad92-9ae53d72fbc1 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:47:22 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:47:22 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:47:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:47:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:47:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:47:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:47:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:47:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:47:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:47:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:47:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:47:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:47:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:47:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:47:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:47:23 user nova-compute[231753]: DEBUG nova.objects.instance [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lazy-loading 'vcpu_model' on Instance uuid b9751029-dfed-4342-ad92-9ae53d72fbc1 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:47:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:45:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1353679928',display_name='tempest-ServerRescueNegativeTestJSON-server-1353679928',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1353679928',id=30,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyqkIk/mHZFeegD1t3ptlpbHx03xO8udA7bbSIZfXHD2TqVVmNTQHOJm3Ynbo+HPT9yM0akjPtiAtsZY0rh56MyFHx5g8gunx9fj5pIS+vVgJEMoD4LC8RWOTY18wNCtg==',key_name='tempest-keypair-1425594541',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:45:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7aa6e9e70b4a49cb994440e868203c99',ramdisk_id='',reservation_id='r-q5ty12vq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-700305152',owner_user_name='tempest-ServerRescueNegativeTestJSON-700305152-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:45:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01b32889cd7442399a8bceaff3d05662',uuid=b9751029-dfed-4342-ad92-9ae53d72fbc1,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a25ce12c-a83d-4128-ac1e-62ca02ae31fd", "address": "fa:16:3e:8f:41:ff", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "vif_mac": "fa:16:3e:8f:41:ff"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25ce12c-a8", "ovs_interfaceid": "a25ce12c-a83d-4128-ac1e-62ca02ae31fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:47:23 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Converting VIF {"id": "a25ce12c-a83d-4128-ac1e-62ca02ae31fd", "address": "fa:16:3e:8f:41:ff", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "vif_mac": "fa:16:3e:8f:41:ff"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25ce12c-a8", "ovs_interfaceid": "a25ce12c-a83d-4128-ac1e-62ca02ae31fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:47:23 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:41:ff,bridge_name='br-int',has_traffic_filtering=True,id=a25ce12c-a83d-4128-ac1e-62ca02ae31fd,network=Network(e1a83272-2e22-47dc-95ae-2ab9861c5925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa25ce12c-a8') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:47:23 user nova-compute[231753]: DEBUG nova.objects.instance [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lazy-loading 'pci_devices' on Instance uuid b9751029-dfed-4342-ad92-9ae53d72fbc1 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:47:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:47:23 user nova-compute[231753]:   <uuid>b9751029-dfed-4342-ad92-9ae53d72fbc1</uuid>
Jul 29 13:47:23 user nova-compute[231753]:   <name>instance-0000001e</name>
Jul 29 13:47:23 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:47:23 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:47:23 user nova-compute[231753]:   <metadata>
Jul 29 13:47:23 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:47:23 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:47:23 user nova-compute[231753]:       <nova:name>tempest-ServerRescueNegativeTestJSON-server-1353679928</nova:name>
Jul 29 13:47:23 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:47:22</nova:creationTime>
Jul 29 13:47:23 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:47:23 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:47:23 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:47:23 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:47:23 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:47:23 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:47:23 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:47:23 user nova-compute[231753]:       <nova:owner>
Jul 29 13:47:23 user nova-compute[231753]:         <nova:user uuid="01b32889cd7442399a8bceaff3d05662">tempest-ServerRescueNegativeTestJSON-700305152-project-member</nova:user>
Jul 29 13:47:23 user nova-compute[231753]:         <nova:project uuid="7aa6e9e70b4a49cb994440e868203c99">tempest-ServerRescueNegativeTestJSON-700305152</nova:project>
Jul 29 13:47:23 user nova-compute[231753]:       </nova:owner>
Jul 29 13:47:23 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:47:23 user nova-compute[231753]:       <nova:ports>
Jul 29 13:47:23 user nova-compute[231753]:         <nova:port uuid="a25ce12c-a83d-4128-ac1e-62ca02ae31fd">
Jul 29 13:47:23 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 29 13:47:23 user nova-compute[231753]:         </nova:port>
Jul 29 13:47:23 user nova-compute[231753]:       </nova:ports>
Jul 29 13:47:23 user nova-compute[231753]:     </nova:instance>
Jul 29 13:47:23 user nova-compute[231753]:   </metadata>
Jul 29 13:47:23 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:47:23 user nova-compute[231753]:     <system>
Jul 29 13:47:23 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:47:23 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:47:23 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:47:23 user nova-compute[231753]:       <entry name="serial">b9751029-dfed-4342-ad92-9ae53d72fbc1</entry>
Jul 29 13:47:23 user nova-compute[231753]:       <entry name="uuid">b9751029-dfed-4342-ad92-9ae53d72fbc1</entry>
Jul 29 13:47:23 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:47:23 user nova-compute[231753]:     </system>
Jul 29 13:47:23 user nova-compute[231753]:   </sysinfo>
Jul 29 13:47:23 user nova-compute[231753]:   <os>
Jul 29 13:47:23 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:47:23 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:47:23 user nova-compute[231753]:   </os>
Jul 29 13:47:23 user nova-compute[231753]:   <features>
Jul 29 13:47:23 user nova-compute[231753]:     <acpi/>
Jul 29 13:47:23 user nova-compute[231753]:     <apic/>
Jul 29 13:47:23 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:47:23 user nova-compute[231753]:   </features>
Jul 29 13:47:23 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:47:23 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:47:23 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:47:23 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:47:23 user nova-compute[231753]:   </clock>
Jul 29 13:47:23 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:47:23 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:47:23 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:47:23 user nova-compute[231753]:   </cpu>
Jul 29 13:47:23 user nova-compute[231753]:   <devices>
Jul 29 13:47:23 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:47:23 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:47:23 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk.rescue"/>
Jul 29 13:47:23 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:47:23 user nova-compute[231753]:     </disk>
Jul 29 13:47:23 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:47:23 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:47:23 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk"/>
Jul 29 13:47:23 user nova-compute[231753]:       <target dev="vdb" bus="virtio"/>
Jul 29 13:47:23 user nova-compute[231753]:     </disk>
Jul 29 13:47:23 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:47:23 user nova-compute[231753]:       <mac address="fa:16:3e:8f:41:ff"/>
Jul 29 13:47:23 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:47:23 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:47:23 user nova-compute[231753]:       <target dev="tapa25ce12c-a8"/>
Jul 29 13:47:23 user nova-compute[231753]:     </interface>
Jul 29 13:47:23 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:47:23 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/console.log" append="off"/>
Jul 29 13:47:23 user nova-compute[231753]:     </serial>
Jul 29 13:47:23 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:47:23 user nova-compute[231753]:     <video>
Jul 29 13:47:23 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:47:23 user nova-compute[231753]:     </video>
Jul 29 13:47:23 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:47:23 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:47:23 user nova-compute[231753]:     </rng>
Jul 29 13:47:23 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:47:23 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:47:23 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:47:23 user nova-compute[231753]:     </memballoon>
Jul 29 13:47:23 user nova-compute[231753]:   </devices>
Jul 29 13:47:23 user nova-compute[231753]: </domain>
Jul 29 13:47:23 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:47:23 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Instance destroyed successfully.
Jul 29 13:47:23 user nova-compute[231753]: DEBUG nova.compute.manager [req-a26d9f8c-e180-4804-b8e5-58d38472096a req-b2b34121-313a-4607-948f-c89595b203de service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Received event network-vif-unplugged-a25ce12c-a83d-4128-ac1e-62ca02ae31fd {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:47:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a26d9f8c-e180-4804-b8e5-58d38472096a req-b2b34121-313a-4607-948f-c89595b203de service nova] Acquiring lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a26d9f8c-e180-4804-b8e5-58d38472096a req-b2b34121-313a-4607-948f-c89595b203de service nova] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a26d9f8c-e180-4804-b8e5-58d38472096a req-b2b34121-313a-4607-948f-c89595b203de service nova] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:23 user nova-compute[231753]: DEBUG nova.compute.manager [req-a26d9f8c-e180-4804-b8e5-58d38472096a req-b2b34121-313a-4607-948f-c89595b203de service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] No waiting events found dispatching network-vif-unplugged-a25ce12c-a83d-4128-ac1e-62ca02ae31fd {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:47:23 user nova-compute[231753]: WARNING nova.compute.manager [req-a26d9f8c-e180-4804-b8e5-58d38472096a req-b2b34121-313a-4607-948f-c89595b203de service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Received unexpected event network-vif-unplugged-a25ce12c-a83d-4128-ac1e-62ca02ae31fd for instance with vm_state active and task_state rescuing.
Jul 29 13:47:23 user nova-compute[231753]: DEBUG nova.compute.manager [req-a26d9f8c-e180-4804-b8e5-58d38472096a req-b2b34121-313a-4607-948f-c89595b203de service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Received event network-vif-plugged-a25ce12c-a83d-4128-ac1e-62ca02ae31fd {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:47:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a26d9f8c-e180-4804-b8e5-58d38472096a req-b2b34121-313a-4607-948f-c89595b203de service nova] Acquiring lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a26d9f8c-e180-4804-b8e5-58d38472096a req-b2b34121-313a-4607-948f-c89595b203de service nova] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a26d9f8c-e180-4804-b8e5-58d38472096a req-b2b34121-313a-4607-948f-c89595b203de service nova] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:23 user nova-compute[231753]: DEBUG nova.compute.manager [req-a26d9f8c-e180-4804-b8e5-58d38472096a req-b2b34121-313a-4607-948f-c89595b203de service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] No waiting events found dispatching network-vif-plugged-a25ce12c-a83d-4128-ac1e-62ca02ae31fd {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:47:23 user nova-compute[231753]: WARNING nova.compute.manager [req-a26d9f8c-e180-4804-b8e5-58d38472096a req-b2b34121-313a-4607-948f-c89595b203de service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Received unexpected event network-vif-plugged-a25ce12c-a83d-4128-ac1e-62ca02ae31fd for instance with vm_state active and task_state rescuing.
Jul 29 13:47:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:47:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] No BDM found with device name vdb, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:47:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] No VIF found with MAC fa:16:3e:8f:41:ff, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:47:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:24 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638444.0210803, afd6468c-465d-49c9-b01c-93734f2a3e17 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:47:24 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] VM Resumed (Lifecycle Event)
Jul 29 13:47:24 user nova-compute[231753]: DEBUG nova.compute.manager [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:47:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:47:24 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Instance spawned successfully.
Jul 29 13:47:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:47:24 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:47:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:47:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:47:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:47:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:47:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:47:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:47:24 user nova-compute[231753]: DEBUG nova.compute.manager [req-c3e6e5da-674b-4d65-b288-b122c57607d7 req-5b6dd871-4977-4110-b357-aa2cf423a5ba service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Received event network-changed-351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:47:24 user nova-compute[231753]: DEBUG nova.compute.manager [req-c3e6e5da-674b-4d65-b288-b122c57607d7 req-5b6dd871-4977-4110-b357-aa2cf423a5ba service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Refreshing instance network info cache due to event network-changed-351f3080-98ce-4f1f-a53f-d4415327255f. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:47:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c3e6e5da-674b-4d65-b288-b122c57607d7 req-5b6dd871-4977-4110-b357-aa2cf423a5ba service nova] Acquiring lock "refresh_cache-aee15bbf-4d52-4611-9e75-6443c2384913" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:47:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c3e6e5da-674b-4d65-b288-b122c57607d7 req-5b6dd871-4977-4110-b357-aa2cf423a5ba service nova] Acquired lock "refresh_cache-aee15bbf-4d52-4611-9e75-6443c2384913" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:47:24 user nova-compute[231753]: DEBUG nova.network.neutron [req-c3e6e5da-674b-4d65-b288-b122c57607d7 req-5b6dd871-4977-4110-b357-aa2cf423a5ba service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Refreshing network info cache for port 351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:47:24 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:47:24 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:47:24 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638444.0228353, afd6468c-465d-49c9-b01c-93734f2a3e17 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:47:24 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] VM Started (Lifecycle Event)
Jul 29 13:47:24 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:47:24 user nova-compute[231753]: INFO nova.compute.manager [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Took 6.62 seconds to spawn the instance on the hypervisor.
Jul 29 13:47:24 user nova-compute[231753]: DEBUG nova.compute.manager [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:47:24 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:47:24 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:47:24 user nova-compute[231753]: INFO nova.compute.manager [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Took 7.84 seconds to build instance.
Jul 29 13:47:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-33d94931-0417-4c51-aa16-ee2bff03752d tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "afd6468c-465d-49c9-b01c-93734f2a3e17" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.960s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:24 user nova-compute[231753]: DEBUG nova.network.neutron [req-c3e6e5da-674b-4d65-b288-b122c57607d7 req-5b6dd871-4977-4110-b357-aa2cf423a5ba service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Updated VIF entry in instance network info cache for port 351f3080-98ce-4f1f-a53f-d4415327255f. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:47:24 user nova-compute[231753]: DEBUG nova.network.neutron [req-c3e6e5da-674b-4d65-b288-b122c57607d7 req-5b6dd871-4977-4110-b357-aa2cf423a5ba service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Updating instance_info_cache with network_info: [{"id": "351f3080-98ce-4f1f-a53f-d4415327255f", "address": "fa:16:3e:ae:ff:c5", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351f3080-98", "ovs_interfaceid": "351f3080-98ce-4f1f-a53f-d4415327255f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:47:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c3e6e5da-674b-4d65-b288-b122c57607d7 req-5b6dd871-4977-4110-b357-aa2cf423a5ba service nova] Releasing lock "refresh_cache-aee15bbf-4d52-4611-9e75-6443c2384913" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:47:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:25 user nova-compute[231753]: DEBUG nova.compute.manager [req-84d93d09-6783-4250-a957-42df458c21ec req-02c469cc-b670-42c7-bd7f-f53299b47faf service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Received event network-vif-plugged-a25ce12c-a83d-4128-ac1e-62ca02ae31fd {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:47:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-84d93d09-6783-4250-a957-42df458c21ec req-02c469cc-b670-42c7-bd7f-f53299b47faf service nova] Acquiring lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-84d93d09-6783-4250-a957-42df458c21ec req-02c469cc-b670-42c7-bd7f-f53299b47faf service nova] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-84d93d09-6783-4250-a957-42df458c21ec req-02c469cc-b670-42c7-bd7f-f53299b47faf service nova] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:25 user nova-compute[231753]: DEBUG nova.compute.manager [req-84d93d09-6783-4250-a957-42df458c21ec req-02c469cc-b670-42c7-bd7f-f53299b47faf service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] No waiting events found dispatching network-vif-plugged-a25ce12c-a83d-4128-ac1e-62ca02ae31fd {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:47:25 user nova-compute[231753]: WARNING nova.compute.manager [req-84d93d09-6783-4250-a957-42df458c21ec req-02c469cc-b670-42c7-bd7f-f53299b47faf service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Received unexpected event network-vif-plugged-a25ce12c-a83d-4128-ac1e-62ca02ae31fd for instance with vm_state active and task_state rescuing.
Jul 29 13:47:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Removed pending event for b9751029-dfed-4342-ad92-9ae53d72fbc1 due to event {{(pid=231753) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 29 13:47:26 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638446.8413997, b9751029-dfed-4342-ad92-9ae53d72fbc1 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:47:26 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] VM Resumed (Lifecycle Event)
Jul 29 13:47:26 user nova-compute[231753]: DEBUG nova.compute.manager [None req-16c681b3-748e-4171-8687-315ed97d4709 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:47:26 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:47:26 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:47:26 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 29 13:47:26 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638446.8432944, b9751029-dfed-4342-ad92-9ae53d72fbc1 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:47:26 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] VM Started (Lifecycle Event)
Jul 29 13:47:26 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:47:26 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:47:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-3ca62147-cdb5-48d8-80e2-33f8a1ff44e4 req-a44c6fb9-606f-4344-9172-7b62757b71d7 service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Received event network-vif-plugged-a25ce12c-a83d-4128-ac1e-62ca02ae31fd {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:47:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3ca62147-cdb5-48d8-80e2-33f8a1ff44e4 req-a44c6fb9-606f-4344-9172-7b62757b71d7 service nova] Acquiring lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3ca62147-cdb5-48d8-80e2-33f8a1ff44e4 req-a44c6fb9-606f-4344-9172-7b62757b71d7 service nova] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3ca62147-cdb5-48d8-80e2-33f8a1ff44e4 req-a44c6fb9-606f-4344-9172-7b62757b71d7 service nova] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-3ca62147-cdb5-48d8-80e2-33f8a1ff44e4 req-a44c6fb9-606f-4344-9172-7b62757b71d7 service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] No waiting events found dispatching network-vif-plugged-a25ce12c-a83d-4128-ac1e-62ca02ae31fd {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:47:27 user nova-compute[231753]: WARNING nova.compute.manager [req-3ca62147-cdb5-48d8-80e2-33f8a1ff44e4 req-a44c6fb9-606f-4344-9172-7b62757b71d7 service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Received unexpected event network-vif-plugged-a25ce12c-a83d-4128-ac1e-62ca02ae31fd for instance with vm_state rescued and task_state None.
Jul 29 13:47:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-3ca62147-cdb5-48d8-80e2-33f8a1ff44e4 req-a44c6fb9-606f-4344-9172-7b62757b71d7 service nova] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Received event network-changed-89495dd5-c711-4ec9-b2f4-bb166a0a4a7b {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:47:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-3ca62147-cdb5-48d8-80e2-33f8a1ff44e4 req-a44c6fb9-606f-4344-9172-7b62757b71d7 service nova] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Refreshing instance network info cache due to event network-changed-89495dd5-c711-4ec9-b2f4-bb166a0a4a7b. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:47:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3ca62147-cdb5-48d8-80e2-33f8a1ff44e4 req-a44c6fb9-606f-4344-9172-7b62757b71d7 service nova] Acquiring lock "refresh_cache-8a61a780-6403-4aed-9c4a-2af01965f5d2" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:47:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3ca62147-cdb5-48d8-80e2-33f8a1ff44e4 req-a44c6fb9-606f-4344-9172-7b62757b71d7 service nova] Acquired lock "refresh_cache-8a61a780-6403-4aed-9c4a-2af01965f5d2" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:47:27 user nova-compute[231753]: DEBUG nova.network.neutron [req-3ca62147-cdb5-48d8-80e2-33f8a1ff44e4 req-a44c6fb9-606f-4344-9172-7b62757b71d7 service nova] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Refreshing network info cache for port 89495dd5-c711-4ec9-b2f4-bb166a0a4a7b {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:47:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:28 user nova-compute[231753]: DEBUG nova.network.neutron [req-3ca62147-cdb5-48d8-80e2-33f8a1ff44e4 req-a44c6fb9-606f-4344-9172-7b62757b71d7 service nova] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Updated VIF entry in instance network info cache for port 89495dd5-c711-4ec9-b2f4-bb166a0a4a7b. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:47:28 user nova-compute[231753]: DEBUG nova.network.neutron [req-3ca62147-cdb5-48d8-80e2-33f8a1ff44e4 req-a44c6fb9-606f-4344-9172-7b62757b71d7 service nova] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Updating instance_info_cache with network_info: [{"id": "89495dd5-c711-4ec9-b2f4-bb166a0a4a7b", "address": "fa:16:3e:cb:ee:63", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89495dd5-c7", "ovs_interfaceid": "89495dd5-c711-4ec9-b2f4-bb166a0a4a7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:47:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3ca62147-cdb5-48d8-80e2-33f8a1ff44e4 req-a44c6fb9-606f-4344-9172-7b62757b71d7 service nova] Releasing lock "refresh_cache-8a61a780-6403-4aed-9c4a-2af01965f5d2" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:47:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:30 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "8a61a780-6403-4aed-9c4a-2af01965f5d2" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "8a61a780-6403-4aed-9c4a-2af01965f5d2" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:30 user nova-compute[231753]: DEBUG nova.objects.instance [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lazy-loading 'flavor' on Instance uuid 8a61a780-6403-4aed-9c4a-2af01965f5d2 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:47:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "8a61a780-6403-4aed-9c4a-2af01965f5d2" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.093s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "8a61a780-6403-4aed-9c4a-2af01965f5d2" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "8a61a780-6403-4aed-9c4a-2af01965f5d2" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:30 user nova-compute[231753]: INFO nova.compute.manager [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Attaching volume 4ba55d8c-783c-44a6-8094-84a4593d409a to /dev/vdb
Jul 29 13:47:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "aee15bbf-4d52-4611-9e75-6443c2384913" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "aee15bbf-4d52-4611-9e75-6443c2384913" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:30 user nova-compute[231753]: INFO nova.compute.manager [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Rebooting instance
Jul 29 13:47:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "refresh_cache-aee15bbf-4d52-4611-9e75-6443c2384913" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:47:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquired lock "refresh_cache-aee15bbf-4d52-4611-9e75-6443c2384913" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:47:30 user nova-compute[231753]: DEBUG nova.network.neutron [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:47:30 user nova-compute[231753]: DEBUG os_brick.utils [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:47:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:30 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd71fc31-ff78-4392-93fe-bec081b0f875]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:30 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f104bea-f470-4833-86b1-04ebbf015cd9]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:30 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7cd465-9675-432f-8fd8-d3fd903c1cd9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:30 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cda3c51-fdad-47c1-9413-ac1049ee39ab]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:47:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:47:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:47:30 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:47:30 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[476d5da1-787a-480d-84d4-d82ad61e244a]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:47:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:47:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:47:30 user nova-compute[231753]: DEBUG os_brick.utils [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] <== get_connector_properties: return (175ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:47:30 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Updating existing volume attachment record: 776e50e6-229d-4b73-a62a-614b05badb21 {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:47:31 user nova-compute[231753]: DEBUG nova.network.neutron [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Updating instance_info_cache with network_info: [{"id": "351f3080-98ce-4f1f-a53f-d4415327255f", "address": "fa:16:3e:ae:ff:c5", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351f3080-98", "ovs_interfaceid": "351f3080-98ce-4f1f-a53f-d4415327255f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:47:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Releasing lock "refresh_cache-aee15bbf-4d52-4611-9e75-6443c2384913" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:47:31 user nova-compute[231753]: DEBUG nova.compute.manager [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:47:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:31 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690638436.707203, 576f5002-4e4d-4236-8b0f-9b8788246de2 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:47:31 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] VM Stopped (Lifecycle Event)
Jul 29 13:47:31 user nova-compute[231753]: DEBUG nova.compute.manager [None req-8f0ae858-6e64-4f68-8598-0e6b32edd5eb None None] [instance: 576f5002-4e4d-4236-8b0f-9b8788246de2] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:47:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:31 user nova-compute[231753]: DEBUG nova.compute.manager [req-94e463f1-6585-4590-8d12-c1245ff8c4b9 req-ab070cf3-a6c3-4219-8b9a-fd853b1d0421 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Received event network-vif-unplugged-351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:47:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-94e463f1-6585-4590-8d12-c1245ff8c4b9 req-ab070cf3-a6c3-4219-8b9a-fd853b1d0421 service nova] Acquiring lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-94e463f1-6585-4590-8d12-c1245ff8c4b9 req-ab070cf3-a6c3-4219-8b9a-fd853b1d0421 service nova] Lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-94e463f1-6585-4590-8d12-c1245ff8c4b9 req-ab070cf3-a6c3-4219-8b9a-fd853b1d0421 service nova] Lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:31 user nova-compute[231753]: DEBUG nova.compute.manager [req-94e463f1-6585-4590-8d12-c1245ff8c4b9 req-ab070cf3-a6c3-4219-8b9a-fd853b1d0421 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] No waiting events found dispatching network-vif-unplugged-351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:47:31 user nova-compute[231753]: WARNING nova.compute.manager [req-94e463f1-6585-4590-8d12-c1245ff8c4b9 req-ab070cf3-a6c3-4219-8b9a-fd853b1d0421 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Received unexpected event network-vif-unplugged-351f3080-98ce-4f1f-a53f-d4415327255f for instance with vm_state active and task_state reboot_started_hard.
Jul 29 13:47:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:32 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Instance destroyed successfully.
Jul 29 13:47:32 user nova-compute[231753]: DEBUG nova.objects.instance [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lazy-loading 'resources' on Instance uuid aee15bbf-4d52-4611-9e75-6443c2384913 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:45:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1284255744',display_name='tempest-TestMinimumBasicScenario-server-1284255744',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1284255744',id=29,image_ref='78adb53f-be8b-4033-a431-1a462bd1ead9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKr8ekMLRc3v6qbOd8eRngk+ys5vegV1XgCj9XLuALI1iIMjOlfgT1s5XKib17FXpypyjWP6kJK3XT768WDJC2k5DNlfH8LLPqFoCUrFbdeUyhXm4lePDDUp4AQyBXC4Dg==',key_name='tempest-TestMinimumBasicScenario-949027565',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:45:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a0d7f4b7f8641f9890a4ac009942190',ramdisk_id='',reservation_id='r-f9wpz5wp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='78adb53f-be8b-4033-a431-1a462bd1ead9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-187684118',owner_user_name='tempest-TestMinimumBasicScenario-187684118-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:47:32Z,user_data=None,user_id='68002afa2ff64150afe91714800481ae',uuid=aee15bbf-4d52-4611-9e75-6443c2384913,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "351f3080-98ce-4f1f-a53f-d4415327255f", "address": "fa:16:3e:ae:ff:c5", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351f3080-98", "ovs_interfaceid": "351f3080-98ce-4f1f-a53f-d4415327255f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Converting VIF {"id": "351f3080-98ce-4f1f-a53f-d4415327255f", "address": "fa:16:3e:ae:ff:c5", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351f3080-98", "ovs_interfaceid": "351f3080-98ce-4f1f-a53f-d4415327255f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:ff:c5,bridge_name='br-int',has_traffic_filtering=True,id=351f3080-98ce-4f1f-a53f-d4415327255f,network=Network(70a92bb8-13dd-4b75-9986-5c136de68b16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap351f3080-98') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG os_vif [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:ff:c5,bridge_name='br-int',has_traffic_filtering=True,id=351f3080-98ce-4f1f-a53f-d4415327255f,network=Network(70a92bb8-13dd-4b75-9986-5c136de68b16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap351f3080-98') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap351f3080-98, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:32 user nova-compute[231753]: INFO os_vif [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:ff:c5,bridge_name='br-int',has_traffic_filtering=True,id=351f3080-98ce-4f1f-a53f-d4415327255f,network=Network(70a92bb8-13dd-4b75-9986-5c136de68b16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap351f3080-98')
Jul 29 13:47:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZBkfiDa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:47:32 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:47:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.030s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f50bbe-fffe-4784-bb71-d8fb4e13fd7b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:47:32 user nova-compute[231753]: No targets found.
Jul 29 13:47:32 user nova-compute[231753]: iSNS:
Jul 29 13:47:32 user nova-compute[231753]: No targets found.
Jul 29 13:47:32 user nova-compute[231753]: STATIC:
Jul 29 13:47:32 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea
Jul 29 13:47:32 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:47:32 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:47:32 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4
Jul 29 13:47:32 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:47:32 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:47:32 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43
Jul 29 13:47:32 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:47:32 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:47:32 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef
Jul 29 13:47:32 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:47:32 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:47:32 user nova-compute[231753]: FIRMWARE:
Jul 29 13:47:32 user nova-compute[231753]: No targets found.
Jul 29 13:47:32 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:47:32 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:47:32 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0d514b0-c0c6-4f71-b1de-1e5b25621ca4]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.040s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5985cfbe-028c-4eda-9908-532949517a7d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)\ntcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:47:32 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:47:32 user nova-compute[231753]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)
Jul 29 13:47:32 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:47:32 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:47:32 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:47:32 user nova-compute[231753]: tcp: [34] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)
Jul 29 13:47:32 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:47:32 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c80324550>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4'): ({'sdb'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Removing single pathed devices sdb {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a125731-6da4-4c9b-ace1-145a155c4599]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[72075c27-3871-42ed-bb84-a5606e9a0501]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Flushing IO for device /dev/sdb {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca401d9e-6ca8-41bc-867c-5572da83bdfc]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfed20d1-c73a-4666-8e4e-66a1e3b968a9]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] SCSI volumes sdb have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:47:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[13b512c1-9a02-4775-b1b4-34752b8ad730]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.076s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca33f3b4-f156-4956-89dc-85d2aa9c5629]: (4, ('Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4, portal: 172.16.0.220,3260]\nLogout of [sid: 34, target: iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4, portal: 172.16.0.220,3260]
Jul 29 13:47:33 user nova-compute[231753]: Logout of [sid: 34, target: iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4, portal: 172.16.0.220,3260] successful.
Jul 29 13:47:33 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[35514c96-9982-4b79-9cda-13f19d831dc0]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.422s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] <== disconnect_volume: return (424ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Start _get_guest_xml network_info=[{"id": "351f3080-98ce-4f1f-a53f-d4415327255f", "address": "fa:16:3e:ae:ff:c5", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351f3080-98", "ovs_interfaceid": "351f3080-98ce-4f1f-a53f-d4415327255f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=78adb53f-be8b-4033-a431-1a462bd1ead9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '78adb53f-be8b-4033-a431-1a462bd1ead9'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZBkfiDa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'aee15bbf-4d52-4611-9e75-6443c2384913', 'attached_at': '', 'detached_at': '', 'volume_id': 'f522e219-aad8-4eb2-b6e6-5cceb04ba4c4', 'serial': 'f522e219-aad8-4eb2-b6e6-5cceb04ba4c4'}, 'guest_format': None, 'mount_device': '/dev/vdb', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': 'cdd48dc6-bd93-4949-be31-e88b637e4a3d', 'boot_index': None, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:47:33 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:47:33 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:47:33 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=78adb53f-be8b-4033-a431-1a462bd1ead9,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG nova.objects.instance [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lazy-loading 'vcpu_model' on Instance uuid aee15bbf-4d52-4611-9e75-6443c2384913 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZBkfiDa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:47:33 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:47:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:47:33 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:47:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:47:33 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0bf66f-56b5-420b-8889-30e026d0b17a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:47:33 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.037s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b47bba61-caf6-4ca5-a297-eba1a05b4c9b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4] added
Jul 29 13:47:33 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.035s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e980b75e-57aa-4db9-b484-d67490bf7671]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.037s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d462bf18-57aa-40d9-af56-3b1abc96eebb]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tZBkfiDa {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tZBkfiDa" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e113179-301d-48c3-ad9a-193e80d18d8c]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tZBkfiDa'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[db165876-34c2-4dcb-a4f2-cf22623dc9b4]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.033s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a537e5f4-ba51-4f5f-94a1-2bdc0d358806]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:47:33 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:47:33 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:47:33 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:47:33 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:47:33 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:47:33 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --login" returned: 0 in 0.093s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e19732dc-3505-4440-8ee1-e8db37a613a2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4, portal: 172.16.0.220,3260]
Jul 29 13:47:33 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4, portal: 172.16.0.220,3260] successful.
Jul 29 13:47:33 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cc27a92-e530-4c80-8cf8-74d65797a88b]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdd5a3bf-2318-41cb-a2bf-b4752ae546f9]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:47:33 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:47:33 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:47:33 user nova-compute[231753]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)
Jul 29 13:47:33 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:47:33 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:47:33 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:47:33 user nova-compute[231753]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)
Jul 29 13:47:33 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.438s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] HCTL ('33', '-', '-', 0) found on session 36 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.034s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[889ea6a4-43b3-4a6c-973b-854e2728cd29]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Searching for a device in session 36 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZBkfiDa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690638438.7677493, 8dd26572-fe6a-40fd-8c58-6af862b340c4 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:47:33 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] VM Stopped (Lifecycle Event)
Jul 29 13:47:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG nova.compute.manager [None req-256ea792-34aa-4c89-9131-d575ca80e2bb None None] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:47:33 user nova-compute[231753]: DEBUG nova.compute.manager [None req-256ea792-34aa-4c89-9131-d575ca80e2bb None None] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: stopped, current task_state: None, current DB power_state: 4, VM power_state: 4 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:47:34 user nova-compute[231753]: DEBUG nova.compute.manager [req-39f6b147-f73a-47ef-abef-856d8339fc31 req-2a85fddc-3cd6-4b5e-ab7f-a02558a96273 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Received event network-vif-plugged-351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:47:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-39f6b147-f73a-47ef-abef-856d8339fc31 req-2a85fddc-3cd6-4b5e-ab7f-a02558a96273 service nova] Acquiring lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-39f6b147-f73a-47ef-abef-856d8339fc31 req-2a85fddc-3cd6-4b5e-ab7f-a02558a96273 service nova] Lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-39f6b147-f73a-47ef-abef-856d8339fc31 req-2a85fddc-3cd6-4b5e-ab7f-a02558a96273 service nova] Lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:34 user nova-compute[231753]: DEBUG nova.compute.manager [req-39f6b147-f73a-47ef-abef-856d8339fc31 req-2a85fddc-3cd6-4b5e-ab7f-a02558a96273 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] No waiting events found dispatching network-vif-plugged-351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:47:34 user nova-compute[231753]: WARNING nova.compute.manager [req-39f6b147-f73a-47ef-abef-856d8339fc31 req-2a85fddc-3cd6-4b5e-ab7f-a02558a96273 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Received unexpected event network-vif-plugged-351f3080-98ce-4f1f-a53f-d4415327255f for instance with vm_state active and task_state reboot_started_hard.
Jul 29 13:47:34 user nova-compute[231753]: DEBUG nova.compute.manager [req-39f6b147-f73a-47ef-abef-856d8339fc31 req-2a85fddc-3cd6-4b5e-ab7f-a02558a96273 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Received event network-vif-plugged-351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:47:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-39f6b147-f73a-47ef-abef-856d8339fc31 req-2a85fddc-3cd6-4b5e-ab7f-a02558a96273 service nova] Acquiring lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-39f6b147-f73a-47ef-abef-856d8339fc31 req-2a85fddc-3cd6-4b5e-ab7f-a02558a96273 service nova] Lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-39f6b147-f73a-47ef-abef-856d8339fc31 req-2a85fddc-3cd6-4b5e-ab7f-a02558a96273 service nova] Lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:34 user nova-compute[231753]: DEBUG nova.compute.manager [req-39f6b147-f73a-47ef-abef-856d8339fc31 req-2a85fddc-3cd6-4b5e-ab7f-a02558a96273 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] No waiting events found dispatching network-vif-plugged-351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:47:34 user nova-compute[231753]: WARNING nova.compute.manager [req-39f6b147-f73a-47ef-abef-856d8339fc31 req-2a85fddc-3cd6-4b5e-ab7f-a02558a96273 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Received unexpected event network-vif-plugged-351f3080-98ce-4f1f-a53f-d4415327255f for instance with vm_state active and task_state reboot_started_hard.
Jul 29 13:47:34 user nova-compute[231753]: DEBUG nova.compute.manager [req-39f6b147-f73a-47ef-abef-856d8339fc31 req-2a85fddc-3cd6-4b5e-ab7f-a02558a96273 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Received event network-vif-plugged-351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:47:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-39f6b147-f73a-47ef-abef-856d8339fc31 req-2a85fddc-3cd6-4b5e-ab7f-a02558a96273 service nova] Acquiring lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-39f6b147-f73a-47ef-abef-856d8339fc31 req-2a85fddc-3cd6-4b5e-ab7f-a02558a96273 service nova] Lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-39f6b147-f73a-47ef-abef-856d8339fc31 req-2a85fddc-3cd6-4b5e-ab7f-a02558a96273 service nova] Lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:34 user nova-compute[231753]: DEBUG nova.compute.manager [req-39f6b147-f73a-47ef-abef-856d8339fc31 req-2a85fddc-3cd6-4b5e-ab7f-a02558a96273 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] No waiting events found dispatching network-vif-plugged-351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:47:34 user nova-compute[231753]: WARNING nova.compute.manager [req-39f6b147-f73a-47ef-abef-856d8339fc31 req-2a85fddc-3cd6-4b5e-ab7f-a02558a96273 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Received unexpected event network-vif-plugged-351f3080-98ce-4f1f-a53f-d4415327255f for instance with vm_state active and task_state reboot_started_hard.
Jul 29 13:47:34 user nova-compute[231753]: DEBUG nova.compute.manager [req-39f6b147-f73a-47ef-abef-856d8339fc31 req-2a85fddc-3cd6-4b5e-ab7f-a02558a96273 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Received event network-vif-unplugged-351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:47:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-39f6b147-f73a-47ef-abef-856d8339fc31 req-2a85fddc-3cd6-4b5e-ab7f-a02558a96273 service nova] Acquiring lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-39f6b147-f73a-47ef-abef-856d8339fc31 req-2a85fddc-3cd6-4b5e-ab7f-a02558a96273 service nova] Lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-39f6b147-f73a-47ef-abef-856d8339fc31 req-2a85fddc-3cd6-4b5e-ab7f-a02558a96273 service nova] Lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:34 user nova-compute[231753]: DEBUG nova.compute.manager [req-39f6b147-f73a-47ef-abef-856d8339fc31 req-2a85fddc-3cd6-4b5e-ab7f-a02558a96273 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] No waiting events found dispatching network-vif-unplugged-351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:47:34 user nova-compute[231753]: WARNING nova.compute.manager [req-39f6b147-f73a-47ef-abef-856d8339fc31 req-2a85fddc-3cd6-4b5e-ab7f-a02558a96273 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Received unexpected event network-vif-unplugged-351f3080-98ce-4f1f-a53f-d4415327255f for instance with vm_state active and task_state reboot_started_hard.
Jul 29 13:47:34 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.504s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:47:34 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] <== connect_volume: return (1506ms) {'type': 'block', 'scsi_wwn': '26135313033636133', 'path': '/dev/sdb'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:47:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26135313033636133', 'path': '/dev/sdb'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:47:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:45:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1284255744',display_name='tempest-TestMinimumBasicScenario-server-1284255744',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1284255744',id=29,image_ref='78adb53f-be8b-4033-a431-1a462bd1ead9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKr8ekMLRc3v6qbOd8eRngk+ys5vegV1XgCj9XLuALI1iIMjOlfgT1s5XKib17FXpypyjWP6kJK3XT768WDJC2k5DNlfH8LLPqFoCUrFbdeUyhXm4lePDDUp4AQyBXC4Dg==',key_name='tempest-TestMinimumBasicScenario-949027565',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:45:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a0d7f4b7f8641f9890a4ac009942190',ramdisk_id='',reservation_id='r-f9wpz5wp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='78adb53f-be8b-4033-a431-1a462bd1ead9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-187684118',owner_user_name='tempest-TestMinimumBasicScenario-187684118-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:47:32Z,user_data=None,user_id='68002afa2ff64150afe91714800481ae',uuid=aee15bbf-4d52-4611-9e75-6443c2384913,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "351f3080-98ce-4f1f-a53f-d4415327255f", "address": "fa:16:3e:ae:ff:c5", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351f3080-98", "ovs_interfaceid": "351f3080-98ce-4f1f-a53f-d4415327255f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:47:34 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Converting VIF {"id": "351f3080-98ce-4f1f-a53f-d4415327255f", "address": "fa:16:3e:ae:ff:c5", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351f3080-98", "ovs_interfaceid": "351f3080-98ce-4f1f-a53f-d4415327255f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:47:34 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:ff:c5,bridge_name='br-int',has_traffic_filtering=True,id=351f3080-98ce-4f1f-a53f-d4415327255f,network=Network(70a92bb8-13dd-4b75-9986-5c136de68b16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap351f3080-98') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:47:34 user nova-compute[231753]: DEBUG nova.objects.instance [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lazy-loading 'pci_devices' on Instance uuid aee15bbf-4d52-4611-9e75-6443c2384913 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:47:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:47:34 user nova-compute[231753]:   <uuid>aee15bbf-4d52-4611-9e75-6443c2384913</uuid>
Jul 29 13:47:34 user nova-compute[231753]:   <name>instance-0000001d</name>
Jul 29 13:47:34 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:47:34 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:47:34 user nova-compute[231753]:   <metadata>
Jul 29 13:47:34 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:47:34 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:47:34 user nova-compute[231753]:       <nova:name>tempest-TestMinimumBasicScenario-server-1284255744</nova:name>
Jul 29 13:47:34 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:47:33</nova:creationTime>
Jul 29 13:47:34 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:47:34 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:47:34 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:47:34 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:47:34 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:47:34 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:47:34 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:47:34 user nova-compute[231753]:       <nova:owner>
Jul 29 13:47:34 user nova-compute[231753]:         <nova:user uuid="68002afa2ff64150afe91714800481ae">tempest-TestMinimumBasicScenario-187684118-project-member</nova:user>
Jul 29 13:47:34 user nova-compute[231753]:         <nova:project uuid="3a0d7f4b7f8641f9890a4ac009942190">tempest-TestMinimumBasicScenario-187684118</nova:project>
Jul 29 13:47:34 user nova-compute[231753]:       </nova:owner>
Jul 29 13:47:34 user nova-compute[231753]:       <nova:root type="image" uuid="78adb53f-be8b-4033-a431-1a462bd1ead9"/>
Jul 29 13:47:34 user nova-compute[231753]:       <nova:ports>
Jul 29 13:47:34 user nova-compute[231753]:         <nova:port uuid="351f3080-98ce-4f1f-a53f-d4415327255f">
Jul 29 13:47:34 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 29 13:47:34 user nova-compute[231753]:         </nova:port>
Jul 29 13:47:34 user nova-compute[231753]:       </nova:ports>
Jul 29 13:47:34 user nova-compute[231753]:     </nova:instance>
Jul 29 13:47:34 user nova-compute[231753]:   </metadata>
Jul 29 13:47:34 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:47:34 user nova-compute[231753]:     <system>
Jul 29 13:47:34 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:47:34 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:47:34 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:47:34 user nova-compute[231753]:       <entry name="serial">aee15bbf-4d52-4611-9e75-6443c2384913</entry>
Jul 29 13:47:34 user nova-compute[231753]:       <entry name="uuid">aee15bbf-4d52-4611-9e75-6443c2384913</entry>
Jul 29 13:47:34 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:47:34 user nova-compute[231753]:     </system>
Jul 29 13:47:34 user nova-compute[231753]:   </sysinfo>
Jul 29 13:47:34 user nova-compute[231753]:   <os>
Jul 29 13:47:34 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:47:34 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:47:34 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:47:34 user nova-compute[231753]:   </os>
Jul 29 13:47:34 user nova-compute[231753]:   <features>
Jul 29 13:47:34 user nova-compute[231753]:     <acpi/>
Jul 29 13:47:34 user nova-compute[231753]:     <apic/>
Jul 29 13:47:34 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:47:34 user nova-compute[231753]:   </features>
Jul 29 13:47:34 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:47:34 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:47:34 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:47:34 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:47:34 user nova-compute[231753]:   </clock>
Jul 29 13:47:34 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:47:34 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:47:34 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:47:34 user nova-compute[231753]:   </cpu>
Jul 29 13:47:34 user nova-compute[231753]:   <devices>
Jul 29 13:47:34 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:47:34 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:47:34 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk"/>
Jul 29 13:47:34 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:47:34 user nova-compute[231753]:     </disk>
Jul 29 13:47:34 user nova-compute[231753]:     <disk type="block" device="disk">
Jul 29 13:47:34 user nova-compute[231753]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:47:34 user nova-compute[231753]:       <source dev="/dev/sdb"/>
Jul 29 13:47:34 user nova-compute[231753]:       <target dev="vdb" bus="virtio"/>
Jul 29 13:47:34 user nova-compute[231753]:       <serial>f522e219-aad8-4eb2-b6e6-5cceb04ba4c4</serial>
Jul 29 13:47:34 user nova-compute[231753]:     </disk>
Jul 29 13:47:34 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:47:34 user nova-compute[231753]:       <mac address="fa:16:3e:ae:ff:c5"/>
Jul 29 13:47:34 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:47:34 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:47:34 user nova-compute[231753]:       <target dev="tap351f3080-98"/>
Jul 29 13:47:34 user nova-compute[231753]:     </interface>
Jul 29 13:47:34 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:47:34 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/console.log" append="off"/>
Jul 29 13:47:34 user nova-compute[231753]:     </serial>
Jul 29 13:47:34 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:47:34 user nova-compute[231753]:     <video>
Jul 29 13:47:34 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:47:34 user nova-compute[231753]:     </video>
Jul 29 13:47:34 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:47:34 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:47:34 user nova-compute[231753]:     </rng>
Jul 29 13:47:34 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:47:34 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:47:34 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:47:34 user nova-compute[231753]:     </memballoon>
Jul 29 13:47:34 user nova-compute[231753]:   </devices>
Jul 29 13:47:34 user nova-compute[231753]: </domain>
Jul 29 13:47:34 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:47:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:35 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:47:35 user nova-compute[231753]: DEBUG nova.objects.instance [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lazy-loading 'trusted_certs' on Instance uuid aee15bbf-4d52-4611-9e75-6443c2384913 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:47:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d6ff72a81b12e9d9d85cd1600c2c98947b6d776 --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/1d6ff72a81b12e9d9d85cd1600c2c98947b6d776 --force-share --output=json" returned: 0 in 0.148s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:35 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Checking if we can resize image /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:47:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:35 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Cannot resize image /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:47:35 user nova-compute[231753]: DEBUG nova.objects.instance [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lazy-loading 'migration_context' on Instance uuid aee15bbf-4d52-4611-9e75-6443c2384913 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:47:35 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:45:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1284255744',display_name='tempest-TestMinimumBasicScenario-server-1284255744',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1284255744',id=29,image_ref='78adb53f-be8b-4033-a431-1a462bd1ead9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKr8ekMLRc3v6qbOd8eRngk+ys5vegV1XgCj9XLuALI1iIMjOlfgT1s5XKib17FXpypyjWP6kJK3XT768WDJC2k5DNlfH8LLPqFoCUrFbdeUyhXm4lePDDUp4AQyBXC4Dg==',key_name='tempest-TestMinimumBasicScenario-949027565',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:45:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=1,progress=0,project_id='3a0d7f4b7f8641f9890a4ac009942190',ramdisk_id='',reservation_id='r-f9wpz5wp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='78adb53f-be8b-4033-a431-1a462bd1ead9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-187684118',owner_user_name='tempest-TestMinimumBasicScenario-187684118-project-member'},tags=<?>,task_state='reboot_started_hard',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:47:32Z,user_data=None,user_id='68002afa2ff64150afe91714800481ae',uuid=aee15bbf-4d52-4611-9e75-6443c2384913,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "351f3080-98ce-4f1f-a53f-d4415327255f", "address": "fa:16:3e:ae:ff:c5", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351f3080-98", "ovs_interfaceid": "351f3080-98ce-4f1f-a53f-d4415327255f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:47:35 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Converting VIF {"id": "351f3080-98ce-4f1f-a53f-d4415327255f", "address": "fa:16:3e:ae:ff:c5", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351f3080-98", "ovs_interfaceid": "351f3080-98ce-4f1f-a53f-d4415327255f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:47:35 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:ff:c5,bridge_name='br-int',has_traffic_filtering=True,id=351f3080-98ce-4f1f-a53f-d4415327255f,network=Network(70a92bb8-13dd-4b75-9986-5c136de68b16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap351f3080-98') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:47:35 user nova-compute[231753]: DEBUG os_vif [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:ff:c5,bridge_name='br-int',has_traffic_filtering=True,id=351f3080-98ce-4f1f-a53f-d4415327255f,network=Network(70a92bb8-13dd-4b75-9986-5c136de68b16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap351f3080-98') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:47:35 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:35 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:47:35 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:47:35 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:35 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap351f3080-98, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:47:35 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap351f3080-98, col_values=(('external_ids', {'iface-id': '351f3080-98ce-4f1f-a53f-d4415327255f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ae:ff:c5', 'vm-uuid': 'aee15bbf-4d52-4611-9e75-6443c2384913'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:47:35 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:47:35 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:35 user nova-compute[231753]: INFO os_vif [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:ff:c5,bridge_name='br-int',has_traffic_filtering=True,id=351f3080-98ce-4f1f-a53f-d4415327255f,network=Network(70a92bb8-13dd-4b75-9986-5c136de68b16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap351f3080-98')
Jul 29 13:47:36 user nova-compute[231753]: DEBUG nova.compute.manager [req-b9388095-0561-4c2b-b888-8f93c0a83e7c req-19f7bec4-bf39-4538-94fd-70bd1e8aafb8 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Received event network-vif-plugged-351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:47:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b9388095-0561-4c2b-b888-8f93c0a83e7c req-19f7bec4-bf39-4538-94fd-70bd1e8aafb8 service nova] Acquiring lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b9388095-0561-4c2b-b888-8f93c0a83e7c req-19f7bec4-bf39-4538-94fd-70bd1e8aafb8 service nova] Lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b9388095-0561-4c2b-b888-8f93c0a83e7c req-19f7bec4-bf39-4538-94fd-70bd1e8aafb8 service nova] Lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:36 user nova-compute[231753]: DEBUG nova.compute.manager [req-b9388095-0561-4c2b-b888-8f93c0a83e7c req-19f7bec4-bf39-4538-94fd-70bd1e8aafb8 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] No waiting events found dispatching network-vif-plugged-351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:47:36 user nova-compute[231753]: WARNING nova.compute.manager [req-b9388095-0561-4c2b-b888-8f93c0a83e7c req-19f7bec4-bf39-4538-94fd-70bd1e8aafb8 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Received unexpected event network-vif-plugged-351f3080-98ce-4f1f-a53f-d4415327255f for instance with vm_state active and task_state reboot_started_hard.
Jul 29 13:47:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:38 user nova-compute[231753]: DEBUG nova.compute.manager [req-20d3eb9c-36f5-4fad-8aa2-ca18df4b1c85 req-ba04c17b-db8f-4874-ad39-8c2091686cdd service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Received event network-vif-plugged-351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:47:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-20d3eb9c-36f5-4fad-8aa2-ca18df4b1c85 req-ba04c17b-db8f-4874-ad39-8c2091686cdd service nova] Acquiring lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-20d3eb9c-36f5-4fad-8aa2-ca18df4b1c85 req-ba04c17b-db8f-4874-ad39-8c2091686cdd service nova] Lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-20d3eb9c-36f5-4fad-8aa2-ca18df4b1c85 req-ba04c17b-db8f-4874-ad39-8c2091686cdd service nova] Lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:38 user nova-compute[231753]: DEBUG nova.compute.manager [req-20d3eb9c-36f5-4fad-8aa2-ca18df4b1c85 req-ba04c17b-db8f-4874-ad39-8c2091686cdd service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] No waiting events found dispatching network-vif-plugged-351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:47:38 user nova-compute[231753]: WARNING nova.compute.manager [req-20d3eb9c-36f5-4fad-8aa2-ca18df4b1c85 req-ba04c17b-db8f-4874-ad39-8c2091686cdd service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Received unexpected event network-vif-plugged-351f3080-98ce-4f1f-a53f-d4415327255f for instance with vm_state active and task_state reboot_started_hard.
Jul 29 13:47:38 user nova-compute[231753]: DEBUG nova.compute.manager [req-20d3eb9c-36f5-4fad-8aa2-ca18df4b1c85 req-ba04c17b-db8f-4874-ad39-8c2091686cdd service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Received event network-vif-plugged-351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:47:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-20d3eb9c-36f5-4fad-8aa2-ca18df4b1c85 req-ba04c17b-db8f-4874-ad39-8c2091686cdd service nova] Acquiring lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-20d3eb9c-36f5-4fad-8aa2-ca18df4b1c85 req-ba04c17b-db8f-4874-ad39-8c2091686cdd service nova] Lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-20d3eb9c-36f5-4fad-8aa2-ca18df4b1c85 req-ba04c17b-db8f-4874-ad39-8c2091686cdd service nova] Lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:38 user nova-compute[231753]: DEBUG nova.compute.manager [req-20d3eb9c-36f5-4fad-8aa2-ca18df4b1c85 req-ba04c17b-db8f-4874-ad39-8c2091686cdd service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] No waiting events found dispatching network-vif-plugged-351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:47:38 user nova-compute[231753]: WARNING nova.compute.manager [req-20d3eb9c-36f5-4fad-8aa2-ca18df4b1c85 req-ba04c17b-db8f-4874-ad39-8c2091686cdd service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Received unexpected event network-vif-plugged-351f3080-98ce-4f1f-a53f-d4415327255f for instance with vm_state active and task_state reboot_started_hard.
Jul 29 13:47:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Removed pending event for aee15bbf-4d52-4611-9e75-6443c2384913 due to event {{(pid=231753) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 29 13:47:39 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638459.970461, aee15bbf-4d52-4611-9e75-6443c2384913 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:47:39 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] VM Resumed (Lifecycle Event)
Jul 29 13:47:39 user nova-compute[231753]: DEBUG nova.compute.manager [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:47:39 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Instance rebooted successfully.
Jul 29 13:47:39 user nova-compute[231753]: DEBUG nova.compute.manager [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:47:40 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] During sync_power_state the instance has a pending task (reboot_started_hard). Skip.
Jul 29 13:47:40 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638459.9776063, aee15bbf-4d52-4611-9e75-6443c2384913 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:47:40 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] VM Started (Lifecycle Event)
Jul 29 13:47:40 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-88b293df-9f12-46a0-a382-0344137d5754 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "aee15bbf-4d52-4611-9e75-6443c2384913" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 9.455s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started_hard, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WsRLOebH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:47:40 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:47:40 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.003s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:47:40 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:47:40 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:47:40 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:47:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a -p 172.16.0.220:3260" returned: 21 in 0.028s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[45ae7af6-c4d3-4030-ae97-51c556001b4e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:47:40 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.033s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0feb9867-8282-457f-a67a-af90ccc8fcdf]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a] added
Jul 29 13:47:40 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.059s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7f35b65-f050-46ca-be2d-201c78bdfecd]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a499431e-778e-41dc-9b7a-ab3c1ea16be7]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WsRLOebH {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v WsRLOebH" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b3b870-dcff-4f17-85b6-7d1bde9edc79]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'WsRLOebH'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8bbc12-a979-424a-b8dc-dde9ba4202dc]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.041s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b105069d-3cc7-42c5-8c5f-5c392059dddf]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:47:40 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:47:40 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:47:40 user nova-compute[231753]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)
Jul 29 13:47:40 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:47:40 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:47:40 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:47:40 user nova-compute[231753]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)
Jul 29 13:47:40 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a -p 172.16.0.220:3260 --login" returned: 0 in 0.088s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4aff9527-aa3c-45a9-91be-b9b9c06a6d87]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a, portal: 172.16.0.220,3260]
Jul 29 13:47:40 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a, portal: 172.16.0.220,3260] successful.
Jul 29 13:47:40 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3289eff-d25f-47dc-80b9-113f1c975894]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.035s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[003aff8d-f5e5-47c3-87c3-73f17eb15457]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:47:40 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:47:40 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:47:40 user nova-compute[231753]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)
Jul 29 13:47:40 user nova-compute[231753]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a (non-flash)
Jul 29 13:47:40 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:47:40 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:47:40 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:47:40 user nova-compute[231753]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)
Jul 29 13:47:40 user nova-compute[231753]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a (non-flash)
Jul 29 13:47:40 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.440s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] HCTL ('37', '-', '-', 0) found on session 37 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1d4622d-f48d-4277-bdd3-44e419c1e07f]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Searching for a device in session 37 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:47:40 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WsRLOebH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:47:40 user nova-compute[231753]: INFO nova.compute.manager [None req-9b274bb7-b9ee-47d1-b6a0-78ec20592cf3 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Get console output
Jul 29 13:47:40 user nova-compute[231753]: INFO nova.privsep.libvirt [-] Ignored error while reading from instance console pty: can't concat NoneType to bytes
Jul 29 13:47:41 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:41 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.491s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:47:41 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] <== connect_volume: return (1493ms) {'type': 'block', 'scsi_wwn': '23134643231366161', 'path': '/dev/sdf'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:47:41 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23134643231366161', 'path': '/dev/sdf'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:47:41 user nova-compute[231753]: DEBUG nova.objects.instance [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lazy-loading 'flavor' on Instance uuid 8a61a780-6403-4aed-9c4a-2af01965f5d2 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:47:41 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 13:47:41 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:47:41 user nova-compute[231753]:   <source dev="/dev/sdf"/>
Jul 29 13:47:41 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:47:41 user nova-compute[231753]:   <serial>4ba55d8c-783c-44a6-8094-84a4593d409a</serial>
Jul 29 13:47:41 user nova-compute[231753]: </disk>
Jul 29 13:47:41 user nova-compute[231753]:  {{(pid=231753) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 13:47:42 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:47:42 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] No BDM found with device name vdb, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:47:42 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] No VIF found with MAC fa:16:3e:cb:ee:63, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:47:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-76d90deb-742e-4392-b469-bd27a9262e3d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "8a61a780-6403-4aed-9c4a-2af01965f5d2" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.797s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-a7bf6b1b-23e9-4b98-a7f1-3457b9d7f34d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "8a61a780-6403-4aed-9c4a-2af01965f5d2" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:47:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-a7bf6b1b-23e9-4b98-a7f1-3457b9d7f34d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "8a61a780-6403-4aed-9c4a-2af01965f5d2" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:47:43 user nova-compute[231753]: INFO nova.compute.manager [None req-a7bf6b1b-23e9-4b98-a7f1-3457b9d7f34d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Detaching volume 4ba55d8c-783c-44a6-8094-84a4593d409a
Jul 29 13:47:43 user nova-compute[231753]: INFO nova.virt.block_device [None req-a7bf6b1b-23e9-4b98-a7f1-3457b9d7f34d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Attempting to driver detach volume 4ba55d8c-783c-44a6-8094-84a4593d409a from mountpoint /dev/vdb
Jul 29 13:47:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-a7bf6b1b-23e9-4b98-a7f1-3457b9d7f34d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Attempting to detach device vdb from instance 8a61a780-6403-4aed-9c4a-2af01965f5d2 from the persistent domain config. {{(pid=231753) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 13:47:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-a7bf6b1b-23e9-4b98-a7f1-3457b9d7f34d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:47:43 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:47:43 user nova-compute[231753]:   <source dev="/dev/sdf"/>
Jul 29 13:47:43 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:47:43 user nova-compute[231753]:   <serial>4ba55d8c-783c-44a6-8094-84a4593d409a</serial>
Jul 29 13:47:43 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 13:47:43 user nova-compute[231753]: </disk>
Jul 29 13:47:43 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:47:43 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-a7bf6b1b-23e9-4b98-a7f1-3457b9d7f34d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Successfully detached device vdb from instance 8a61a780-6403-4aed-9c4a-2af01965f5d2 from the persistent domain config.
Jul 29 13:47:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-a7bf6b1b-23e9-4b98-a7f1-3457b9d7f34d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8a61a780-6403-4aed-9c4a-2af01965f5d2 from the live domain config. {{(pid=231753) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 13:47:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-a7bf6b1b-23e9-4b98-a7f1-3457b9d7f34d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:47:43 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:47:43 user nova-compute[231753]:   <source dev="/dev/sdf"/>
Jul 29 13:47:43 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:47:43 user nova-compute[231753]:   <serial>4ba55d8c-783c-44a6-8094-84a4593d409a</serial>
Jul 29 13:47:43 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 13:47:43 user nova-compute[231753]: </disk>
Jul 29 13:47:43 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:47:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Received event <DeviceRemovedEvent: 1690638464.031133, 8a61a780-6403-4aed-9c4a-2af01965f5d2 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=231753) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-a7bf6b1b-23e9-4b98-a7f1-3457b9d7f34d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8a61a780-6403-4aed-9c4a-2af01965f5d2 {{(pid=231753) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 13:47:44 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-a7bf6b1b-23e9-4b98-a7f1-3457b9d7f34d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Successfully detached device vdb from instance 8a61a780-6403-4aed-9c4a-2af01965f5d2 from the live domain config.
Jul 29 13:47:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7bf6b1b-23e9-4b98-a7f1-3457b9d7f34d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf6b1b-23e9-4b98-a7f1-3457b9d7f34d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'WsRLOebH', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:47:44 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-a7bf6b1b-23e9-4b98-a7f1-3457b9d7f34d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:47:44 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-a7bf6b1b-23e9-4b98-a7f1-3457b9d7f34d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-a7bf6b1b-23e9-4b98-a7f1-3457b9d7f34d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[76aef271-3b84-4132-82d4-70cbd066bd87]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf6b1b-23e9-4b98-a7f1-3457b9d7f34d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:47:44 user nova-compute[231753]: No targets found.
Jul 29 13:47:44 user nova-compute[231753]: iSNS:
Jul 29 13:47:44 user nova-compute[231753]: No targets found.
Jul 29 13:47:44 user nova-compute[231753]: STATIC:
Jul 29 13:47:44 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea
Jul 29 13:47:44 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:47:44 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:47:44 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4
Jul 29 13:47:44 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:47:44 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:47:44 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a
Jul 29 13:47:44 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:47:44 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:47:44 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43
Jul 29 13:47:44 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:47:44 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:47:44 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef
Jul 29 13:47:44 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:47:44 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:47:44 user nova-compute[231753]: FIRMWARE:
Jul 29 13:47:44 user nova-compute[231753]: No targets found.
Jul 29 13:47:44 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf6b1b-23e9-4b98-a7f1-3457b9d7f34d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:47:44 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:47:44 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf6b1b-23e9-4b98-a7f1-3457b9d7f34d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[587b2c03-1eec-4205-8fc6-1b080185abe3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[11919ee0-8a66-4471-913e-b18d9ead3a40]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)\ntcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf6b1b-23e9-4b98-a7f1-3457b9d7f34d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:47:44 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:47:44 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:47:44 user nova-compute[231753]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)
Jul 29 13:47:44 user nova-compute[231753]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a (non-flash)
Jul 29 13:47:44 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf6b1b-23e9-4b98-a7f1-3457b9d7f34d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:47:44 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:47:44 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:47:44 user nova-compute[231753]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)
Jul 29 13:47:44 user nova-compute[231753]: tcp: [37] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a (non-flash)
Jul 29 13:47:44 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf6b1b-23e9-4b98-a7f1-3457b9d7f34d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c983292d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a'): ({'sdf'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-a7bf6b1b-23e9-4b98-a7f1-3457b9d7f34d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Removing single pathed devices sdf {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f8befad-6a2c-4f2f-aab5-db2e701ecd1c]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd002321-920c-4973-b9e1-fa9e3df94d61]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-a7bf6b1b-23e9-4b98-a7f1-3457b9d7f34d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Flushing IO for device /dev/sdf {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.014s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[800776cb-0dfc-4f38-85e9-186fd2ca135a]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-a7bf6b1b-23e9-4b98-a7f1-3457b9d7f34d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.030s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[678d8055-9c08-4f38-9e1b-dcf9b2586760]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-a7bf6b1b-23e9-4b98-a7f1-3457b9d7f34d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-a7bf6b1b-23e9-4b98-a7f1-3457b9d7f34d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] SCSI volumes sdf have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf6b1b-23e9-4b98-a7f1-3457b9d7f34d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d6e71bc-f25f-43a0-8891-30d6bb35f1b3]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf6b1b-23e9-4b98-a7f1-3457b9d7f34d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a -p 172.16.0.220:3260 --logout" returned: 0 in 0.055s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f417ed0-79e4-4279-8a88-96cbe42b8ec9]: (4, ('Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a, portal: 172.16.0.220,3260]\nLogout of [sid: 37, target: iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf6b1b-23e9-4b98-a7f1-3457b9d7f34d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a, portal: 172.16.0.220,3260]
Jul 29 13:47:44 user nova-compute[231753]: Logout of [sid: 37, target: iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a, portal: 172.16.0.220,3260] successful.
Jul 29 13:47:44 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:4ba55d8c-783c-44a6-8094-84a4593d409a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bbab96-20ec-4fbf-8a82-a5c48349c9a1]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf6b1b-23e9-4b98-a7f1-3457b9d7f34d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-a7bf6b1b-23e9-4b98-a7f1-3457b9d7f34d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.319s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-a7bf6b1b-23e9-4b98-a7f1-3457b9d7f34d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] <== disconnect_volume: return (321ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:47:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a7bf6b1b-23e9-4b98-a7f1-3457b9d7f34d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:47:45 user nova-compute[231753]: DEBUG nova.objects.instance [None req-a7bf6b1b-23e9-4b98-a7f1-3457b9d7f34d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lazy-loading 'flavor' on Instance uuid 8a61a780-6403-4aed-9c4a-2af01965f5d2 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:47:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-a7bf6b1b-23e9-4b98-a7f1-3457b9d7f34d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "8a61a780-6403-4aed-9c4a-2af01965f5d2" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.853s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:47:45 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:46 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:50 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:55 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:55 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:47:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:48:00 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:48:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:48:05 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:48:08 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:48:09 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:48:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:48:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:48:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:48:09 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 13:48:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:48:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk.rescue --force-share --output=json" returned: 0 in 0.148s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk (vdb) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:48:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afd6468c-465d-49c9-b01c-93734f2a3e17/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afd6468c-465d-49c9-b01c-93734f2a3e17/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afd6468c-465d-49c9-b01c-93734f2a3e17/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:48:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:48:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afd6468c-465d-49c9-b01c-93734f2a3e17/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json" returned: 0 in 0.140s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json" returned: 0 in 0.175s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:11 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:48:11 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:48:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a61a780-6403-4aed-9c4a-2af01965f5d2/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a61a780-6403-4aed-9c4a-2af01965f5d2/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a61a780-6403-4aed-9c4a-2af01965f5d2/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a61a780-6403-4aed-9c4a-2af01965f5d2/disk --force-share --output=json" returned: 0 in 0.167s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:13 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:48:13 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:48:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=7018MB free_disk=25.00558090209961GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 13:48:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:48:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:48:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:48:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 7e2615c1-b03e-4076-bcd9-3585fb11b8ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:48:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8ea52d41-7ec3-44d7-8421-133000ee887b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:48:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance cf326e80-7293-4764-9411-ed05a5aeba23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:48:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b99a72ba-73e2-4be7-b52b-7797351daa5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:48:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8dd26572-fe6a-40fd-8c58-6af862b340c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:48:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance f62c7904-d9d1-4bfc-bef8-9b1c241134f1 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 2048, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:48:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance aee15bbf-4d52-4611-9e75-6443c2384913 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:48:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b9751029-dfed-4342-ad92-9ae53d72fbc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:48:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8a61a780-6403-4aed-9c4a-2af01965f5d2 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:48:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b6be450b-ebe7-4385-b162-2d072237aa97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:48:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance afd6468c-465d-49c9-b01c-93734f2a3e17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:48:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 13:48:13 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=8192MB phys_disk=40GB used_disk=10GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 13:48:13 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:48:14 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:48:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 13:48:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.579s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:48:15 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:48:17 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:48:17 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:48:17 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 13:48:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "refresh_cache-7e2615c1-b03e-4076-bcd9-3585fb11b8ac" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:48:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquired lock "refresh_cache-7e2615c1-b03e-4076-bcd9-3585fb11b8ac" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:48:17 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Forcefully refreshing network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 13:48:17 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Updating instance_info_cache with network_info: [{"id": "8c8e51fe-0d15-4a27-8215-dc512b6816f5", "address": "fa:16:3e:3e:10:27", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e51fe-0d", "ovs_interfaceid": "8c8e51fe-0d15-4a27-8215-dc512b6816f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:48:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Releasing lock "refresh_cache-7e2615c1-b03e-4076-bcd9-3585fb11b8ac" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:48:17 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Updated the network info_cache for instance {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 13:48:17 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:48:17 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:48:17 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:48:17 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:48:17 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 13:48:18 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:48:19 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:48:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:48:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:48:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:48:30 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:48:33 user nova-compute[231753]: DEBUG nova.compute.manager [None req-3ad93118-b48d-42df-9aea-9ec423e71ae5 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:48:33 user nova-compute[231753]: INFO nova.compute.manager [None req-3ad93118-b48d-42df-9aea-9ec423e71ae5 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] instance snapshotting
Jul 29 13:48:33 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-3ad93118-b48d-42df-9aea-9ec423e71ae5 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Beginning live snapshot process
Jul 29 13:48:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b4b99e4e-4a88-4b76-be2d-f1298b0e9ef4 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "8a61a780-6403-4aed-9c4a-2af01965f5d2" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:48:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b4b99e4e-4a88-4b76-be2d-f1298b0e9ef4 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "8a61a780-6403-4aed-9c4a-2af01965f5d2" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:48:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b4b99e4e-4a88-4b76-be2d-f1298b0e9ef4 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "8a61a780-6403-4aed-9c4a-2af01965f5d2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:48:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b4b99e4e-4a88-4b76-be2d-f1298b0e9ef4 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "8a61a780-6403-4aed-9c4a-2af01965f5d2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:48:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b4b99e4e-4a88-4b76-be2d-f1298b0e9ef4 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "8a61a780-6403-4aed-9c4a-2af01965f5d2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:48:33 user nova-compute[231753]: INFO nova.compute.manager [None req-b4b99e4e-4a88-4b76-be2d-f1298b0e9ef4 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Terminating instance
Jul 29 13:48:33 user nova-compute[231753]: DEBUG nova.compute.manager [None req-b4b99e4e-4a88-4b76-be2d-f1298b0e9ef4 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:48:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-3ad93118-b48d-42df-9aea-9ec423e71ae5 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json -f qcow2 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:48:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:48:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:48:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:48:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-3ad93118-b48d-42df-9aea-9ec423e71ae5 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json -f qcow2" returned: 0 in 0.224s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-3ad93118-b48d-42df-9aea-9ec423e71ae5 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json -f qcow2 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:34 user nova-compute[231753]: DEBUG nova.compute.manager [req-ce36d609-cd4a-4a63-a1f4-84cad61aacb6 req-a94234ee-05dd-4469-bc04-d5d36492174e service nova] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Received event network-vif-unplugged-89495dd5-c711-4ec9-b2f4-bb166a0a4a7b {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:48:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ce36d609-cd4a-4a63-a1f4-84cad61aacb6 req-a94234ee-05dd-4469-bc04-d5d36492174e service nova] Acquiring lock "8a61a780-6403-4aed-9c4a-2af01965f5d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:48:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ce36d609-cd4a-4a63-a1f4-84cad61aacb6 req-a94234ee-05dd-4469-bc04-d5d36492174e service nova] Lock "8a61a780-6403-4aed-9c4a-2af01965f5d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:48:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ce36d609-cd4a-4a63-a1f4-84cad61aacb6 req-a94234ee-05dd-4469-bc04-d5d36492174e service nova] Lock "8a61a780-6403-4aed-9c4a-2af01965f5d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:48:34 user nova-compute[231753]: DEBUG nova.compute.manager [req-ce36d609-cd4a-4a63-a1f4-84cad61aacb6 req-a94234ee-05dd-4469-bc04-d5d36492174e service nova] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] No waiting events found dispatching network-vif-unplugged-89495dd5-c711-4ec9-b2f4-bb166a0a4a7b {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:48:34 user nova-compute[231753]: DEBUG nova.compute.manager [req-ce36d609-cd4a-4a63-a1f4-84cad61aacb6 req-a94234ee-05dd-4469-bc04-d5d36492174e service nova] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Received event network-vif-unplugged-89495dd5-c711-4ec9-b2f4-bb166a0a4a7b for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:48:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-3ad93118-b48d-42df-9aea-9ec423e71ae5 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json -f qcow2" returned: 0 in 0.170s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-3ad93118-b48d-42df-9aea-9ec423e71ae5 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-3ad93118-b48d-42df-9aea-9ec423e71ae5 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.166s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-3ad93118-b48d-42df-9aea-9ec423e71ae5 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpu72hs3lv/3feb6bad55694eeeb1cfa39eaa7abf70.delta 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-3ad93118-b48d-42df-9aea-9ec423e71ae5 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpu72hs3lv/3feb6bad55694eeeb1cfa39eaa7abf70.delta 1073741824" returned: 0 in 0.074s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:34 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-3ad93118-b48d-42df-9aea-9ec423e71ae5 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 29 13:48:35 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Instance destroyed successfully.
Jul 29 13:48:35 user nova-compute[231753]: DEBUG nova.objects.instance [None req-b4b99e4e-4a88-4b76-be2d-f1298b0e9ef4 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lazy-loading 'resources' on Instance uuid 8a61a780-6403-4aed-9c4a-2af01965f5d2 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:48:35 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-b4b99e4e-4a88-4b76-be2d-f1298b0e9ef4 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:45:33Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-1325470665',display_name='tempest-AttachVolumeNegativeTest-server-1325470665',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-1325470665',id=31,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFfnSb8cbu5OETbWcAKwBDoUDBXOx6Z8rJjqi/6q4SgJInpdA2hwKRIOIwxuoEoRhWB8soyI6dob83rSNnrZg7CagBD0oJ2fZcA6tTvIE2y0qLmG72DhfNvwgkA/c13nPw==',key_name='tempest-keypair-169969578',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:45:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f3122196c4504a82a2a01774ab60406a',ramdisk_id='',reservation_id='r-e34728zo',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1031975907',owner_user_name='tempest-AttachVolumeNegativeTest-1031975907-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:45:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a09de75c8ab742fe951604b612ea5839',uuid=8a61a780-6403-4aed-9c4a-2af01965f5d2,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89495dd5-c711-4ec9-b2f4-bb166a0a4a7b", "address": "fa:16:3e:cb:ee:63", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89495dd5-c7", "ovs_interfaceid": "89495dd5-c711-4ec9-b2f4-bb166a0a4a7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:48:35 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b4b99e4e-4a88-4b76-be2d-f1298b0e9ef4 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Converting VIF {"id": "89495dd5-c711-4ec9-b2f4-bb166a0a4a7b", "address": "fa:16:3e:cb:ee:63", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.26", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89495dd5-c7", "ovs_interfaceid": "89495dd5-c711-4ec9-b2f4-bb166a0a4a7b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:48:35 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b4b99e4e-4a88-4b76-be2d-f1298b0e9ef4 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cb:ee:63,bridge_name='br-int',has_traffic_filtering=True,id=89495dd5-c711-4ec9-b2f4-bb166a0a4a7b,network=Network(1ff03660-77ea-4ec6-8eeb-55df7e78096b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89495dd5-c7') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:48:35 user nova-compute[231753]: DEBUG os_vif [None req-b4b99e4e-4a88-4b76-be2d-f1298b0e9ef4 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:ee:63,bridge_name='br-int',has_traffic_filtering=True,id=89495dd5-c711-4ec9-b2f4-bb166a0a4a7b,network=Network(1ff03660-77ea-4ec6-8eeb-55df7e78096b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89495dd5-c7') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:48:35 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:48:35 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89495dd5-c7, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:48:35 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:48:35 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-3ad93118-b48d-42df-9aea-9ec423e71ae5 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] COPY block job progress, current cursor: 0 final cursor: 75497472 {{(pid=231753) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 13:48:35 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:48:35 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:48:35 user nova-compute[231753]: INFO os_vif [None req-b4b99e4e-4a88-4b76-be2d-f1298b0e9ef4 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cb:ee:63,bridge_name='br-int',has_traffic_filtering=True,id=89495dd5-c711-4ec9-b2f4-bb166a0a4a7b,network=Network(1ff03660-77ea-4ec6-8eeb-55df7e78096b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89495dd5-c7')
Jul 29 13:48:35 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-b4b99e4e-4a88-4b76-be2d-f1298b0e9ef4 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Deleting instance files /opt/stack/data/nova/instances/8a61a780-6403-4aed-9c4a-2af01965f5d2_del
Jul 29 13:48:35 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-b4b99e4e-4a88-4b76-be2d-f1298b0e9ef4 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Deletion of /opt/stack/data/nova/instances/8a61a780-6403-4aed-9c4a-2af01965f5d2_del complete
Jul 29 13:48:35 user nova-compute[231753]: INFO nova.compute.manager [None req-b4b99e4e-4a88-4b76-be2d-f1298b0e9ef4 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Took 1.74 seconds to destroy the instance on the hypervisor.
Jul 29 13:48:35 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-b4b99e4e-4a88-4b76-be2d-f1298b0e9ef4 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:48:35 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:48:35 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:48:35 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-3ad93118-b48d-42df-9aea-9ec423e71ae5 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] COPY block job progress, current cursor: 75497472 final cursor: 75497472 {{(pid=231753) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 13:48:35 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-3ad93118-b48d-42df-9aea-9ec423e71ae5 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 29 13:48:36 user nova-compute[231753]: DEBUG nova.privsep.utils [None req-3ad93118-b48d-42df-9aea-9ec423e71ae5 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=231753) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 29 13:48:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-3ad93118-b48d-42df-9aea-9ec423e71ae5 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpu72hs3lv/3feb6bad55694eeeb1cfa39eaa7abf70.delta /opt/stack/data/nova/instances/snapshots/tmpu72hs3lv/3feb6bad55694eeeb1cfa39eaa7abf70 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:36 user nova-compute[231753]: DEBUG nova.compute.manager [req-5e91f17f-84c5-4fa1-aec0-11bdd64bcfe6 req-e94e3814-aef2-433f-bb56-11be83c7a9d3 service nova] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Received event network-vif-plugged-89495dd5-c711-4ec9-b2f4-bb166a0a4a7b {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:48:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5e91f17f-84c5-4fa1-aec0-11bdd64bcfe6 req-e94e3814-aef2-433f-bb56-11be83c7a9d3 service nova] Acquiring lock "8a61a780-6403-4aed-9c4a-2af01965f5d2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:48:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5e91f17f-84c5-4fa1-aec0-11bdd64bcfe6 req-e94e3814-aef2-433f-bb56-11be83c7a9d3 service nova] Lock "8a61a780-6403-4aed-9c4a-2af01965f5d2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:48:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5e91f17f-84c5-4fa1-aec0-11bdd64bcfe6 req-e94e3814-aef2-433f-bb56-11be83c7a9d3 service nova] Lock "8a61a780-6403-4aed-9c4a-2af01965f5d2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:48:36 user nova-compute[231753]: DEBUG nova.compute.manager [req-5e91f17f-84c5-4fa1-aec0-11bdd64bcfe6 req-e94e3814-aef2-433f-bb56-11be83c7a9d3 service nova] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] No waiting events found dispatching network-vif-plugged-89495dd5-c711-4ec9-b2f4-bb166a0a4a7b {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:48:36 user nova-compute[231753]: WARNING nova.compute.manager [req-5e91f17f-84c5-4fa1-aec0-11bdd64bcfe6 req-e94e3814-aef2-433f-bb56-11be83c7a9d3 service nova] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Received unexpected event network-vif-plugged-89495dd5-c711-4ec9-b2f4-bb166a0a4a7b for instance with vm_state active and task_state deleting.
Jul 29 13:48:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-3ad93118-b48d-42df-9aea-9ec423e71ae5 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpu72hs3lv/3feb6bad55694eeeb1cfa39eaa7abf70.delta /opt/stack/data/nova/instances/snapshots/tmpu72hs3lv/3feb6bad55694eeeb1cfa39eaa7abf70" returned: 0 in 0.678s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:36 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-3ad93118-b48d-42df-9aea-9ec423e71ae5 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Snapshot extracted, beginning image upload
Jul 29 13:48:36 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:48:36 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Took 1.35 seconds to deallocate network for instance.
Jul 29 13:48:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b4b99e4e-4a88-4b76-be2d-f1298b0e9ef4 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:48:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b4b99e4e-4a88-4b76-be2d-f1298b0e9ef4 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:48:37 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-b4b99e4e-4a88-4b76-be2d-f1298b0e9ef4 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:48:37 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-b4b99e4e-4a88-4b76-be2d-f1298b0e9ef4 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:48:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b4b99e4e-4a88-4b76-be2d-f1298b0e9ef4 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.456s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:48:37 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-b4b99e4e-4a88-4b76-be2d-f1298b0e9ef4 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Deleted allocations for instance 8a61a780-6403-4aed-9c4a-2af01965f5d2
Jul 29 13:48:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b4b99e4e-4a88-4b76-be2d-f1298b0e9ef4 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "8a61a780-6403-4aed-9c4a-2af01965f5d2" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.822s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:48:38 user nova-compute[231753]: DEBUG nova.compute.manager [req-71549d54-82c5-4973-a075-35f837573f2b req-43056720-9b93-4209-a465-74e84650be8e service nova] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Received event network-vif-deleted-89495dd5-c711-4ec9-b2f4-bb166a0a4a7b {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:48:39 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-3ad93118-b48d-42df-9aea-9ec423e71ae5 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Snapshot image upload complete
Jul 29 13:48:39 user nova-compute[231753]: INFO nova.compute.manager [None req-3ad93118-b48d-42df-9aea-9ec423e71ae5 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Took 5.86 seconds to snapshot the instance on the hypervisor.
Jul 29 13:48:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:48:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:48:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:48:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:48:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:48:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:48:41 user nova-compute[231753]: INFO nova.compute.manager [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Terminating instance
Jul 29 13:48:41 user nova-compute[231753]: DEBUG nova.compute.manager [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:48:41 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:48:41 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG nova.compute.manager [req-333a7e3b-3e09-436f-b136-e55907090d25 req-a50a1305-d563-407f-a2eb-f61a00510d53 service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Received event network-vif-unplugged-50f751e1-b359-47f5-8e65-19f48fcf1f4a {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-333a7e3b-3e09-436f-b136-e55907090d25 req-a50a1305-d563-407f-a2eb-f61a00510d53 service nova] Acquiring lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-333a7e3b-3e09-436f-b136-e55907090d25 req-a50a1305-d563-407f-a2eb-f61a00510d53 service nova] Lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-333a7e3b-3e09-436f-b136-e55907090d25 req-a50a1305-d563-407f-a2eb-f61a00510d53 service nova] Lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG nova.compute.manager [req-333a7e3b-3e09-436f-b136-e55907090d25 req-a50a1305-d563-407f-a2eb-f61a00510d53 service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] No waiting events found dispatching network-vif-unplugged-50f751e1-b359-47f5-8e65-19f48fcf1f4a {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG nova.compute.manager [req-333a7e3b-3e09-436f-b136-e55907090d25 req-a50a1305-d563-407f-a2eb-f61a00510d53 service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Received event network-vif-unplugged-50f751e1-b359-47f5-8e65-19f48fcf1f4a for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:48:42 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Instance destroyed successfully.
Jul 29 13:48:42 user nova-compute[231753]: DEBUG nova.objects.instance [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lazy-loading 'resources' on Instance uuid f62c7904-d9d1-4bfc-bef8-9b1c241134f1 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:42:06Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-643824359',display_name='tempest-ServerActionsTestOtherA-server-643824359',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(7),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-643824359',id=26,image_ref='',info_cache=InstanceInfoCache,instance_type_id=7,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuWQgyAL1ZhtINiMb8bBadRX1/6ZehT6zfTT2DNFW6eh8iXvfW0Pq6raR1PDnzRXJlqkmjwTrVF+AwsdLN+yPf0k+X1yx9QfVmcJaO2ivlK/Orc5S8LFrDXUE7UuYGgdQ==',key_name='tempest-keypair-820646002',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:44:18Z,launched_on='user',locked=False,locked_by=None,memory_mb=2048,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='afff9d3d250643c58da9bc5cf5756d1e',ramdisk_id='',reservation_id='r-yz0wxii9',resources=None,root_device_name='/dev/vda',root_gb=20,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1666416634',owner_user_name='tempest-ServerActionsTestOtherA-1666416634-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:45:51Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='748938c3fbfb4244ab946dcfe4762435',uuid=f62c7904-d9d1-4bfc-bef8-9b1c241134f1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "address": "fa:16:3e:ed:37:b6", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f751e1-b3", "ovs_interfaceid": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Converting VIF {"id": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "address": "fa:16:3e:ed:37:b6", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.232", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap50f751e1-b3", "ovs_interfaceid": "50f751e1-b359-47f5-8e65-19f48fcf1f4a", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ed:37:b6,bridge_name='br-int',has_traffic_filtering=True,id=50f751e1-b359-47f5-8e65-19f48fcf1f4a,network=Network(f99d9e39-7a5f-481e-905f-4d5a4e920b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f751e1-b3') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG os_vif [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:37:b6,bridge_name='br-int',has_traffic_filtering=True,id=50f751e1-b359-47f5-8e65-19f48fcf1f4a,network=Network(f99d9e39-7a5f-481e-905f-4d5a4e920b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f751e1-b3') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap50f751e1-b3, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:48:42 user nova-compute[231753]: INFO os_vif [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ed:37:b6,bridge_name='br-int',has_traffic_filtering=True,id=50f751e1-b359-47f5-8e65-19f48fcf1f4a,network=Network(f99d9e39-7a5f-481e-905f-4d5a4e920b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap50f751e1-b3')
Jul 29 13:48:42 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'QWgPCtAU', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:48:42 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:48:42 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[78619f70-a475-47f7-8517-ea26ec94b31e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:48:42 user nova-compute[231753]: No targets found.
Jul 29 13:48:42 user nova-compute[231753]: iSNS:
Jul 29 13:48:42 user nova-compute[231753]: No targets found.
Jul 29 13:48:42 user nova-compute[231753]: STATIC:
Jul 29 13:48:42 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea
Jul 29 13:48:42 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:48:42 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:48:42 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4
Jul 29 13:48:42 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:48:42 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:48:42 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43
Jul 29 13:48:42 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:48:42 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:48:42 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef
Jul 29 13:48:42 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:48:42 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:48:42 user nova-compute[231753]: FIRMWARE:
Jul 29 13:48:42 user nova-compute[231753]: No targets found.
Jul 29 13:48:42 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:48:42 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:48:42 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.112s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[458aaf2d-17a5-4c11-88d0-aefc72480cf0]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.042s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a16520c-8437-4c61-8494-8cb9ae3f8391]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:48:42 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:48:42 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:48:42 user nova-compute[231753]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)
Jul 29 13:48:42 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:48:42 user nova-compute[231753]: tcp: [30] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef (non-flash)
Jul 29 13:48:42 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:48:42 user nova-compute[231753]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)
Jul 29 13:48:42 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c80381480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef'): ({'sdc'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Removing single pathed devices sdc {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.027s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfecbc35-a59a-4903-b4d5-3cdb48842604]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff78d44e-4aa5-409b-9744-457d53251641]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Flushing IO for device /dev/sdc {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0c37915-1946-4213-a2de-55d0720f9122]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.056s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[34219954-bb7c-471b-a977-3d4973580c42]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] SCSI volumes sdc have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-SSCST_BIO_Storage_b542c56d', '/dev/disk/by-id/scsi-23632316232303066', '/dev/disk/by-id/scsi-1SCST_BIOb542c56d-621b200f21cbb7a9') {{(pid=242780) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fb4aec1-8abd-4c81-b765-9ebf336f0394]: (4, None) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd64685a-6c82-4fd7-897e-b4d3681ef43e]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[75759958-6826-41b0-a518-ae1db144a94b]: (4, ('Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef, portal: 172.16.0.220,3260]\nLogout of [sid: 30, target: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 30, target: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef, portal: 172.16.0.220,3260]
Jul 29 13:48:42 user nova-compute[231753]: Logout of [sid: 30, target: iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef, portal: 172.16.0.220,3260] successful.
Jul 29 13:48:42 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:afa3c554-c497-4ad8-94dc-fbe61541e6ef -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7eb763-2c31-4345-bdf5-a662c43dd4e8]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.477s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] <== disconnect_volume: return (478ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:48:42 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:48:42 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Deleting instance files /opt/stack/data/nova/instances/f62c7904-d9d1-4bfc-bef8-9b1c241134f1_del
Jul 29 13:48:42 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Deletion of /opt/stack/data/nova/instances/f62c7904-d9d1-4bfc-bef8-9b1c241134f1_del complete
Jul 29 13:48:43 user nova-compute[231753]: INFO nova.compute.manager [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Took 1.40 seconds to destroy the instance on the hypervisor.
Jul 29 13:48:43 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:48:43 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:48:43 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:48:43 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:48:43 user nova-compute[231753]: DEBUG nova.compute.manager [req-eaf378ea-d91f-4d04-97a2-a74a8afe243e req-4229d3da-17db-4816-bae6-3c6b79143b2f service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Received event network-vif-deleted-50f751e1-b359-47f5-8e65-19f48fcf1f4a {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:48:43 user nova-compute[231753]: INFO nova.compute.manager [req-eaf378ea-d91f-4d04-97a2-a74a8afe243e req-4229d3da-17db-4816-bae6-3c6b79143b2f service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Neutron deleted interface 50f751e1-b359-47f5-8e65-19f48fcf1f4a; detaching it from the instance and deleting it from the info cache
Jul 29 13:48:43 user nova-compute[231753]: DEBUG nova.network.neutron [req-eaf378ea-d91f-4d04-97a2-a74a8afe243e req-4229d3da-17db-4816-bae6-3c6b79143b2f service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:48:43 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Took 0.86 seconds to deallocate network for instance.
Jul 29 13:48:43 user nova-compute[231753]: DEBUG nova.compute.manager [req-eaf378ea-d91f-4d04-97a2-a74a8afe243e req-4229d3da-17db-4816-bae6-3c6b79143b2f service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Detach interface failed, port_id=50f751e1-b359-47f5-8e65-19f48fcf1f4a, reason: Instance f62c7904-d9d1-4bfc-bef8-9b1c241134f1 could not be found. {{(pid=231753) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 13:48:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-d12ea364-18c6-4c75-9b00-251d6386ed44 req-6cb2e106-b5c8-4752-b69a-4e26151d59d4 service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Received event network-vif-plugged-50f751e1-b359-47f5-8e65-19f48fcf1f4a {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:48:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d12ea364-18c6-4c75-9b00-251d6386ed44 req-6cb2e106-b5c8-4752-b69a-4e26151d59d4 service nova] Acquiring lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:48:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d12ea364-18c6-4c75-9b00-251d6386ed44 req-6cb2e106-b5c8-4752-b69a-4e26151d59d4 service nova] Lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:48:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d12ea364-18c6-4c75-9b00-251d6386ed44 req-6cb2e106-b5c8-4752-b69a-4e26151d59d4 service nova] Lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:48:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-d12ea364-18c6-4c75-9b00-251d6386ed44 req-6cb2e106-b5c8-4752-b69a-4e26151d59d4 service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] No waiting events found dispatching network-vif-plugged-50f751e1-b359-47f5-8e65-19f48fcf1f4a {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:48:44 user nova-compute[231753]: WARNING nova.compute.manager [req-d12ea364-18c6-4c75-9b00-251d6386ed44 req-6cb2e106-b5c8-4752-b69a-4e26151d59d4 service nova] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Received unexpected event network-vif-plugged-50f751e1-b359-47f5-8e65-19f48fcf1f4a for instance with vm_state active and task_state deleting.
Jul 29 13:48:44 user nova-compute[231753]: INFO nova.compute.manager [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Took 0.77 seconds to detach 1 volumes for instance.
Jul 29 13:48:44 user nova-compute[231753]: DEBUG nova.compute.manager [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Deleting volume: afa3c554-c497-4ad8-94dc-fbe61541e6ef {{(pid=231753) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 29 13:48:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:48:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:48:45 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:48:45 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:48:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.359s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:48:45 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Deleted allocations for instance f62c7904-d9d1-4bfc-bef8-9b1c241134f1
Jul 29 13:48:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9b78f2b2-ec6f-470b-9c73-37939bc08364 tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "f62c7904-d9d1-4bfc-bef8-9b1c241134f1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.635s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:48:47 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:48:50 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690638515.381237, 8a61a780-6403-4aed-9c4a-2af01965f5d2 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:48:50 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] VM Stopped (Lifecycle Event)
Jul 29 13:48:50 user nova-compute[231753]: DEBUG nova.compute.manager [None req-df92f1d7-41a5-4576-bc0f-1e55bb2f0a54 None None] [instance: 8a61a780-6403-4aed-9c4a-2af01965f5d2] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:48:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:48:57 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690638522.3590677, f62c7904-d9d1-4bfc-bef8-9b1c241134f1 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:48:57 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] VM Stopped (Lifecycle Event)
Jul 29 13:48:57 user nova-compute[231753]: DEBUG nova.compute.manager [None req-1b362dcc-17a0-412f-8567-08808ff0514f None None] [instance: f62c7904-d9d1-4bfc-bef8-9b1c241134f1] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:48:57 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:49:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:49:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:07 user nova-compute[231753]: DEBUG nova.compute.manager [req-7dfbf763-9442-405f-acba-9b13643544b0 req-ae3f88a2-ff80-42a1-a2ca-3d0714f3ed1a service nova] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Received event network-changed-c940d941-2958-47b0-a186-d56be39e524f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:49:07 user nova-compute[231753]: DEBUG nova.compute.manager [req-7dfbf763-9442-405f-acba-9b13643544b0 req-ae3f88a2-ff80-42a1-a2ca-3d0714f3ed1a service nova] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Refreshing instance network info cache due to event network-changed-c940d941-2958-47b0-a186-d56be39e524f. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:49:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7dfbf763-9442-405f-acba-9b13643544b0 req-ae3f88a2-ff80-42a1-a2ca-3d0714f3ed1a service nova] Acquiring lock "refresh_cache-afd6468c-465d-49c9-b01c-93734f2a3e17" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:49:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7dfbf763-9442-405f-acba-9b13643544b0 req-ae3f88a2-ff80-42a1-a2ca-3d0714f3ed1a service nova] Acquired lock "refresh_cache-afd6468c-465d-49c9-b01c-93734f2a3e17" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:49:07 user nova-compute[231753]: DEBUG nova.network.neutron [req-7dfbf763-9442-405f-acba-9b13643544b0 req-ae3f88a2-ff80-42a1-a2ca-3d0714f3ed1a service nova] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Refreshing network info cache for port c940d941-2958-47b0-a186-d56be39e524f {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:49:08 user nova-compute[231753]: DEBUG nova.network.neutron [req-7dfbf763-9442-405f-acba-9b13643544b0 req-ae3f88a2-ff80-42a1-a2ca-3d0714f3ed1a service nova] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Updated VIF entry in instance network info cache for port c940d941-2958-47b0-a186-d56be39e524f. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:49:08 user nova-compute[231753]: DEBUG nova.network.neutron [req-7dfbf763-9442-405f-acba-9b13643544b0 req-ae3f88a2-ff80-42a1-a2ca-3d0714f3ed1a service nova] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Updating instance_info_cache with network_info: [{"id": "c940d941-2958-47b0-a186-d56be39e524f", "address": "fa:16:3e:ad:34:94", "network": {"id": "e07105bf-cfaf-4a04-be90-27b9f5a1dce1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2002932258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f0063caba494df79d23ee7ab6cca952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc940d941-29", "ovs_interfaceid": "c940d941-2958-47b0-a186-d56be39e524f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:49:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7dfbf763-9442-405f-acba-9b13643544b0 req-ae3f88a2-ff80-42a1-a2ca-3d0714f3ed1a service nova] Releasing lock "refresh_cache-afd6468c-465d-49c9-b01c-93734f2a3e17" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:49:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Acquiring lock "afd6468c-465d-49c9-b01c-93734f2a3e17" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "afd6468c-465d-49c9-b01c-93734f2a3e17" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:08 user nova-compute[231753]: DEBUG nova.objects.instance [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lazy-loading 'flavor' on Instance uuid afd6468c-465d-49c9-b01c-93734f2a3e17 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:49:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "afd6468c-465d-49c9-b01c-93734f2a3e17" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.058s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:08 user nova-compute[231753]: DEBUG nova.objects.instance [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lazy-loading 'flavor' on Instance uuid 8dd26572-fe6a-40fd-8c58-6af862b340c4 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:49:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "refresh_cache-8dd26572-fe6a-40fd-8c58-6af862b340c4" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:49:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquired lock "refresh_cache-8dd26572-fe6a-40fd-8c58-6af862b340c4" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:49:08 user nova-compute[231753]: DEBUG nova.network.neutron [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:49:08 user nova-compute[231753]: DEBUG nova.objects.instance [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lazy-loading 'info_cache' on Instance uuid 8dd26572-fe6a-40fd-8c58-6af862b340c4 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:49:08 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Acquiring lock "afd6468c-465d-49c9-b01c-93734f2a3e17" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "afd6468c-465d-49c9-b01c-93734f2a3e17" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:08 user nova-compute[231753]: INFO nova.compute.manager [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Attaching volume 84f24568-fdbc-447d-bf70-28b6d5ef7477 to /dev/vdb
Jul 29 13:49:09 user nova-compute[231753]: DEBUG os_brick.utils [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa657ad8-f39e-467c-a37f-381cf815e852]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf0bc7ed-9642-449f-8e84-9c9f41f2b39a]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[10c0aea5-f8e0-4740-bc7b-6ebc428e37ec]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ba4fc5e-c7e1-4961-a5ac-4419f23c3b6c]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:49:09 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:49:09 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[74bd4e9b-a6e1-4bb4-8cd7-4de3a520ab23]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG os_brick.utils [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] <== get_connector_properties: return (147ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Updating existing volume attachment record: b215a399-6ece-45a4-af41-0c3ac66ab803 {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG nova.network.neutron [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Updating instance_info_cache with network_info: [{"id": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "address": "fa:16:3e:a7:22:05", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3e2ca8-62", "ovs_interfaceid": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Releasing lock "refresh_cache-8dd26572-fe6a-40fd-8c58-6af862b340c4" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:49:09 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Instance destroyed successfully.
Jul 29 13:49:09 user nova-compute[231753]: DEBUG nova.objects.instance [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lazy-loading 'resources' on Instance uuid 8dd26572-fe6a-40fd-8c58-6af862b340c4 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-307508049',display_name='tempest-AttachVolumeTestJSON-server-307508049',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-307508049',id=25,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoyUAgpcSSQTthO61utyiF8t7eniB6Jq0RtxtqYL+lvLbvmf3WG4z2Y5S66oY+znDIezboeDRUEwg+7djUWhx8vLQF2KnXuxcUYlwL/5sSfLakxOteY7b7lI0VU3lUVUA==',key_name='tempest-keypair-441207824',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:41:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4a8801c6bc4b46ef9b407426c5eb07e0',ramdisk_id='',reservation_id='r-tsz4sxhz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-695592502',owner_user_name='tempest-AttachVolumeTestJSON-695592502-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:47:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df1ccafc63e0418e9889541bb8ecd3d2',uuid=8dd26572-fe6a-40fd-8c58-6af862b340c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "address": "fa:16:3e:a7:22:05", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3e2ca8-62", "ovs_interfaceid": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Converting VIF {"id": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "address": "fa:16:3e:a7:22:05", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3e2ca8-62", "ovs_interfaceid": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:22:05,bridge_name='br-int',has_traffic_filtering=True,id=ef3e2ca8-6228-4cd8-b815-d06cf34e15e0,network=Network(dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef3e2ca8-62') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG os_vif [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:22:05,bridge_name='br-int',has_traffic_filtering=True,id=ef3e2ca8-6228-4cd8-b815-d06cf34e15e0,network=Network(dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef3e2ca8-62') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef3e2ca8-62, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:49:09 user nova-compute[231753]: INFO os_vif [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:22:05,bridge_name='br-int',has_traffic_filtering=True,id=ef3e2ca8-6228-4cd8-b815-d06cf34e15e0,network=Network(dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef3e2ca8-62')
Jul 29 13:49:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Start _get_guest_xml network_info=[{"id": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "address": "fa:16:3e:a7:22:05", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3e2ca8-62", "ovs_interfaceid": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG nova.objects.instance [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lazy-loading 'numa_topology' on Instance uuid 8dd26572-fe6a-40fd-8c58-6af862b340c4 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:49:09 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:49:09 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:49:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format='bare',created_at=<?>,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG nova.objects.instance [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lazy-loading 'vcpu_model' on Instance uuid 8dd26572-fe6a-40fd-8c58-6af862b340c4 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-307508049',display_name='tempest-AttachVolumeTestJSON-server-307508049',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-307508049',id=25,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoyUAgpcSSQTthO61utyiF8t7eniB6Jq0RtxtqYL+lvLbvmf3WG4z2Y5S66oY+znDIezboeDRUEwg+7djUWhx8vLQF2KnXuxcUYlwL/5sSfLakxOteY7b7lI0VU3lUVUA==',key_name='tempest-keypair-441207824',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:41:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=4,progress=0,project_id='4a8801c6bc4b46ef9b407426c5eb07e0',ramdisk_id='',reservation_id='r-tsz4sxhz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-695592502',owner_user_name='tempest-AttachVolumeTestJSON-695592502-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:47:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df1ccafc63e0418e9889541bb8ecd3d2',uuid=8dd26572-fe6a-40fd-8c58-6af862b340c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "address": "fa:16:3e:a7:22:05", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3e2ca8-62", "ovs_interfaceid": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Converting VIF {"id": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "address": "fa:16:3e:a7:22:05", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3e2ca8-62", "ovs_interfaceid": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:22:05,bridge_name='br-int',has_traffic_filtering=True,id=ef3e2ca8-6228-4cd8-b815-d06cf34e15e0,network=Network(dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef3e2ca8-62') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG nova.objects.instance [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lazy-loading 'pci_devices' on Instance uuid 8dd26572-fe6a-40fd-8c58-6af862b340c4 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:49:09 user nova-compute[231753]:   <uuid>8dd26572-fe6a-40fd-8c58-6af862b340c4</uuid>
Jul 29 13:49:09 user nova-compute[231753]:   <name>instance-00000019</name>
Jul 29 13:49:09 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:49:09 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:49:09 user nova-compute[231753]:   <metadata>
Jul 29 13:49:09 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:49:09 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:49:09 user nova-compute[231753]:       <nova:name>tempest-AttachVolumeTestJSON-server-307508049</nova:name>
Jul 29 13:49:09 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:49:09</nova:creationTime>
Jul 29 13:49:09 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:49:09 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:49:09 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:49:09 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:49:09 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:49:09 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:49:09 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:49:09 user nova-compute[231753]:       <nova:owner>
Jul 29 13:49:09 user nova-compute[231753]:         <nova:user uuid="df1ccafc63e0418e9889541bb8ecd3d2">tempest-AttachVolumeTestJSON-695592502-project-member</nova:user>
Jul 29 13:49:09 user nova-compute[231753]:         <nova:project uuid="4a8801c6bc4b46ef9b407426c5eb07e0">tempest-AttachVolumeTestJSON-695592502</nova:project>
Jul 29 13:49:09 user nova-compute[231753]:       </nova:owner>
Jul 29 13:49:09 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:49:09 user nova-compute[231753]:       <nova:ports>
Jul 29 13:49:09 user nova-compute[231753]:         <nova:port uuid="ef3e2ca8-6228-4cd8-b815-d06cf34e15e0">
Jul 29 13:49:09 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 29 13:49:09 user nova-compute[231753]:         </nova:port>
Jul 29 13:49:09 user nova-compute[231753]:       </nova:ports>
Jul 29 13:49:09 user nova-compute[231753]:     </nova:instance>
Jul 29 13:49:09 user nova-compute[231753]:   </metadata>
Jul 29 13:49:09 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:49:09 user nova-compute[231753]:     <system>
Jul 29 13:49:09 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:49:09 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:49:09 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:49:09 user nova-compute[231753]:       <entry name="serial">8dd26572-fe6a-40fd-8c58-6af862b340c4</entry>
Jul 29 13:49:09 user nova-compute[231753]:       <entry name="uuid">8dd26572-fe6a-40fd-8c58-6af862b340c4</entry>
Jul 29 13:49:09 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:49:09 user nova-compute[231753]:     </system>
Jul 29 13:49:09 user nova-compute[231753]:   </sysinfo>
Jul 29 13:49:09 user nova-compute[231753]:   <os>
Jul 29 13:49:09 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:49:09 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:49:09 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:49:09 user nova-compute[231753]:   </os>
Jul 29 13:49:09 user nova-compute[231753]:   <features>
Jul 29 13:49:09 user nova-compute[231753]:     <acpi/>
Jul 29 13:49:09 user nova-compute[231753]:     <apic/>
Jul 29 13:49:09 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:49:09 user nova-compute[231753]:   </features>
Jul 29 13:49:09 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:49:09 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:49:09 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:49:09 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:49:09 user nova-compute[231753]:   </clock>
Jul 29 13:49:09 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:49:09 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:49:09 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:49:09 user nova-compute[231753]:   </cpu>
Jul 29 13:49:09 user nova-compute[231753]:   <devices>
Jul 29 13:49:09 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:49:09 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:49:09 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk"/>
Jul 29 13:49:09 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:49:09 user nova-compute[231753]:     </disk>
Jul 29 13:49:09 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:49:09 user nova-compute[231753]:       <mac address="fa:16:3e:a7:22:05"/>
Jul 29 13:49:09 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:49:09 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:49:09 user nova-compute[231753]:       <target dev="tapef3e2ca8-62"/>
Jul 29 13:49:09 user nova-compute[231753]:     </interface>
Jul 29 13:49:09 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:49:09 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/console.log" append="off"/>
Jul 29 13:49:09 user nova-compute[231753]:     </serial>
Jul 29 13:49:09 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:49:09 user nova-compute[231753]:     <video>
Jul 29 13:49:09 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:49:09 user nova-compute[231753]:     </video>
Jul 29 13:49:09 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:49:09 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:49:09 user nova-compute[231753]:     </rng>
Jul 29 13:49:09 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:49:09 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:49:09 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:49:09 user nova-compute[231753]:     </memballoon>
Jul 29 13:49:09 user nova-compute[231753]:   </devices>
Jul 29 13:49:09 user nova-compute[231753]: </domain>
Jul 29 13:49:09 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG nova.objects.instance [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lazy-loading 'trusted_certs' on Instance uuid 8dd26572-fe6a-40fd-8c58-6af862b340c4 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:49:09 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.170s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:10 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:49:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:10 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:10 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Cannot resize image /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:49:10 user nova-compute[231753]: DEBUG nova.objects.instance [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lazy-loading 'migration_context' on Instance uuid 8dd26572-fe6a-40fd-8c58-6af862b340c4 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:49:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-307508049',display_name='tempest-AttachVolumeTestJSON-server-307508049',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-307508049',id=25,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoyUAgpcSSQTthO61utyiF8t7eniB6Jq0RtxtqYL+lvLbvmf3WG4z2Y5S66oY+znDIezboeDRUEwg+7djUWhx8vLQF2KnXuxcUYlwL/5sSfLakxOteY7b7lI0VU3lUVUA==',key_name='tempest-keypair-441207824',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:41:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=<?>,power_state=4,progress=0,project_id='4a8801c6bc4b46ef9b407426c5eb07e0',ramdisk_id='',reservation_id='r-tsz4sxhz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=<?>,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-695592502',owner_user_name='tempest-AttachVolumeTestJSON-695592502-project-member'},tags=<?>,task_state='powering-on',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:47:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df1ccafc63e0418e9889541bb8ecd3d2',uuid=8dd26572-fe6a-40fd-8c58-6af862b340c4,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='stopped') vif={"id": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "address": "fa:16:3e:a7:22:05", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3e2ca8-62", "ovs_interfaceid": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:49:10 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Converting VIF {"id": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "address": "fa:16:3e:a7:22:05", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3e2ca8-62", "ovs_interfaceid": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:49:10 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:22:05,bridge_name='br-int',has_traffic_filtering=True,id=ef3e2ca8-6228-4cd8-b815-d06cf34e15e0,network=Network(dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef3e2ca8-62') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:49:10 user nova-compute[231753]: DEBUG os_vif [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:22:05,bridge_name='br-int',has_traffic_filtering=True,id=ef3e2ca8-6228-4cd8-b815-d06cf34e15e0,network=Network(dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef3e2ca8-62') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:49:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:49:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:49:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapef3e2ca8-62, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:49:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapef3e2ca8-62, col_values=(('external_ids', {'iface-id': 'ef3e2ca8-6228-4cd8-b815-d06cf34e15e0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a7:22:05', 'vm-uuid': '8dd26572-fe6a-40fd-8c58-6af862b340c4'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:49:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:49:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:10 user nova-compute[231753]: INFO os_vif [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:22:05,bridge_name='br-int',has_traffic_filtering=True,id=ef3e2ca8-6228-4cd8-b815-d06cf34e15e0,network=Network(dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef3e2ca8-62')
Jul 29 13:49:11 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:49:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:11 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 13:49:11 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:11 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:11 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:12 user nova-compute[231753]: DEBUG nova.compute.manager [req-98db1b69-98ae-41d4-b8ba-3297e106305b req-b3857de5-aa21-4f6d-b000-6d8c6b5e330d service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Received event network-vif-plugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:49:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-98db1b69-98ae-41d4-b8ba-3297e106305b req-b3857de5-aa21-4f6d-b000-6d8c6b5e330d service nova] Acquiring lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-98db1b69-98ae-41d4-b8ba-3297e106305b req-b3857de5-aa21-4f6d-b000-6d8c6b5e330d service nova] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-98db1b69-98ae-41d4-b8ba-3297e106305b req-b3857de5-aa21-4f6d-b000-6d8c6b5e330d service nova] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:12 user nova-compute[231753]: DEBUG nova.compute.manager [req-98db1b69-98ae-41d4-b8ba-3297e106305b req-b3857de5-aa21-4f6d-b000-6d8c6b5e330d service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] No waiting events found dispatching network-vif-plugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:49:12 user nova-compute[231753]: WARNING nova.compute.manager [req-98db1b69-98ae-41d4-b8ba-3297e106305b req-b3857de5-aa21-4f6d-b000-6d8c6b5e330d service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Received unexpected event network-vif-plugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 for instance with vm_state stopped and task_state powering-on.
Jul 29 13:49:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json" returned: 0 in 0.178s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:12 user nova-compute[231753]: INFO nova.compute.manager [None req-056cab52-b1ca-473e-a8fd-a72cbfaf4db5 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Unrescuing
Jul 29 13:49:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-056cab52-b1ca-473e-a8fd-a72cbfaf4db5 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "refresh_cache-b9751029-dfed-4342-ad92-9ae53d72fbc1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:49:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-056cab52-b1ca-473e-a8fd-a72cbfaf4db5 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquired lock "refresh_cache-b9751029-dfed-4342-ad92-9ae53d72fbc1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:49:12 user nova-compute[231753]: DEBUG nova.network.neutron [None req-056cab52-b1ca-473e-a8fd-a72cbfaf4db5 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:49:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json" returned: 0 in 0.161s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json" returned: 0 in 0.194s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk.rescue --force-share --output=json" returned: 0 in 0.147s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:13 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk (vdb) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:49:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afd6468c-465d-49c9-b01c-93734f2a3e17/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:13 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afd6468c-465d-49c9-b01c-93734f2a3e17/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afd6468c-465d-49c9-b01c-93734f2a3e17/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afd6468c-465d-49c9-b01c-93734f2a3e17/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:13 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:14 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638554.3116024, 8dd26572-fe6a-40fd-8c58-6af862b340c4 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:49:14 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] VM Resumed (Lifecycle Event)
Jul 29 13:49:14 user nova-compute[231753]: DEBUG nova.compute.manager [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:49:14 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Instance rebooted successfully.
Jul 29 13:49:14 user nova-compute[231753]: DEBUG nova.compute.manager [None req-b26850e6-7607-4ece-8ad3-f71176f1da22 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:49:14 user nova-compute[231753]: DEBUG nova.network.neutron [None req-056cab52-b1ca-473e-a8fd-a72cbfaf4db5 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Updating instance_info_cache with network_info: [{"id": "a25ce12c-a83d-4128-ac1e-62ca02ae31fd", "address": "fa:16:3e:8f:41:ff", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25ce12c-a8", "ovs_interfaceid": "a25ce12c-a83d-4128-ac1e-62ca02ae31fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:49:14 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:49:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json" returned: 0 in 0.175s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-056cab52-b1ca-473e-a8fd-a72cbfaf4db5 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Releasing lock "refresh_cache-b9751029-dfed-4342-ad92-9ae53d72fbc1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:49:14 user nova-compute[231753]: DEBUG nova.objects.instance [None req-056cab52-b1ca-473e-a8fd-a72cbfaf4db5 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lazy-loading 'flavor' on Instance uuid b9751029-dfed-4342-ad92-9ae53d72fbc1 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:49:14 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: stopped, current task_state: powering-on, current DB power_state: 4, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:49:14 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638554.3124359, 8dd26572-fe6a-40fd-8c58-6af862b340c4 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:49:14 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] VM Started (Lifecycle Event)
Jul 29 13:49:14 user nova-compute[231753]: DEBUG nova.compute.manager [req-5c701721-5628-4381-a605-f1d86f4d30fa req-dbad2dcb-8501-4ad2-8169-0067af318074 service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Received event network-vif-plugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:49:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5c701721-5628-4381-a605-f1d86f4d30fa req-dbad2dcb-8501-4ad2-8169-0067af318074 service nova] Acquiring lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5c701721-5628-4381-a605-f1d86f4d30fa req-dbad2dcb-8501-4ad2-8169-0067af318074 service nova] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5c701721-5628-4381-a605-f1d86f4d30fa req-dbad2dcb-8501-4ad2-8169-0067af318074 service nova] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:14 user nova-compute[231753]: DEBUG nova.compute.manager [req-5c701721-5628-4381-a605-f1d86f4d30fa req-dbad2dcb-8501-4ad2-8169-0067af318074 service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] No waiting events found dispatching network-vif-plugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:49:14 user nova-compute[231753]: WARNING nova.compute.manager [req-5c701721-5628-4381-a605-f1d86f4d30fa req-dbad2dcb-8501-4ad2-8169-0067af318074 service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Received unexpected event network-vif-plugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 for instance with vm_state active and task_state None.
Jul 29 13:49:14 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:49:14 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:49:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json" returned: 0 in 0.161s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:15 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Instance destroyed successfully.
Jul 29 13:49:15 user nova-compute[231753]: DEBUG nova.compute.manager [req-87493039-5ac6-4271-b69b-81a035bc6646 req-753f79b4-1634-419c-a329-24182da9ab3c service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Received event network-vif-unplugged-a25ce12c-a83d-4128-ac1e-62ca02ae31fd {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:49:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-87493039-5ac6-4271-b69b-81a035bc6646 req-753f79b4-1634-419c-a329-24182da9ab3c service nova] Acquiring lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-87493039-5ac6-4271-b69b-81a035bc6646 req-753f79b4-1634-419c-a329-24182da9ab3c service nova] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-87493039-5ac6-4271-b69b-81a035bc6646 req-753f79b4-1634-419c-a329-24182da9ab3c service nova] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:15 user nova-compute[231753]: DEBUG nova.compute.manager [req-87493039-5ac6-4271-b69b-81a035bc6646 req-753f79b4-1634-419c-a329-24182da9ab3c service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] No waiting events found dispatching network-vif-unplugged-a25ce12c-a83d-4128-ac1e-62ca02ae31fd {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:49:15 user nova-compute[231753]: WARNING nova.compute.manager [req-87493039-5ac6-4271-b69b-81a035bc6646 req-753f79b4-1634-419c-a329-24182da9ab3c service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Received unexpected event network-vif-unplugged-a25ce12c-a83d-4128-ac1e-62ca02ae31fd for instance with vm_state rescued and task_state unrescuing.
Jul 29 13:49:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:15 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdb (vdb) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:49:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:15 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb/disk --force-share --output=json" returned: 0 in 0.189s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:15 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:49:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.165s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Removed pending event for b9751029-dfed-4342-ad92-9ae53d72fbc1 due to event {{(pid=231753) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638558.8449981, b9751029-dfed-4342-ad92-9ae53d72fbc1 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:49:19 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] VM Resumed (Lifecycle Event)
Jul 29 13:49:19 user nova-compute[231753]: DEBUG nova.compute.manager [req-486d7ecd-2e33-4881-9197-22dfff5f5bf0 req-f8a35924-a1d5-49f8-ad75-ff034257ec6e service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Received event network-vif-plugged-a25ce12c-a83d-4128-ac1e-62ca02ae31fd {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-486d7ecd-2e33-4881-9197-22dfff5f5bf0 req-f8a35924-a1d5-49f8-ad75-ff034257ec6e service nova] Acquiring lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-486d7ecd-2e33-4881-9197-22dfff5f5bf0 req-f8a35924-a1d5-49f8-ad75-ff034257ec6e service nova] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-486d7ecd-2e33-4881-9197-22dfff5f5bf0 req-f8a35924-a1d5-49f8-ad75-ff034257ec6e service nova] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG nova.compute.manager [req-486d7ecd-2e33-4881-9197-22dfff5f5bf0 req-f8a35924-a1d5-49f8-ad75-ff034257ec6e service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] No waiting events found dispatching network-vif-plugged-a25ce12c-a83d-4128-ac1e-62ca02ae31fd {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:49:19 user nova-compute[231753]: WARNING nova.compute.manager [req-486d7ecd-2e33-4881-9197-22dfff5f5bf0 req-f8a35924-a1d5-49f8-ad75-ff034257ec6e service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Received unexpected event network-vif-plugged-a25ce12c-a83d-4128-ac1e-62ca02ae31fd for instance with vm_state rescued and task_state unrescuing.
Jul 29 13:49:19 user nova-compute[231753]: DEBUG nova.compute.manager [req-486d7ecd-2e33-4881-9197-22dfff5f5bf0 req-f8a35924-a1d5-49f8-ad75-ff034257ec6e service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Received event network-vif-plugged-a25ce12c-a83d-4128-ac1e-62ca02ae31fd {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-486d7ecd-2e33-4881-9197-22dfff5f5bf0 req-f8a35924-a1d5-49f8-ad75-ff034257ec6e service nova] Acquiring lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-486d7ecd-2e33-4881-9197-22dfff5f5bf0 req-f8a35924-a1d5-49f8-ad75-ff034257ec6e service nova] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-486d7ecd-2e33-4881-9197-22dfff5f5bf0 req-f8a35924-a1d5-49f8-ad75-ff034257ec6e service nova] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG nova.compute.manager [req-486d7ecd-2e33-4881-9197-22dfff5f5bf0 req-f8a35924-a1d5-49f8-ad75-ff034257ec6e service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] No waiting events found dispatching network-vif-plugged-a25ce12c-a83d-4128-ac1e-62ca02ae31fd {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:49:19 user nova-compute[231753]: WARNING nova.compute.manager [req-486d7ecd-2e33-4881-9197-22dfff5f5bf0 req-f8a35924-a1d5-49f8-ad75-ff034257ec6e service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Received unexpected event network-vif-plugged-a25ce12c-a83d-4128-ac1e-62ca02ae31fd for instance with vm_state rescued and task_state unrescuing.
Jul 29 13:49:19 user nova-compute[231753]: DEBUG nova.compute.manager [req-486d7ecd-2e33-4881-9197-22dfff5f5bf0 req-f8a35924-a1d5-49f8-ad75-ff034257ec6e service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Received event network-vif-plugged-a25ce12c-a83d-4128-ac1e-62ca02ae31fd {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-486d7ecd-2e33-4881-9197-22dfff5f5bf0 req-f8a35924-a1d5-49f8-ad75-ff034257ec6e service nova] Acquiring lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-486d7ecd-2e33-4881-9197-22dfff5f5bf0 req-f8a35924-a1d5-49f8-ad75-ff034257ec6e service nova] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-486d7ecd-2e33-4881-9197-22dfff5f5bf0 req-f8a35924-a1d5-49f8-ad75-ff034257ec6e service nova] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG nova.compute.manager [req-486d7ecd-2e33-4881-9197-22dfff5f5bf0 req-f8a35924-a1d5-49f8-ad75-ff034257ec6e service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] No waiting events found dispatching network-vif-plugged-a25ce12c-a83d-4128-ac1e-62ca02ae31fd {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:49:19 user nova-compute[231753]: WARNING nova.compute.manager [req-486d7ecd-2e33-4881-9197-22dfff5f5bf0 req-f8a35924-a1d5-49f8-ad75-ff034257ec6e service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Received unexpected event network-vif-plugged-a25ce12c-a83d-4128-ac1e-62ca02ae31fd for instance with vm_state rescued and task_state unrescuing.
Jul 29 13:49:19 user nova-compute[231753]: DEBUG nova.compute.manager [None req-056cab52-b1ca-473e-a8fd-a72cbfaf4db5 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TYpEjyer', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:49:19 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:49:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:49:19 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:49:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:49:19 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:19 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:49:19 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:49:19 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=7499MB free_disk=24.97051239013672GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2458301-9856-4149-b611-e569e2cd2613]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:49:19 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:19 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 29 13:49:19 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638558.8465776, b9751029-dfed-4342-ad92-9ae53d72fbc1 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:49:19 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] VM Started (Lifecycle Event)
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce5e328-a595-4ca5-9dc4-46b55a7e77be]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477] added
Jul 29 13:49:19 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d9aedca-50b6-4f41-8399-055c39fc19a5]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda7a995-ffef-4f0f-b3bb-932827544dc9]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TYpEjyer {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v TYpEjyer" returned: 0 in 0.030s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cba173f-3ac7-4efc-910b-e2ba7a8f53d3]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'TYpEjyer'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.036s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[52bba63f-7b0b-4d26-95f1-85492e0554ea]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e739b4a3-a844-444b-b6ef-87af5df27dd5]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:49:19 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:49:19 user nova-compute[231753]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)
Jul 29 13:49:19 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:49:19 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:49:19 user nova-compute[231753]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)
Jul 29 13:49:19 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b46187-e34c-4966-8d16-d524dda8577a]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477, portal: 172.16.0.220,3260]
Jul 29 13:49:19 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477, portal: 172.16.0.220,3260] successful.
Jul 29 13:49:19 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2479798d-f097-45a6-9540-b066174ec207]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba27d54e-86b9-4fef-a706-64ad47fb99c6]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:49:19 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:49:19 user nova-compute[231753]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)
Jul 29 13:49:19 user nova-compute[231753]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 (non-flash)
Jul 29 13:49:19 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:49:19 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:49:19 user nova-compute[231753]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)
Jul 29 13:49:19 user nova-compute[231753]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 (non-flash)
Jul 29 13:49:19 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.381s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] HCTL ('34', '-', '-', 0) found on session 38 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2abd2297-fca9-43e0-8ddf-03900278f7cc]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Searching for a device in session 38 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TYpEjyer', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 7e2615c1-b03e-4076-bcd9-3585fb11b8ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8ea52d41-7ec3-44d7-8421-133000ee887b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance cf326e80-7293-4764-9411-ed05a5aeba23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b99a72ba-73e2-4be7-b52b-7797351daa5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8dd26572-fe6a-40fd-8c58-6af862b340c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance aee15bbf-4d52-4611-9e75-6443c2384913 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b9751029-dfed-4342-ad92-9ae53d72fbc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b6be450b-ebe7-4385-b162-2d072237aa97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance afd6468c-465d-49c9-b01c-93734f2a3e17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 10 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=5632MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=10 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Refreshing inventories for resource provider 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Updating ProviderTree inventory for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Updating inventory in ProviderTree for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Refreshing aggregate associations for resource provider 222db5c7-e17f-4307-968d-4284bf5c19f4, aggregates: None {{(pid=231753) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 29 13:49:19 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Refreshing trait associations for resource provider 222db5c7-e17f-4307-968d-4284bf5c19f4, traits: HW_CPU_X86_SSSE3,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_VIRTIO {{(pid=231753) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 29 13:49:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:20 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:49:20 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:49:20 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 13:49:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.123s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:20 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:49:20 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Cleaning up deleted instances {{(pid=231753) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 29 13:49:20 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] There are 0 instances to clean {{(pid=231753) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 29 13:49:20 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:49:20 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Cleaning up deleted instances with incomplete migration  {{(pid=231753) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 29 13:49:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.418s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:49:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] <== connect_volume: return (1420ms) {'type': 'block', 'scsi_wwn': '23333663932643336', 'path': '/dev/sdc'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:49:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23333663932643336', 'path': '/dev/sdc'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:49:20 user nova-compute[231753]: DEBUG nova.objects.instance [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lazy-loading 'flavor' on Instance uuid afd6468c-465d-49c9-b01c-93734f2a3e17 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:49:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 13:49:20 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:49:20 user nova-compute[231753]:   <source dev="/dev/sdc"/>
Jul 29 13:49:20 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:49:20 user nova-compute[231753]:   <serial>84f24568-fdbc-447d-bf70-28b6d5ef7477</serial>
Jul 29 13:49:20 user nova-compute[231753]: </disk>
Jul 29 13:49:20 user nova-compute[231753]:  {{(pid=231753) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 13:49:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:49:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] No BDM found with device name vdb, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:49:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] No VIF found with MAC fa:16:3e:ad:34:94, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:49:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8dcf5551-6434-4d64-858a-af8200135441 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "afd6468c-465d-49c9-b01c-93734f2a3e17" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 12.393s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:22 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:49:22 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:49:22 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:49:22 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 13:49:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "refresh_cache-8ea52d41-7ec3-44d7-8421-133000ee887b" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:49:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquired lock "refresh_cache-8ea52d41-7ec3-44d7-8421-133000ee887b" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:49:22 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Forcefully refreshing network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 13:49:23 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Updating instance_info_cache with network_info: [{"id": "4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b", "address": "fa:16:3e:33:76:ce", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed7b5c5-f0", "ovs_interfaceid": "4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:49:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Releasing lock "refresh_cache-8ea52d41-7ec3-44d7-8421-133000ee887b" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:49:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Updated the network info_cache for instance {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 13:49:23 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:49:23 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:49:23 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:49:23 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:49:23 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:49:23 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:49:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 13:49:23 user nova-compute[231753]: DEBUG nova.compute.manager [req-b3416e14-9c91-4526-81dd-1194507952d0 req-3a811827-03d3-4c7c-8e59-b868d141f29f service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Received event network-changed-351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:49:23 user nova-compute[231753]: DEBUG nova.compute.manager [req-b3416e14-9c91-4526-81dd-1194507952d0 req-3a811827-03d3-4c7c-8e59-b868d141f29f service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Refreshing instance network info cache due to event network-changed-351f3080-98ce-4f1f-a53f-d4415327255f. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:49:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b3416e14-9c91-4526-81dd-1194507952d0 req-3a811827-03d3-4c7c-8e59-b868d141f29f service nova] Acquiring lock "refresh_cache-aee15bbf-4d52-4611-9e75-6443c2384913" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:49:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b3416e14-9c91-4526-81dd-1194507952d0 req-3a811827-03d3-4c7c-8e59-b868d141f29f service nova] Acquired lock "refresh_cache-aee15bbf-4d52-4611-9e75-6443c2384913" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:49:23 user nova-compute[231753]: DEBUG nova.network.neutron [req-b3416e14-9c91-4526-81dd-1194507952d0 req-3a811827-03d3-4c7c-8e59-b868d141f29f service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Refreshing network info cache for port 351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:49:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:24 user nova-compute[231753]: DEBUG nova.network.neutron [req-b3416e14-9c91-4526-81dd-1194507952d0 req-3a811827-03d3-4c7c-8e59-b868d141f29f service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Updated VIF entry in instance network info cache for port 351f3080-98ce-4f1f-a53f-d4415327255f. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:49:24 user nova-compute[231753]: DEBUG nova.network.neutron [req-b3416e14-9c91-4526-81dd-1194507952d0 req-3a811827-03d3-4c7c-8e59-b868d141f29f service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Updating instance_info_cache with network_info: [{"id": "351f3080-98ce-4f1f-a53f-d4415327255f", "address": "fa:16:3e:ae:ff:c5", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.68", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351f3080-98", "ovs_interfaceid": "351f3080-98ce-4f1f-a53f-d4415327255f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:49:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b3416e14-9c91-4526-81dd-1194507952d0 req-3a811827-03d3-4c7c-8e59-b868d141f29f service nova] Releasing lock "refresh_cache-aee15bbf-4d52-4611-9e75-6443c2384913" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:49:25 user nova-compute[231753]: DEBUG nova.compute.manager [req-7136e2aa-4fd6-4259-825e-4388f582cd0d req-8a64271a-ec50-43c4-a26e-257a0f53de52 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Received event network-changed-351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:49:25 user nova-compute[231753]: DEBUG nova.compute.manager [req-7136e2aa-4fd6-4259-825e-4388f582cd0d req-8a64271a-ec50-43c4-a26e-257a0f53de52 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Refreshing instance network info cache due to event network-changed-351f3080-98ce-4f1f-a53f-d4415327255f. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:49:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7136e2aa-4fd6-4259-825e-4388f582cd0d req-8a64271a-ec50-43c4-a26e-257a0f53de52 service nova] Acquiring lock "refresh_cache-aee15bbf-4d52-4611-9e75-6443c2384913" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:49:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7136e2aa-4fd6-4259-825e-4388f582cd0d req-8a64271a-ec50-43c4-a26e-257a0f53de52 service nova] Acquired lock "refresh_cache-aee15bbf-4d52-4611-9e75-6443c2384913" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:49:25 user nova-compute[231753]: DEBUG nova.network.neutron [req-7136e2aa-4fd6-4259-825e-4388f582cd0d req-8a64271a-ec50-43c4-a26e-257a0f53de52 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Refreshing network info cache for port 351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:49:25 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:49:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-265b26f0-3e67-4743-ae84-7a69bbda9fa4 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "aee15bbf-4d52-4611-9e75-6443c2384913" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-265b26f0-3e67-4743-ae84-7a69bbda9fa4 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "aee15bbf-4d52-4611-9e75-6443c2384913" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:25 user nova-compute[231753]: INFO nova.compute.manager [None req-265b26f0-3e67-4743-ae84-7a69bbda9fa4 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Detaching volume f522e219-aad8-4eb2-b6e6-5cceb04ba4c4
Jul 29 13:49:25 user nova-compute[231753]: INFO nova.virt.block_device [None req-265b26f0-3e67-4743-ae84-7a69bbda9fa4 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Attempting to driver detach volume f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 from mountpoint /dev/vdb
Jul 29 13:49:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-265b26f0-3e67-4743-ae84-7a69bbda9fa4 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Attempting to detach device vdb from instance aee15bbf-4d52-4611-9e75-6443c2384913 from the persistent domain config. {{(pid=231753) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 13:49:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-265b26f0-3e67-4743-ae84-7a69bbda9fa4 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:49:25 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:49:25 user nova-compute[231753]:   <source dev="/dev/sdb"/>
Jul 29 13:49:25 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:49:25 user nova-compute[231753]:   <serial>f522e219-aad8-4eb2-b6e6-5cceb04ba4c4</serial>
Jul 29 13:49:25 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 29 13:49:25 user nova-compute[231753]: </disk>
Jul 29 13:49:25 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:49:25 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-265b26f0-3e67-4743-ae84-7a69bbda9fa4 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Successfully detached device vdb from instance aee15bbf-4d52-4611-9e75-6443c2384913 from the persistent domain config.
Jul 29 13:49:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-265b26f0-3e67-4743-ae84-7a69bbda9fa4 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance aee15bbf-4d52-4611-9e75-6443c2384913 from the live domain config. {{(pid=231753) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 13:49:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-265b26f0-3e67-4743-ae84-7a69bbda9fa4 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:49:25 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:49:25 user nova-compute[231753]:   <source dev="/dev/sdb"/>
Jul 29 13:49:25 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:49:25 user nova-compute[231753]:   <serial>f522e219-aad8-4eb2-b6e6-5cceb04ba4c4</serial>
Jul 29 13:49:25 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x05" function="0x0"/>
Jul 29 13:49:25 user nova-compute[231753]: </disk>
Jul 29 13:49:25 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG nova.network.neutron [req-7136e2aa-4fd6-4259-825e-4388f582cd0d req-8a64271a-ec50-43c4-a26e-257a0f53de52 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Updated VIF entry in instance network info cache for port 351f3080-98ce-4f1f-a53f-d4415327255f. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG nova.network.neutron [req-7136e2aa-4fd6-4259-825e-4388f582cd0d req-8a64271a-ec50-43c4-a26e-257a0f53de52 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Updating instance_info_cache with network_info: [{"id": "351f3080-98ce-4f1f-a53f-d4415327255f", "address": "fa:16:3e:ae:ff:c5", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351f3080-98", "ovs_interfaceid": "351f3080-98ce-4f1f-a53f-d4415327255f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7136e2aa-4fd6-4259-825e-4388f582cd0d req-8a64271a-ec50-43c4-a26e-257a0f53de52 service nova] Releasing lock "refresh_cache-aee15bbf-4d52-4611-9e75-6443c2384913" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Received event <DeviceRemovedEvent: 1690638566.162309, aee15bbf-4d52-4611-9e75-6443c2384913 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=231753) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-265b26f0-3e67-4743-ae84-7a69bbda9fa4 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance aee15bbf-4d52-4611-9e75-6443c2384913 {{(pid=231753) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 13:49:26 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-265b26f0-3e67-4743-ae84-7a69bbda9fa4 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Successfully detached device vdb from instance aee15bbf-4d52-4611-9e75-6443c2384913 from the live domain config.
Jul 29 13:49:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-265b26f0-3e67-4743-ae84-7a69bbda9fa4 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-265b26f0-3e67-4743-ae84-7a69bbda9fa4 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tZBkfiDa', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:49:26 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-265b26f0-3e67-4743-ae84-7a69bbda9fa4 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:49:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-265b26f0-3e67-4743-ae84-7a69bbda9fa4 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-265b26f0-3e67-4743-ae84-7a69bbda9fa4 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[96c19617-a0a5-4be8-aeb0-a5d5a5af3f06]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-265b26f0-3e67-4743-ae84-7a69bbda9fa4 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:49:26 user nova-compute[231753]: No targets found.
Jul 29 13:49:26 user nova-compute[231753]: iSNS:
Jul 29 13:49:26 user nova-compute[231753]: No targets found.
Jul 29 13:49:26 user nova-compute[231753]: STATIC:
Jul 29 13:49:26 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea
Jul 29 13:49:26 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:49:26 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:49:26 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4
Jul 29 13:49:26 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:49:26 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:49:26 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477
Jul 29 13:49:26 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:49:26 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:49:26 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43
Jul 29 13:49:26 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:49:26 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:49:26 user nova-compute[231753]: FIRMWARE:
Jul 29 13:49:26 user nova-compute[231753]: No targets found.
Jul 29 13:49:26 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-265b26f0-3e67-4743-ae84-7a69bbda9fa4 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:49:26 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:49:26 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-265b26f0-3e67-4743-ae84-7a69bbda9fa4 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[21b5c666-0a36-4ea0-8dfe-45ced2bd3f66]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a078fc9-b7b5-48c0-94df-6387a02d0e4d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)\ntcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-265b26f0-3e67-4743-ae84-7a69bbda9fa4 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:49:26 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:49:26 user nova-compute[231753]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)
Jul 29 13:49:26 user nova-compute[231753]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 (non-flash)
Jul 29 13:49:26 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-265b26f0-3e67-4743-ae84-7a69bbda9fa4 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:49:26 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:49:26 user nova-compute[231753]: tcp: [36] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 (non-flash)
Jul 29 13:49:26 user nova-compute[231753]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 (non-flash)
Jul 29 13:49:26 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-265b26f0-3e67-4743-ae84-7a69bbda9fa4 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c80347520>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4'): ({'sdb'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-265b26f0-3e67-4743-ae84-7a69bbda9fa4 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Removing single pathed devices sdb {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.030s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[79c4f173-c878-4549-a722-d415ebbad00d]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d021f0e1-1778-48d7-a7b6-577cd1f56bef]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-265b26f0-3e67-4743-ae84-7a69bbda9fa4 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Flushing IO for device /dev/sdb {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Acquiring lock "afd6468c-465d-49c9-b01c-93734f2a3e17" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "afd6468c-465d-49c9-b01c-93734f2a3e17" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[33ea47a6-593a-40ab-b643-b7f2ab4ba34a]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-265b26f0-3e67-4743-ae84-7a69bbda9fa4 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG nova.objects.instance [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lazy-loading 'flavor' on Instance uuid afd6468c-465d-49c9-b01c-93734f2a3e17 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[adedcda8-e83a-449f-a164-b12cee12e86c]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-265b26f0-3e67-4743-ae84-7a69bbda9fa4 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-265b26f0-3e67-4743-ae84-7a69bbda9fa4 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] SCSI volumes sdb have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-265b26f0-3e67-4743-ae84-7a69bbda9fa4 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "afd6468c-465d-49c9-b01c-93734f2a3e17" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.077s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.031s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7bd6766b-adde-435e-a333-9b58142873ce]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-265b26f0-3e67-4743-ae84-7a69bbda9fa4 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --logout" returned: 0 in 0.070s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d11631e-b809-401c-858f-ccb07d5c45a6]: (4, ('Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4, portal: 172.16.0.220,3260]\nLogout of [sid: 36, target: iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-265b26f0-3e67-4743-ae84-7a69bbda9fa4 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4, portal: 172.16.0.220,3260]
Jul 29 13:49:26 user nova-compute[231753]: Logout of [sid: 36, target: iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4, portal: 172.16.0.220,3260] successful.
Jul 29 13:49:26 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f522e219-aad8-4eb2-b6e6-5cceb04ba4c4 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.056s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4c8c300-b7b7-4c35-9d47-0dab0442fc64]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-265b26f0-3e67-4743-ae84-7a69bbda9fa4 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-265b26f0-3e67-4743-ae84-7a69bbda9fa4 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.402s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-265b26f0-3e67-4743-ae84-7a69bbda9fa4 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] <== disconnect_volume: return (403ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-265b26f0-3e67-4743-ae84-7a69bbda9fa4 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Acquiring lock "afd6468c-465d-49c9-b01c-93734f2a3e17" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "afd6468c-465d-49c9-b01c-93734f2a3e17" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:26 user nova-compute[231753]: INFO nova.compute.manager [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Attaching volume b07f2c3a-93cb-4bff-a6d6-8ef363cefb36 to /dev/vdc
Jul 29 13:49:27 user nova-compute[231753]: DEBUG os_brick.utils [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:49:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e62c7716-7d5c-435f-8887-01efc1348ad1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0710200b-b65a-450c-8ef6-836756511ff7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ce9a9f7-cbb5-455b-8a72-81844fb3cdb6]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fcd3f7b-3221-48f2-b1d0-929f9515f666]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:49:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:49:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:49:27 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:49:27 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ea6846-3a08-41bb-9712-688ff2cfea24]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:49:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:49:27 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:49:27 user nova-compute[231753]: DEBUG os_brick.utils [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] <== get_connector_properties: return (126ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:49:27 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Updating existing volume attachment record: cd2d10c2-b64d-4adc-a4ad-4e556621e868 {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:49:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "02501ee9-0dc6-4aa3-8fb8-055bb2989617" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "02501ee9-0dc6-4aa3-8fb8-055bb2989617" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:29 user nova-compute[231753]: DEBUG nova.compute.manager [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:49:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:29 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:49:29 user nova-compute[231753]: INFO nova.compute.claims [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Claim successful on node user
Jul 29 13:49:29 user nova-compute[231753]: DEBUG nova.objects.instance [None req-265b26f0-3e67-4743-ae84-7a69bbda9fa4 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lazy-loading 'flavor' on Instance uuid aee15bbf-4d52-4611-9e75-6443c2384913 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:49:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-265b26f0-3e67-4743-ae84-7a69bbda9fa4 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "aee15bbf-4d52-4611-9e75-6443c2384913" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 4.459s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:29 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:49:29 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:49:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.517s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:29 user nova-compute[231753]: DEBUG nova.compute.manager [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:49:30 user nova-compute[231753]: DEBUG nova.compute.manager [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:49:30 user nova-compute[231753]: DEBUG nova.network.neutron [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:49:30 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:49:30 user nova-compute[231753]: DEBUG nova.compute.manager [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:49:30 user nova-compute[231753]: DEBUG nova.policy [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a09de75c8ab742fe951604b612ea5839', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f3122196c4504a82a2a01774ab60406a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:49:30 user nova-compute[231753]: DEBUG nova.compute.manager [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:49:30 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:49:30 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Creating image(s)
Jul 29 13:49:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "/opt/stack/data/nova/instances/02501ee9-0dc6-4aa3-8fb8-055bb2989617/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "/opt/stack/data/nova/instances/02501ee9-0dc6-4aa3-8fb8-055bb2989617/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "/opt/stack/data/nova/instances/02501ee9-0dc6-4aa3-8fb8-055bb2989617/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:30 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:30 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.158s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.148s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/02501ee9-0dc6-4aa3-8fb8-055bb2989617/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/02501ee9-0dc6-4aa3-8fb8-055bb2989617/disk 1073741824" returned: 0 in 0.063s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.220s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.138s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:30 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Checking if we can resize image /opt/stack/data/nova/instances/02501ee9-0dc6-4aa3-8fb8-055bb2989617/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:49:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02501ee9-0dc6-4aa3-8fb8-055bb2989617/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02501ee9-0dc6-4aa3-8fb8-055bb2989617/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:30 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Cannot resize image /opt/stack/data/nova/instances/02501ee9-0dc6-4aa3-8fb8-055bb2989617/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:49:30 user nova-compute[231753]: DEBUG nova.objects.instance [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lazy-loading 'migration_context' on Instance uuid 02501ee9-0dc6-4aa3-8fb8-055bb2989617 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:49:30 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:49:30 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Ensure instance console log exists: /opt/stack/data/nova/instances/02501ee9-0dc6-4aa3-8fb8-055bb2989617/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:49:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:31 user nova-compute[231753]: DEBUG nova.network.neutron [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Successfully created port: 5efea429-64cb-4dde-aa19-0b5152a03181 {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG nova.network.neutron [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Successfully updated port: 5efea429-64cb-4dde-aa19-0b5152a03181 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "refresh_cache-02501ee9-0dc6-4aa3-8fb8-055bb2989617" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquired lock "refresh_cache-02501ee9-0dc6-4aa3-8fb8-055bb2989617" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG nova.network.neutron [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG nova.compute.manager [req-cd255dd0-5d56-4930-8693-310844293761 req-e2b08c91-49da-4801-9d54-bc7bf444bab4 service nova] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Received event network-changed-5efea429-64cb-4dde-aa19-0b5152a03181 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG nova.compute.manager [req-cd255dd0-5d56-4930-8693-310844293761 req-e2b08c91-49da-4801-9d54-bc7bf444bab4 service nova] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Refreshing instance network info cache due to event network-changed-5efea429-64cb-4dde-aa19-0b5152a03181. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-cd255dd0-5d56-4930-8693-310844293761 req-e2b08c91-49da-4801-9d54-bc7bf444bab4 service nova] Acquiring lock "refresh_cache-02501ee9-0dc6-4aa3-8fb8-055bb2989617" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG nova.network.neutron [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG nova.network.neutron [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Updating instance_info_cache with network_info: [{"id": "5efea429-64cb-4dde-aa19-0b5152a03181", "address": "fa:16:3e:eb:f5:54", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5efea429-64", "ovs_interfaceid": "5efea429-64cb-4dde-aa19-0b5152a03181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Releasing lock "refresh_cache-02501ee9-0dc6-4aa3-8fb8-055bb2989617" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG nova.compute.manager [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Instance network_info: |[{"id": "5efea429-64cb-4dde-aa19-0b5152a03181", "address": "fa:16:3e:eb:f5:54", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5efea429-64", "ovs_interfaceid": "5efea429-64cb-4dde-aa19-0b5152a03181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-cd255dd0-5d56-4930-8693-310844293761 req-e2b08c91-49da-4801-9d54-bc7bf444bab4 service nova] Acquired lock "refresh_cache-02501ee9-0dc6-4aa3-8fb8-055bb2989617" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG nova.network.neutron [req-cd255dd0-5d56-4930-8693-310844293761 req-e2b08c91-49da-4801-9d54-bc7bf444bab4 service nova] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Refreshing network info cache for port 5efea429-64cb-4dde-aa19-0b5152a03181 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Start _get_guest_xml network_info=[{"id": "5efea429-64cb-4dde-aa19-0b5152a03181", "address": "fa:16:3e:eb:f5:54", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5efea429-64", "ovs_interfaceid": "5efea429-64cb-4dde-aa19-0b5152a03181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:49:32 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:49:32 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:49:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:49:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-816449773',display_name='tempest-AttachVolumeNegativeTest-server-816449773',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-816449773',id=34,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkXD9yc60vb4MNT0cCgAfpCMu1Q/Vk2JAMb3utpRZEkQ8MV1TPiwL3OV1ALNn2/4ikHvB816sQq9uvqyOJXuP14Lzcz8qU3UV+UrBc2J19/0nTOkYNkfwVv7BSwrnyweQ==',key_name='tempest-keypair-2018580862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3122196c4504a82a2a01774ab60406a',ramdisk_id='',reservation_id='r-87tl7djz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1031975907',owner_user_name='tempest-AttachVolumeNegativeTest-1031975907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:49:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a09de75c8ab742fe951604b612ea5839',uuid=02501ee9-0dc6-4aa3-8fb8-055bb2989617,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5efea429-64cb-4dde-aa19-0b5152a03181", "address": "fa:16:3e:eb:f5:54", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5efea429-64", "ovs_interfaceid": "5efea429-64cb-4dde-aa19-0b5152a03181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Converting VIF {"id": "5efea429-64cb-4dde-aa19-0b5152a03181", "address": "fa:16:3e:eb:f5:54", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5efea429-64", "ovs_interfaceid": "5efea429-64cb-4dde-aa19-0b5152a03181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:f5:54,bridge_name='br-int',has_traffic_filtering=True,id=5efea429-64cb-4dde-aa19-0b5152a03181,network=Network(1ff03660-77ea-4ec6-8eeb-55df7e78096b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5efea429-64') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG nova.objects.instance [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lazy-loading 'pci_devices' on Instance uuid 02501ee9-0dc6-4aa3-8fb8-055bb2989617 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:49:32 user nova-compute[231753]:   <uuid>02501ee9-0dc6-4aa3-8fb8-055bb2989617</uuid>
Jul 29 13:49:32 user nova-compute[231753]:   <name>instance-00000022</name>
Jul 29 13:49:32 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:49:32 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:49:32 user nova-compute[231753]:   <metadata>
Jul 29 13:49:32 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:49:32 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:49:32 user nova-compute[231753]:       <nova:name>tempest-AttachVolumeNegativeTest-server-816449773</nova:name>
Jul 29 13:49:32 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:49:32</nova:creationTime>
Jul 29 13:49:32 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:49:32 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:49:32 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:49:32 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:49:32 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:49:32 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:49:32 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:49:32 user nova-compute[231753]:       <nova:owner>
Jul 29 13:49:32 user nova-compute[231753]:         <nova:user uuid="a09de75c8ab742fe951604b612ea5839">tempest-AttachVolumeNegativeTest-1031975907-project-member</nova:user>
Jul 29 13:49:32 user nova-compute[231753]:         <nova:project uuid="f3122196c4504a82a2a01774ab60406a">tempest-AttachVolumeNegativeTest-1031975907</nova:project>
Jul 29 13:49:32 user nova-compute[231753]:       </nova:owner>
Jul 29 13:49:32 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:49:32 user nova-compute[231753]:       <nova:ports>
Jul 29 13:49:32 user nova-compute[231753]:         <nova:port uuid="5efea429-64cb-4dde-aa19-0b5152a03181">
Jul 29 13:49:32 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 29 13:49:32 user nova-compute[231753]:         </nova:port>
Jul 29 13:49:32 user nova-compute[231753]:       </nova:ports>
Jul 29 13:49:32 user nova-compute[231753]:     </nova:instance>
Jul 29 13:49:32 user nova-compute[231753]:   </metadata>
Jul 29 13:49:32 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:49:32 user nova-compute[231753]:     <system>
Jul 29 13:49:32 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:49:32 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:49:32 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:49:32 user nova-compute[231753]:       <entry name="serial">02501ee9-0dc6-4aa3-8fb8-055bb2989617</entry>
Jul 29 13:49:32 user nova-compute[231753]:       <entry name="uuid">02501ee9-0dc6-4aa3-8fb8-055bb2989617</entry>
Jul 29 13:49:32 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:49:32 user nova-compute[231753]:     </system>
Jul 29 13:49:32 user nova-compute[231753]:   </sysinfo>
Jul 29 13:49:32 user nova-compute[231753]:   <os>
Jul 29 13:49:32 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:49:32 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:49:32 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:49:32 user nova-compute[231753]:   </os>
Jul 29 13:49:32 user nova-compute[231753]:   <features>
Jul 29 13:49:32 user nova-compute[231753]:     <acpi/>
Jul 29 13:49:32 user nova-compute[231753]:     <apic/>
Jul 29 13:49:32 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:49:32 user nova-compute[231753]:   </features>
Jul 29 13:49:32 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:49:32 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:49:32 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:49:32 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:49:32 user nova-compute[231753]:   </clock>
Jul 29 13:49:32 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:49:32 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:49:32 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:49:32 user nova-compute[231753]:   </cpu>
Jul 29 13:49:32 user nova-compute[231753]:   <devices>
Jul 29 13:49:32 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:49:32 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:49:32 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/02501ee9-0dc6-4aa3-8fb8-055bb2989617/disk"/>
Jul 29 13:49:32 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:49:32 user nova-compute[231753]:     </disk>
Jul 29 13:49:32 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:49:32 user nova-compute[231753]:       <mac address="fa:16:3e:eb:f5:54"/>
Jul 29 13:49:32 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:49:32 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:49:32 user nova-compute[231753]:       <target dev="tap5efea429-64"/>
Jul 29 13:49:32 user nova-compute[231753]:     </interface>
Jul 29 13:49:32 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:49:32 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/02501ee9-0dc6-4aa3-8fb8-055bb2989617/console.log" append="off"/>
Jul 29 13:49:32 user nova-compute[231753]:     </serial>
Jul 29 13:49:32 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:49:32 user nova-compute[231753]:     <video>
Jul 29 13:49:32 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:49:32 user nova-compute[231753]:     </video>
Jul 29 13:49:32 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:49:32 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:49:32 user nova-compute[231753]:     </rng>
Jul 29 13:49:32 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:49:32 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:49:32 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:49:32 user nova-compute[231753]:     </memballoon>
Jul 29 13:49:32 user nova-compute[231753]:   </devices>
Jul 29 13:49:32 user nova-compute[231753]: </domain>
Jul 29 13:49:32 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:49:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-816449773',display_name='tempest-AttachVolumeNegativeTest-server-816449773',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-816449773',id=34,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkXD9yc60vb4MNT0cCgAfpCMu1Q/Vk2JAMb3utpRZEkQ8MV1TPiwL3OV1ALNn2/4ikHvB816sQq9uvqyOJXuP14Lzcz8qU3UV+UrBc2J19/0nTOkYNkfwVv7BSwrnyweQ==',key_name='tempest-keypair-2018580862',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f3122196c4504a82a2a01774ab60406a',ramdisk_id='',reservation_id='r-87tl7djz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeNegativeTest-1031975907',owner_user_name='tempest-AttachVolumeNegativeTest-1031975907-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:49:30Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a09de75c8ab742fe951604b612ea5839',uuid=02501ee9-0dc6-4aa3-8fb8-055bb2989617,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "5efea429-64cb-4dde-aa19-0b5152a03181", "address": "fa:16:3e:eb:f5:54", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5efea429-64", "ovs_interfaceid": "5efea429-64cb-4dde-aa19-0b5152a03181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Converting VIF {"id": "5efea429-64cb-4dde-aa19-0b5152a03181", "address": "fa:16:3e:eb:f5:54", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5efea429-64", "ovs_interfaceid": "5efea429-64cb-4dde-aa19-0b5152a03181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:eb:f5:54,bridge_name='br-int',has_traffic_filtering=True,id=5efea429-64cb-4dde-aa19-0b5152a03181,network=Network(1ff03660-77ea-4ec6-8eeb-55df7e78096b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5efea429-64') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG os_vif [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:f5:54,bridge_name='br-int',has_traffic_filtering=True,id=5efea429-64cb-4dde-aa19-0b5152a03181,network=Network(1ff03660-77ea-4ec6-8eeb-55df7e78096b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5efea429-64') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap5efea429-64, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap5efea429-64, col_values=(('external_ids', {'iface-id': '5efea429-64cb-4dde-aa19-0b5152a03181', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:eb:f5:54', 'vm-uuid': '02501ee9-0dc6-4aa3-8fb8-055bb2989617'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:49:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:33 user nova-compute[231753]: INFO os_vif [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:eb:f5:54,bridge_name='br-int',has_traffic_filtering=True,id=5efea429-64cb-4dde-aa19-0b5152a03181,network=Network(1ff03660-77ea-4ec6-8eeb-55df7e78096b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5efea429-64')
Jul 29 13:49:33 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:49:33 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] No VIF found with MAC fa:16:3e:eb:f5:54, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:49:33 user nova-compute[231753]: DEBUG nova.network.neutron [req-cd255dd0-5d56-4930-8693-310844293761 req-e2b08c91-49da-4801-9d54-bc7bf444bab4 service nova] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Updated VIF entry in instance network info cache for port 5efea429-64cb-4dde-aa19-0b5152a03181. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:49:33 user nova-compute[231753]: DEBUG nova.network.neutron [req-cd255dd0-5d56-4930-8693-310844293761 req-e2b08c91-49da-4801-9d54-bc7bf444bab4 service nova] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Updating instance_info_cache with network_info: [{"id": "5efea429-64cb-4dde-aa19-0b5152a03181", "address": "fa:16:3e:eb:f5:54", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5efea429-64", "ovs_interfaceid": "5efea429-64cb-4dde-aa19-0b5152a03181", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:49:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-cd255dd0-5d56-4930-8693-310844293761 req-e2b08c91-49da-4801-9d54-bc7bf444bab4 service nova] Releasing lock "refresh_cache-02501ee9-0dc6-4aa3-8fb8-055bb2989617" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:49:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:34 user nova-compute[231753]: DEBUG nova.compute.manager [req-d843f8a1-d083-4ab7-b02a-7161d2420913 req-e690cd8e-c8bc-4b91-9d9e-6bacaa52a8a4 service nova] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Received event network-vif-plugged-5efea429-64cb-4dde-aa19-0b5152a03181 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:49:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d843f8a1-d083-4ab7-b02a-7161d2420913 req-e690cd8e-c8bc-4b91-9d9e-6bacaa52a8a4 service nova] Acquiring lock "02501ee9-0dc6-4aa3-8fb8-055bb2989617-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d843f8a1-d083-4ab7-b02a-7161d2420913 req-e690cd8e-c8bc-4b91-9d9e-6bacaa52a8a4 service nova] Lock "02501ee9-0dc6-4aa3-8fb8-055bb2989617-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d843f8a1-d083-4ab7-b02a-7161d2420913 req-e690cd8e-c8bc-4b91-9d9e-6bacaa52a8a4 service nova] Lock "02501ee9-0dc6-4aa3-8fb8-055bb2989617-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:34 user nova-compute[231753]: DEBUG nova.compute.manager [req-d843f8a1-d083-4ab7-b02a-7161d2420913 req-e690cd8e-c8bc-4b91-9d9e-6bacaa52a8a4 service nova] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] No waiting events found dispatching network-vif-plugged-5efea429-64cb-4dde-aa19-0b5152a03181 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:49:34 user nova-compute[231753]: WARNING nova.compute.manager [req-d843f8a1-d083-4ab7-b02a-7161d2420913 req-e690cd8e-c8bc-4b91-9d9e-6bacaa52a8a4 service nova] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Received unexpected event network-vif-plugged-5efea429-64cb-4dde-aa19-0b5152a03181 for instance with vm_state building and task_state spawning.
Jul 29 13:49:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jHLYSViz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:49:35 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:49:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:49:35 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:49:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:49:35 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:49:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36 -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36 -p 172.16.0.220:3260" returned: 21 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ea120f3-2a3e-42aa-bff2-c6ae0b8b32c3]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:49:35 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36 -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4c0b6b5-4334-4283-9628-d45f1bc76ddb]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36] added
Jul 29 13:49:35 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.027s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f558019c-6ae8-4526-a847-b5de2e4eb209]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.036s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ca8d3af-1238-475b-8de1-37c2034f9856]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jHLYSViz {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jHLYSViz" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60533a0-089a-400e-b860-705ef9005bb5]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jHLYSViz'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[403104eb-e6d6-41ae-ac61-3a9ff88ae902]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[618fa064-cb77-40e3-8592-2a8d72010cf9]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:49:35 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:49:35 user nova-compute[231753]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 (non-flash)
Jul 29 13:49:35 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:49:35 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:49:35 user nova-compute[231753]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 (non-flash)
Jul 29 13:49:35 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36 -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36 -p 172.16.0.220:3260 --login" returned: 0 in 0.077s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aafe345-465f-44a5-a5bc-f0b451527c1e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36, portal: 172.16.0.220,3260]
Jul 29 13:49:35 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36, portal: 172.16.0.220,3260] successful.
Jul 29 13:49:35 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[90d8034c-b2fd-4998-b2e8-f504e1bd9593]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e68b49a-099e-4e65-914c-f395b08886a5]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:49:35 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:49:35 user nova-compute[231753]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 (non-flash)
Jul 29 13:49:35 user nova-compute[231753]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36 (non-flash)
Jul 29 13:49:35 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:49:35 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:49:35 user nova-compute[231753]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 (non-flash)
Jul 29 13:49:35 user nova-compute[231753]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36 (non-flash)
Jul 29 13:49:35 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.368s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] HCTL ('33', '-', '-', 0) found on session 39 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.030s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:35 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d795a9-6ed4-4ec9-bdd0-4dd282730bbe]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:36 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: None {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:49:36 user nova-compute[231753]: DEBUG nova.compute.manager [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:49:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:49:36 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638576.8373566, 02501ee9-0dc6-4aa3-8fb8-055bb2989617 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:49:36 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] VM Resumed (Lifecycle Event)
Jul 29 13:49:36 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Instance spawned successfully.
Jul 29 13:49:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:49:36 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:49:36 user nova-compute[231753]: DEBUG nova.compute.manager [req-3cd0ef53-858d-4bda-9783-fa99c35819f9 req-0661182f-b8bf-4d32-871a-ab50daac5b24 service nova] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Received event network-vif-plugged-5efea429-64cb-4dde-aa19-0b5152a03181 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:49:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3cd0ef53-858d-4bda-9783-fa99c35819f9 req-0661182f-b8bf-4d32-871a-ab50daac5b24 service nova] Acquiring lock "02501ee9-0dc6-4aa3-8fb8-055bb2989617-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3cd0ef53-858d-4bda-9783-fa99c35819f9 req-0661182f-b8bf-4d32-871a-ab50daac5b24 service nova] Lock "02501ee9-0dc6-4aa3-8fb8-055bb2989617-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3cd0ef53-858d-4bda-9783-fa99c35819f9 req-0661182f-b8bf-4d32-871a-ab50daac5b24 service nova] Lock "02501ee9-0dc6-4aa3-8fb8-055bb2989617-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:36 user nova-compute[231753]: DEBUG nova.compute.manager [req-3cd0ef53-858d-4bda-9783-fa99c35819f9 req-0661182f-b8bf-4d32-871a-ab50daac5b24 service nova] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] No waiting events found dispatching network-vif-plugged-5efea429-64cb-4dde-aa19-0b5152a03181 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:49:36 user nova-compute[231753]: WARNING nova.compute.manager [req-3cd0ef53-858d-4bda-9783-fa99c35819f9 req-0661182f-b8bf-4d32-871a-ab50daac5b24 service nova] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Received unexpected event network-vif-plugged-5efea429-64cb-4dde-aa19-0b5152a03181 for instance with vm_state building and task_state spawning.
Jul 29 13:49:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:49:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:49:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:49:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:49:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:49:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:49:36 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:49:36 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:49:36 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638576.837466, 02501ee9-0dc6-4aa3-8fb8-055bb2989617 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:49:36 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] VM Started (Lifecycle Event)
Jul 29 13:49:36 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:49:36 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:49:36 user nova-compute[231753]: INFO nova.compute.manager [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Took 6.76 seconds to spawn the instance on the hypervisor.
Jul 29 13:49:36 user nova-compute[231753]: DEBUG nova.compute.manager [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:49:36 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:49:37 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Searching for a device in session 39 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:49:37 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jHLYSViz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:49:37 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.446s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:49:37 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] <== connect_volume: return (1448ms) {'type': 'block', 'scsi_wwn': '26461616139633765', 'path': '/dev/sdb'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:49:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26461616139633765', 'path': '/dev/sdb'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:49:37 user nova-compute[231753]: DEBUG nova.objects.instance [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lazy-loading 'flavor' on Instance uuid afd6468c-465d-49c9-b01c-93734f2a3e17 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:49:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 13:49:37 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:49:37 user nova-compute[231753]:   <source dev="/dev/sdb"/>
Jul 29 13:49:37 user nova-compute[231753]:   <target dev="vdc" bus="virtio"/>
Jul 29 13:49:37 user nova-compute[231753]:   <serial>b07f2c3a-93cb-4bff-a6d6-8ef363cefb36</serial>
Jul 29 13:49:37 user nova-compute[231753]: </disk>
Jul 29 13:49:37 user nova-compute[231753]:  {{(pid=231753) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 13:49:37 user nova-compute[231753]: INFO nova.compute.manager [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Took 7.65 seconds to build instance.
Jul 29 13:49:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5b57e18c-b90a-4b99-ab7a-2ee12017890d tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "02501ee9-0dc6-4aa3-8fb8-055bb2989617" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.783s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:49:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] No BDM found with device name vdb, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:49:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] No BDM found with device name vdc, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:49:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] No VIF found with MAC fa:16:3e:ad:34:94, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:49:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9d56f99f-244e-4a3d-9d2b-fbf9c3857cd7 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "afd6468c-465d-49c9-b01c-93734f2a3e17" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 10.996s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e4961e47-6e19-4a5f-bd0e-283b8e7ab5c5 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Acquiring lock "afd6468c-465d-49c9-b01c-93734f2a3e17" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e4961e47-6e19-4a5f-bd0e-283b8e7ab5c5 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "afd6468c-465d-49c9-b01c-93734f2a3e17" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:38 user nova-compute[231753]: INFO nova.compute.manager [None req-e4961e47-6e19-4a5f-bd0e-283b8e7ab5c5 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Detaching volume b07f2c3a-93cb-4bff-a6d6-8ef363cefb36
Jul 29 13:49:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:39 user nova-compute[231753]: INFO nova.virt.block_device [None req-e4961e47-6e19-4a5f-bd0e-283b8e7ab5c5 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Attempting to driver detach volume b07f2c3a-93cb-4bff-a6d6-8ef363cefb36 from mountpoint /dev/vdc
Jul 29 13:49:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e4961e47-6e19-4a5f-bd0e-283b8e7ab5c5 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Attempting to detach device vdc from instance afd6468c-465d-49c9-b01c-93734f2a3e17 from the persistent domain config. {{(pid=231753) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-e4961e47-6e19-4a5f-bd0e-283b8e7ab5c5 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:49:39 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:49:39 user nova-compute[231753]:   <source dev="/dev/sdb"/>
Jul 29 13:49:39 user nova-compute[231753]:   <target dev="vdc" bus="virtio"/>
Jul 29 13:49:39 user nova-compute[231753]:   <serial>b07f2c3a-93cb-4bff-a6d6-8ef363cefb36</serial>
Jul 29 13:49:39 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 29 13:49:39 user nova-compute[231753]: </disk>
Jul 29 13:49:39 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:49:39 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-e4961e47-6e19-4a5f-bd0e-283b8e7ab5c5 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Successfully detached device vdc from instance afd6468c-465d-49c9-b01c-93734f2a3e17 from the persistent domain config.
Jul 29 13:49:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e4961e47-6e19-4a5f-bd0e-283b8e7ab5c5 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance afd6468c-465d-49c9-b01c-93734f2a3e17 from the live domain config. {{(pid=231753) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-e4961e47-6e19-4a5f-bd0e-283b8e7ab5c5 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:49:39 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:49:39 user nova-compute[231753]:   <source dev="/dev/sdb"/>
Jul 29 13:49:39 user nova-compute[231753]:   <target dev="vdc" bus="virtio"/>
Jul 29 13:49:39 user nova-compute[231753]:   <serial>b07f2c3a-93cb-4bff-a6d6-8ef363cefb36</serial>
Jul 29 13:49:39 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 29 13:49:39 user nova-compute[231753]: </disk>
Jul 29 13:49:39 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Received event <DeviceRemovedEvent: 1690638579.5076597, afd6468c-465d-49c9-b01c-93734f2a3e17 => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=231753) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e4961e47-6e19-4a5f-bd0e-283b8e7ab5c5 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance afd6468c-465d-49c9-b01c-93734f2a3e17 {{(pid=231753) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 13:49:39 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-e4961e47-6e19-4a5f-bd0e-283b8e7ab5c5 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Successfully detached device vdc from instance afd6468c-465d-49c9-b01c-93734f2a3e17 from the live domain config.
Jul 29 13:49:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4961e47-6e19-4a5f-bd0e-283b8e7ab5c5 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4961e47-6e19-4a5f-bd0e-283b8e7ab5c5 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jHLYSViz', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:49:39 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-e4961e47-6e19-4a5f-bd0e-283b8e7ab5c5 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:49:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-e4961e47-6e19-4a5f-bd0e-283b8e7ab5c5 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-e4961e47-6e19-4a5f-bd0e-283b8e7ab5c5 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[65871236-3c46-4875-97dd-cad6835ab560]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4961e47-6e19-4a5f-bd0e-283b8e7ab5c5 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:49:39 user nova-compute[231753]: No targets found.
Jul 29 13:49:39 user nova-compute[231753]: iSNS:
Jul 29 13:49:39 user nova-compute[231753]: No targets found.
Jul 29 13:49:39 user nova-compute[231753]: STATIC:
Jul 29 13:49:39 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea
Jul 29 13:49:39 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:49:39 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:49:39 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477
Jul 29 13:49:39 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:49:39 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:49:39 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43
Jul 29 13:49:39 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:49:39 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:49:39 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36
Jul 29 13:49:39 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:49:39 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:49:39 user nova-compute[231753]: FIRMWARE:
Jul 29 13:49:39 user nova-compute[231753]: No targets found.
Jul 29 13:49:39 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4961e47-6e19-4a5f-bd0e-283b8e7ab5c5 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:49:39 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:49:39 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4961e47-6e19-4a5f-bd0e-283b8e7ab5c5 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5c3e007-5c26-4f88-bbf6-8e1412bd3aa9]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13aa6ab-bd4f-42f6-b68e-dbcd2bf4a3f1]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 (non-flash)\ntcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4961e47-6e19-4a5f-bd0e-283b8e7ab5c5 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:49:39 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:49:39 user nova-compute[231753]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 (non-flash)
Jul 29 13:49:39 user nova-compute[231753]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36 (non-flash)
Jul 29 13:49:39 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4961e47-6e19-4a5f-bd0e-283b8e7ab5c5 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:49:39 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:49:39 user nova-compute[231753]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 (non-flash)
Jul 29 13:49:39 user nova-compute[231753]: tcp: [39] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36 (non-flash)
Jul 29 13:49:39 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4961e47-6e19-4a5f-bd0e-283b8e7ab5c5 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ca69a5360>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36'): ({'sdb'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-e4961e47-6e19-4a5f-bd0e-283b8e7ab5c5 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Removing single pathed devices sdb {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb1b6319-1cb7-42cf-bbc1-92a7c9098d81]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[70e5a505-1e3f-4b99-9b37-ed3410f9a0ea]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-e4961e47-6e19-4a5f-bd0e-283b8e7ab5c5 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Flushing IO for device /dev/sdb {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.015s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd9dde4-2072-47a4-b637-1adbefe0df71]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-e4961e47-6e19-4a5f-bd0e-283b8e7ab5c5 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.038s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cad0727-a06a-4aa4-9de4-062b69f5c535]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-e4961e47-6e19-4a5f-bd0e-283b8e7ab5c5 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-e4961e47-6e19-4a5f-bd0e-283b8e7ab5c5 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] SCSI volumes sdb have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4961e47-6e19-4a5f-bd0e-283b8e7ab5c5 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0879c739-b7d4-4e45-b80e-35a87b606904]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4961e47-6e19-4a5f-bd0e-283b8e7ab5c5 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36 -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36 -p 172.16.0.220:3260 --logout" returned: 0 in 0.059s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc021d4-79ba-4e66-90cb-65894b95d75b]: (4, ('Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36, portal: 172.16.0.220,3260]\nLogout of [sid: 39, target: iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4961e47-6e19-4a5f-bd0e-283b8e7ab5c5 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 39, target: iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36, portal: 172.16.0.220,3260]
Jul 29 13:49:39 user nova-compute[231753]: Logout of [sid: 39, target: iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36, portal: 172.16.0.220,3260] successful.
Jul 29 13:49:39 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36 -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b07f2c3a-93cb-4bff-a6d6-8ef363cefb36 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e0c278-bebd-4a47-a255-3c7f62b4ecaa]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4961e47-6e19-4a5f-bd0e-283b8e7ab5c5 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-e4961e47-6e19-4a5f-bd0e-283b8e7ab5c5 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.314s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e4961e47-6e19-4a5f-bd0e-283b8e7ab5c5 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] <== disconnect_volume: return (315ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:49:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e4961e47-6e19-4a5f-bd0e-283b8e7ab5c5 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:49:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:41 user nova-compute[231753]: DEBUG nova.compute.manager [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:49:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:41 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:49:41 user nova-compute[231753]: INFO nova.compute.claims [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Claim successful on node user
Jul 29 13:49:42 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.558s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._sync_power_states {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG nova.network.neutron [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-402c916d-23cd-4f22-b951-6542d3d1ebfb tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-402c916d-23cd-4f22-b951-6542d3d1ebfb tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-402c916d-23cd-4f22-b951-6542d3d1ebfb tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-402c916d-23cd-4f22-b951-6542d3d1ebfb tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-402c916d-23cd-4f22-b951-6542d3d1ebfb tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:42 user nova-compute[231753]: INFO nova.compute.manager [None req-402c916d-23cd-4f22-b951-6542d3d1ebfb tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Terminating instance
Jul 29 13:49:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-402c916d-23cd-4f22-b951-6542d3d1ebfb tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:49:42 user nova-compute[231753]: WARNING nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] While synchronizing instance power states, found 12 instances in the database and 11 instances on the hypervisor.
Jul 29 13:49:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Triggering sync for uuid 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb {{(pid=231753) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Triggering sync for uuid 7e2615c1-b03e-4076-bcd9-3585fb11b8ac {{(pid=231753) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Triggering sync for uuid 8ea52d41-7ec3-44d7-8421-133000ee887b {{(pid=231753) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Triggering sync for uuid cf326e80-7293-4764-9411-ed05a5aeba23 {{(pid=231753) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Triggering sync for uuid b99a72ba-73e2-4be7-b52b-7797351daa5f {{(pid=231753) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Triggering sync for uuid 8dd26572-fe6a-40fd-8c58-6af862b340c4 {{(pid=231753) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Triggering sync for uuid aee15bbf-4d52-4611-9e75-6443c2384913 {{(pid=231753) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Triggering sync for uuid b9751029-dfed-4342-ad92-9ae53d72fbc1 {{(pid=231753) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Triggering sync for uuid b6be450b-ebe7-4385-b162-2d072237aa97 {{(pid=231753) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Triggering sync for uuid afd6468c-465d-49c9-b01c-93734f2a3e17 {{(pid=231753) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Triggering sync for uuid 02501ee9-0dc6-4aa3-8fb8-055bb2989617 {{(pid=231753) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Triggering sync for uuid ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965 {{(pid=231753) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "8ea52d41-7ec3-44d7-8421-133000ee887b" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "8ea52d41-7ec3-44d7-8421-133000ee887b" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "cf326e80-7293-4764-9411-ed05a5aeba23" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "cf326e80-7293-4764-9411-ed05a5aeba23" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "b99a72ba-73e2-4be7-b52b-7797351daa5f" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "b99a72ba-73e2-4be7-b52b-7797351daa5f" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "8dd26572-fe6a-40fd-8c58-6af862b340c4" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "aee15bbf-4d52-4611-9e75-6443c2384913" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "aee15bbf-4d52-4611-9e75-6443c2384913" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "b9751029-dfed-4342-ad92-9ae53d72fbc1" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "b6be450b-ebe7-4385-b162-2d072237aa97" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "b6be450b-ebe7-4385-b162-2d072237aa97" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "afd6468c-465d-49c9-b01c-93734f2a3e17" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "02501ee9-0dc6-4aa3-8fb8-055bb2989617" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "02501ee9-0dc6-4aa3-8fb8-055bb2989617" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:42 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "8ea52d41-7ec3-44d7-8421-133000ee887b" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.052s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.070s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "b6be450b-ebe7-4385-b162-2d072237aa97" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.091s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "b99a72ba-73e2-4be7-b52b-7797351daa5f" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.112s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "cf326e80-7293-4764-9411-ed05a5aeba23" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.118s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "aee15bbf-4d52-4611-9e75-6443c2384913" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.124s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "02501ee9-0dc6-4aa3-8fb8-055bb2989617" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.125s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.147s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:42 user nova-compute[231753]: INFO nova.virt.block_device [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Booting with volume-backed-image e16ae177-482e-47d8-a71b-737a50412c32 at /dev/vda
Jul 29 13:49:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG nova.policy [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '618ce2d56c3c4ee8ace871d308ca45fb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c01165e83a3143ad83f050790f2b63fe', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG nova.compute.manager [req-b06cabf4-f0e3-4309-8aab-1c9d5616f702 req-9aac659d-63a3-4085-b5e7-88b25f4c308e service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Received event network-vif-unplugged-2a7981fb-647d-4610-9da2-3b162f366dfe {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b06cabf4-f0e3-4309-8aab-1c9d5616f702 req-9aac659d-63a3-4085-b5e7-88b25f4c308e service nova] Acquiring lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b06cabf4-f0e3-4309-8aab-1c9d5616f702 req-9aac659d-63a3-4085-b5e7-88b25f4c308e service nova] Lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b06cabf4-f0e3-4309-8aab-1c9d5616f702 req-9aac659d-63a3-4085-b5e7-88b25f4c308e service nova] Lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG nova.compute.manager [req-b06cabf4-f0e3-4309-8aab-1c9d5616f702 req-9aac659d-63a3-4085-b5e7-88b25f4c308e service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] No waiting events found dispatching network-vif-unplugged-2a7981fb-647d-4610-9da2-3b162f366dfe {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG nova.compute.manager [req-b06cabf4-f0e3-4309-8aab-1c9d5616f702 req-9aac659d-63a3-4085-b5e7-88b25f4c308e service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Received event network-vif-unplugged-2a7981fb-647d-4610-9da2-3b162f366dfe for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:49:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:43 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Instance destroyed successfully.
Jul 29 13:49:43 user nova-compute[231753]: DEBUG nova.objects.instance [None req-402c916d-23cd-4f22-b951-6542d3d1ebfb tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lazy-loading 'resources' on Instance uuid 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:49:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-402c916d-23cd-4f22-b951-6542d3d1ebfb tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-29T13:33:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerActionsTestOtherA-server-1236712368',display_name='tempest-ServerActionsTestOtherA-server-259014365',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serveractionstestothera-server-1236712368',id=3,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIuWQgyAL1ZhtINiMb8bBadRX1/6ZehT6zfTT2DNFW6eh8iXvfW0Pq6raR1PDnzRXJlqkmjwTrVF+AwsdLN+yPf0k+X1yx9QfVmcJaO2ivlK/Orc5S8LFrDXUE7UuYGgdQ==',key_name='tempest-keypair-820646002',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:37:37Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={rebuild='server'},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='afff9d3d250643c58da9bc5cf5756d1e',ramdisk_id='',reservation_id='r-8q0q0qkt',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsTestOtherA-1666416634',owner_user_name='tempest-ServerActionsTestOtherA-1666416634-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:37:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='748938c3fbfb4244ab946dcfe4762435',uuid=3b510aaa-49b1-43a9-aba4-fe1ee529b4fb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2a7981fb-647d-4610-9da2-3b162f366dfe", "address": "fa:16:3e:0c:e3:a3", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7981fb-64", "ovs_interfaceid": "2a7981fb-647d-4610-9da2-3b162f366dfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:49:43 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-402c916d-23cd-4f22-b951-6542d3d1ebfb tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Converting VIF {"id": "2a7981fb-647d-4610-9da2-3b162f366dfe", "address": "fa:16:3e:0c:e3:a3", "network": {"id": "f99d9e39-7a5f-481e-905f-4d5a4e920b9f", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherA-1793115211-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "afff9d3d250643c58da9bc5cf5756d1e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap2a7981fb-64", "ovs_interfaceid": "2a7981fb-647d-4610-9da2-3b162f366dfe", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:49:43 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-402c916d-23cd-4f22-b951-6542d3d1ebfb tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0c:e3:a3,bridge_name='br-int',has_traffic_filtering=True,id=2a7981fb-647d-4610-9da2-3b162f366dfe,network=Network(f99d9e39-7a5f-481e-905f-4d5a4e920b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a7981fb-64') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:49:43 user nova-compute[231753]: DEBUG os_vif [None req-402c916d-23cd-4f22-b951-6542d3d1ebfb tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:e3:a3,bridge_name='br-int',has_traffic_filtering=True,id=2a7981fb-647d-4610-9da2-3b162f366dfe,network=Network(f99d9e39-7a5f-481e-905f-4d5a4e920b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a7981fb-64') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:49:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2a7981fb-64, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:49:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:49:43 user nova-compute[231753]: INFO os_vif [None req-402c916d-23cd-4f22-b951-6542d3d1ebfb tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:0c:e3:a3,bridge_name='br-int',has_traffic_filtering=True,id=2a7981fb-647d-4610-9da2-3b162f366dfe,network=Network(f99d9e39-7a5f-481e-905f-4d5a4e920b9f),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2a7981fb-64')
Jul 29 13:49:43 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-402c916d-23cd-4f22-b951-6542d3d1ebfb tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Deleting instance files /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb_del
Jul 29 13:49:43 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-402c916d-23cd-4f22-b951-6542d3d1ebfb tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Deletion of /opt/stack/data/nova/instances/3b510aaa-49b1-43a9-aba4-fe1ee529b4fb_del complete
Jul 29 13:49:43 user nova-compute[231753]: INFO nova.compute.manager [None req-402c916d-23cd-4f22-b951-6542d3d1ebfb tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Took 1.07 seconds to destroy the instance on the hypervisor.
Jul 29 13:49:43 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-402c916d-23cd-4f22-b951-6542d3d1ebfb tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:49:43 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:49:43 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:49:43 user nova-compute[231753]: DEBUG nova.network.neutron [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Successfully created port: dba460c1-334b-4686-b6a3-7d85632d294d {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:49:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:44 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:49:44 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Took 0.82 seconds to deallocate network for instance.
Jul 29 13:49:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-7ac6a76c-71b2-466c-a6e1-7e796cac0558 req-3853943a-b190-4512-94d4-480a3c19c3bf service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Received event network-vif-deleted-2a7981fb-647d-4610-9da2-3b162f366dfe {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:49:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-402c916d-23cd-4f22-b951-6542d3d1ebfb tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-402c916d-23cd-4f22-b951-6542d3d1ebfb tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:44 user nova-compute[231753]: DEBUG nova.network.neutron [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Successfully updated port: dba460c1-334b-4686-b6a3-7d85632d294d {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:49:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "refresh_cache-ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:49:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquired lock "refresh_cache-ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:49:44 user nova-compute[231753]: DEBUG nova.network.neutron [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:49:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-f270454d-d121-4a75-b94b-2da59fe49440 req-c30b9113-0927-4d01-9881-6972fb655551 service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Received event network-changed-dba460c1-334b-4686-b6a3-7d85632d294d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:49:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-f270454d-d121-4a75-b94b-2da59fe49440 req-c30b9113-0927-4d01-9881-6972fb655551 service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Refreshing instance network info cache due to event network-changed-dba460c1-334b-4686-b6a3-7d85632d294d. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:49:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-f270454d-d121-4a75-b94b-2da59fe49440 req-c30b9113-0927-4d01-9881-6972fb655551 service nova] Acquiring lock "refresh_cache-ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:49:44 user nova-compute[231753]: DEBUG nova.network.neutron [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:49:44 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-402c916d-23cd-4f22-b951-6542d3d1ebfb tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:49:44 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-402c916d-23cd-4f22-b951-6542d3d1ebfb tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:49:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-402c916d-23cd-4f22-b951-6542d3d1ebfb tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.447s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:45 user nova-compute[231753]: DEBUG nova.compute.manager [req-1c4bf306-4474-4169-97b1-46257e41e832 req-a133ad40-abac-47b0-86a1-24069a43e9dc service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Received event network-vif-plugged-2a7981fb-647d-4610-9da2-3b162f366dfe {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:49:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-1c4bf306-4474-4169-97b1-46257e41e832 req-a133ad40-abac-47b0-86a1-24069a43e9dc service nova] Acquiring lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-1c4bf306-4474-4169-97b1-46257e41e832 req-a133ad40-abac-47b0-86a1-24069a43e9dc service nova] Lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-1c4bf306-4474-4169-97b1-46257e41e832 req-a133ad40-abac-47b0-86a1-24069a43e9dc service nova] Lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:45 user nova-compute[231753]: DEBUG nova.compute.manager [req-1c4bf306-4474-4169-97b1-46257e41e832 req-a133ad40-abac-47b0-86a1-24069a43e9dc service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] No waiting events found dispatching network-vif-plugged-2a7981fb-647d-4610-9da2-3b162f366dfe {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:49:45 user nova-compute[231753]: WARNING nova.compute.manager [req-1c4bf306-4474-4169-97b1-46257e41e832 req-a133ad40-abac-47b0-86a1-24069a43e9dc service nova] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Received unexpected event network-vif-plugged-2a7981fb-647d-4610-9da2-3b162f366dfe for instance with vm_state deleted and task_state None.
Jul 29 13:49:45 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-402c916d-23cd-4f22-b951-6542d3d1ebfb tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Deleted allocations for instance 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb
Jul 29 13:49:45 user nova-compute[231753]: DEBUG nova.objects.instance [None req-e4961e47-6e19-4a5f-bd0e-283b8e7ab5c5 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lazy-loading 'flavor' on Instance uuid afd6468c-465d-49c9-b01c-93734f2a3e17 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:49:45 user nova-compute[231753]: DEBUG nova.network.neutron [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Updating instance_info_cache with network_info: [{"id": "dba460c1-334b-4686-b6a3-7d85632d294d", "address": "fa:16:3e:15:f4:85", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba460c1-33", "ovs_interfaceid": "dba460c1-334b-4686-b6a3-7d85632d294d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:49:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Releasing lock "refresh_cache-ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:49:45 user nova-compute[231753]: DEBUG nova.compute.manager [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Instance network_info: |[{"id": "dba460c1-334b-4686-b6a3-7d85632d294d", "address": "fa:16:3e:15:f4:85", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba460c1-33", "ovs_interfaceid": "dba460c1-334b-4686-b6a3-7d85632d294d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:49:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-f270454d-d121-4a75-b94b-2da59fe49440 req-c30b9113-0927-4d01-9881-6972fb655551 service nova] Acquired lock "refresh_cache-ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:49:45 user nova-compute[231753]: DEBUG nova.network.neutron [req-f270454d-d121-4a75-b94b-2da59fe49440 req-c30b9113-0927-4d01-9881-6972fb655551 service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Refreshing network info cache for port dba460c1-334b-4686-b6a3-7d85632d294d {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:49:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e4961e47-6e19-4a5f-bd0e-283b8e7ab5c5 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "afd6468c-465d-49c9-b01c-93734f2a3e17" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 6.214s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "afd6468c-465d-49c9-b01c-93734f2a3e17" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.711s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-402c916d-23cd-4f22-b951-6542d3d1ebfb tempest-ServerActionsTestOtherA-1666416634 tempest-ServerActionsTestOtherA-1666416634-project-member] Lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.760s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 2.737s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "afd6468c-465d-49c9-b01c-93734f2a3e17" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.040s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "3b510aaa-49b1-43a9-aba4-fe1ee529b4fb" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.025s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:46 user nova-compute[231753]: DEBUG nova.network.neutron [req-f270454d-d121-4a75-b94b-2da59fe49440 req-c30b9113-0927-4d01-9881-6972fb655551 service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Updated VIF entry in instance network info cache for port dba460c1-334b-4686-b6a3-7d85632d294d. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:49:46 user nova-compute[231753]: DEBUG nova.network.neutron [req-f270454d-d121-4a75-b94b-2da59fe49440 req-c30b9113-0927-4d01-9881-6972fb655551 service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Updating instance_info_cache with network_info: [{"id": "dba460c1-334b-4686-b6a3-7d85632d294d", "address": "fa:16:3e:15:f4:85", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba460c1-33", "ovs_interfaceid": "dba460c1-334b-4686-b6a3-7d85632d294d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:49:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-f270454d-d121-4a75-b94b-2da59fe49440 req-c30b9113-0927-4d01-9881-6972fb655551 service nova] Releasing lock "refresh_cache-ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:49:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:52 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "c5f39add-9361-4cf7-aa3a-643f0a8252a7" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:52 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "c5f39add-9361-4cf7-aa3a-643f0a8252a7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:52 user nova-compute[231753]: DEBUG nova.compute.manager [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:49:52 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:49:52 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:49:52 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:49:52 user nova-compute[231753]: INFO nova.compute.claims [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Claim successful on node user
Jul 29 13:49:52 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:49:52 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:49:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.448s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:49:53 user nova-compute[231753]: DEBUG nova.compute.manager [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:49:53 user nova-compute[231753]: DEBUG nova.compute.manager [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:49:53 user nova-compute[231753]: DEBUG nova.network.neutron [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:49:53 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:49:53 user nova-compute[231753]: DEBUG nova.compute.manager [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:49:53 user nova-compute[231753]: INFO nova.virt.block_device [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Booting with volume snapshot 4c454941-0d71-4f0a-8c75-825052431705 at /dev/vda
Jul 29 13:49:53 user nova-compute[231753]: DEBUG nova.policy [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd94a7ea0c19845b886e12c1689cf30a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45c92d3fe964066b9be87489b2c9f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:49:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:53 user nova-compute[231753]: DEBUG nova.network.neutron [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Successfully created port: 51e44d6c-be82-409c-bf33-6bc0dc78f28d {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:49:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:54 user nova-compute[231753]: DEBUG nova.network.neutron [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Successfully updated port: 51e44d6c-be82-409c-bf33-6bc0dc78f28d {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:49:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "refresh_cache-c5f39add-9361-4cf7-aa3a-643f0a8252a7" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:49:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquired lock "refresh_cache-c5f39add-9361-4cf7-aa3a-643f0a8252a7" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:49:54 user nova-compute[231753]: DEBUG nova.network.neutron [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:49:54 user nova-compute[231753]: DEBUG nova.compute.manager [req-2037499b-6496-43a4-b14c-42ec83b0bf61 req-b7e9f2cb-141e-405c-ac1f-c1dad2b540cb service nova] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Received event network-changed-51e44d6c-be82-409c-bf33-6bc0dc78f28d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:49:54 user nova-compute[231753]: DEBUG nova.compute.manager [req-2037499b-6496-43a4-b14c-42ec83b0bf61 req-b7e9f2cb-141e-405c-ac1f-c1dad2b540cb service nova] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Refreshing instance network info cache due to event network-changed-51e44d6c-be82-409c-bf33-6bc0dc78f28d. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:49:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-2037499b-6496-43a4-b14c-42ec83b0bf61 req-b7e9f2cb-141e-405c-ac1f-c1dad2b540cb service nova] Acquiring lock "refresh_cache-c5f39add-9361-4cf7-aa3a-643f0a8252a7" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:49:54 user nova-compute[231753]: DEBUG nova.network.neutron [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:49:55 user nova-compute[231753]: DEBUG nova.network.neutron [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Updating instance_info_cache with network_info: [{"id": "51e44d6c-be82-409c-bf33-6bc0dc78f28d", "address": "fa:16:3e:9f:3d:88", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e44d6c-be", "ovs_interfaceid": "51e44d6c-be82-409c-bf33-6bc0dc78f28d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:49:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Releasing lock "refresh_cache-c5f39add-9361-4cf7-aa3a-643f0a8252a7" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:49:55 user nova-compute[231753]: DEBUG nova.compute.manager [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Instance network_info: |[{"id": "51e44d6c-be82-409c-bf33-6bc0dc78f28d", "address": "fa:16:3e:9f:3d:88", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e44d6c-be", "ovs_interfaceid": "51e44d6c-be82-409c-bf33-6bc0dc78f28d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:49:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-2037499b-6496-43a4-b14c-42ec83b0bf61 req-b7e9f2cb-141e-405c-ac1f-c1dad2b540cb service nova] Acquired lock "refresh_cache-c5f39add-9361-4cf7-aa3a-643f0a8252a7" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:49:55 user nova-compute[231753]: DEBUG nova.network.neutron [req-2037499b-6496-43a4-b14c-42ec83b0bf61 req-b7e9f2cb-141e-405c-ac1f-c1dad2b540cb service nova] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Refreshing network info cache for port 51e44d6c-be82-409c-bf33-6bc0dc78f28d {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:49:55 user nova-compute[231753]: DEBUG nova.network.neutron [req-2037499b-6496-43a4-b14c-42ec83b0bf61 req-b7e9f2cb-141e-405c-ac1f-c1dad2b540cb service nova] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Updated VIF entry in instance network info cache for port 51e44d6c-be82-409c-bf33-6bc0dc78f28d. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:49:55 user nova-compute[231753]: DEBUG nova.network.neutron [req-2037499b-6496-43a4-b14c-42ec83b0bf61 req-b7e9f2cb-141e-405c-ac1f-c1dad2b540cb service nova] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Updating instance_info_cache with network_info: [{"id": "51e44d6c-be82-409c-bf33-6bc0dc78f28d", "address": "fa:16:3e:9f:3d:88", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e44d6c-be", "ovs_interfaceid": "51e44d6c-be82-409c-bf33-6bc0dc78f28d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:49:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-2037499b-6496-43a4-b14c-42ec83b0bf61 req-b7e9f2cb-141e-405c-ac1f-c1dad2b540cb service nova] Releasing lock "refresh_cache-c5f39add-9361-4cf7-aa3a-643f0a8252a7" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690638583.3170652, 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:49:58 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] VM Stopped (Lifecycle Event)
Jul 29 13:49:58 user nova-compute[231753]: DEBUG nova.compute.manager [None req-20ac90ec-5cca-454f-8af0-4feb64f5ae01 None None] [instance: 3b510aaa-49b1-43a9-aba4-fe1ee529b4fb] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG os_brick.utils [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[96614081-c0a4-4ccc-9877-e882920e65c2]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[1147b779-e8e7-4330-94f5-76eaaae66bd7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b802f49-aac0-4a9b-9832-ab182b8571d9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea1b8fc3-441e-4122-a562-9f492ae45448]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:49:58 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:49:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb33d4bc-4518-402d-a73c-bb8bd746e71f]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG os_brick.utils [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Updating existing volume attachment record: 18bc45d2-b9b5-4646-871f-7e518c1b567d {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG os_brick.utils [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[52445b51-e873-4a7c-9871-b39a66a7ca68]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e424277d-124c-49f8-92d5-866532718077]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.014s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4450fe8d-700c-4ce4-99b2-13fe1d8b5b1e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c37f4fb-8db5-4ca8-b840-655c23de0f1a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:49:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:49:58 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:49:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0cfedfe-c2e4-4337-9a11-0fc407a8dcfc]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:49:59 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:49:59 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:49:59 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:49:59 user nova-compute[231753]: DEBUG os_brick.utils [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:49:59 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Updating existing volume attachment record: a691d20e-138b-4198-bf55-49506d1748aa {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:49:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.compute.manager [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:50:06 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Creating image(s)
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Did not create local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Ensure instance console log exists: /opt/stack/data/nova/instances/ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Start _get_guest_xml network_info=[{"id": "dba460c1-334b-4686-b6a3-7d85632d294d", "address": "fa:16:3e:15:f4:85", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba460c1-33", "ovs_interfaceid": "dba460c1-334b-4686-b6a3-7d85632d294d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yRsdFEaM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965', 'attached_at': '', 'detached_at': '', 'volume_id': 'db901bd6-6e09-4679-be85-f2b92ffb7b6a', 'serial': 'db901bd6-6e09-4679-be85-f2b92ffb7b6a'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '18bc45d2-b9b5-4646-871f-7e518c1b567d', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:50:06 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:50:06 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yRsdFEaM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:50:06 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:50:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:50:06 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:50:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:50:06 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a -p 172.16.0.220:3260" returned: 21 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[afb8bf2a-f09e-40c0-b2aa-45e0ff5199f1]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:50:06 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4432b776-dc77-4ce8-8dcf-092d1752b2ce]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a] added
Jul 29 13:50:06 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[490a82e4-3b9f-4e37-9763-de9c9f9f010c]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce28e016-221e-4f58-a5b9-c8a2afe3cb27]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yRsdFEaM {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yRsdFEaM" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aca1e11-4ab8-44ec-be9c-c72e02590f22]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yRsdFEaM'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[478cd66c-c918-406f-ba3f-4445d456046e]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.compute.manager [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:50:06 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Creating image(s)
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Did not create local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Ensure instance console log exists: /opt/stack/data/nova/instances/c5f39add-9361-4cf7-aa3a-643f0a8252a7/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Start _get_guest_xml network_info=[{"id": "51e44d6c-be82-409c-bf33-6bc0dc78f28d", "address": "fa:16:3e:9f:3d:88", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e44d6c-be", "ovs_interfaceid": "51e44d6c-be82-409c-bf33-6bc0dc78f28d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIpRCYWA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'c5f39add-9361-4cf7-aa3a-643f0a8252a7', 'attached_at': '', 'detached_at': '', 'volume_id': '3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a', 'serial': '3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'attachment_id': 'a691d20e-138b-4198-bf55-49506d1748aa', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:50:06 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:50:06 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[55114194-cc77-48de-a014-b3c8ebe3d2e2]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:50:06 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:50:06 user nova-compute[231753]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 (non-flash)
Jul 29 13:50:06 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:50:06 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:50:06 user nova-compute[231753]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 (non-flash)
Jul 29 13:50:06 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIpRCYWA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:50:06 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:50:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a -p 172.16.0.220:3260 --login" returned: 0 in 0.064s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c62b4a5a-ba4d-4a93-8906-5ee146eefbce]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a, portal: 172.16.0.220,3260]
Jul 29 13:50:06 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a, portal: 172.16.0.220,3260] successful.
Jul 29 13:50:06 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb0c32a6-576a-4bd7-b7ca-f5cd17ff0a06]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d018429-7ad8-4bc8-9ca2-88245e77d3e0]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:50:06 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:50:06 user nova-compute[231753]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 (non-flash)
Jul 29 13:50:06 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:50:06 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:50:06 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:50:06 user nova-compute[231753]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 (non-flash)
Jul 29 13:50:06 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:50:06 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] HCTL ('33', '-', '-', 0) found on session 40 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e61f0195-0b45-4b2a-96e0-9be6d5ff23f9]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:50:06 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: None {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Searching for a device in session 40 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yRsdFEaM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.316s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] <== connect_volume: return (1318ms) {'type': 'block', 'scsi_wwn': '23461373965333230', 'path': '/dev/sdb'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461373965333230', 'path': '/dev/sdb'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.115s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:50:07 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:50:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:50:07 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:50:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:49:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1967595438',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1967595438',id=35,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c01165e83a3143ad83f050790f2b63fe',ramdisk_id='',reservation_id='r-tjkg3ouj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-93506270',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:49:43Z,user_data=None,user_id='618ce2d56c3c4ee8ace871d308ca45fb',uuid=ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dba460c1-334b-4686-b6a3-7d85632d294d", "address": "fa:16:3e:15:f4:85", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba460c1-33", "ovs_interfaceid": "dba460c1-334b-4686-b6a3-7d85632d294d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Converting VIF {"id": "dba460c1-334b-4686-b6a3-7d85632d294d", "address": "fa:16:3e:15:f4:85", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba460c1-33", "ovs_interfaceid": "dba460c1-334b-4686-b6a3-7d85632d294d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:f4:85,bridge_name='br-int',has_traffic_filtering=True,id=dba460c1-334b-4686-b6a3-7d85632d294d,network=Network(03362fcb-afd6-4b0a-af44-a54a848c59f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdba460c1-33') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG nova.objects.instance [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lazy-loading 'pci_devices' on Instance uuid ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38d08a5-1f44-466b-ac87-b847fd31541e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:50:07 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:50:07 user nova-compute[231753]:   <uuid>ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965</uuid>
Jul 29 13:50:07 user nova-compute[231753]:   <name>instance-00000023</name>
Jul 29 13:50:07 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:50:07 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:50:07 user nova-compute[231753]:   <metadata>
Jul 29 13:50:07 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:50:07 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:50:07 user nova-compute[231753]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1967595438</nova:name>
Jul 29 13:50:07 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:50:06</nova:creationTime>
Jul 29 13:50:07 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:50:07 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:50:07 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:50:07 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:50:07 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:50:07 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:50:07 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:50:07 user nova-compute[231753]:       <nova:owner>
Jul 29 13:50:07 user nova-compute[231753]:         <nova:user uuid="618ce2d56c3c4ee8ace871d308ca45fb">tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member</nova:user>
Jul 29 13:50:07 user nova-compute[231753]:         <nova:project uuid="c01165e83a3143ad83f050790f2b63fe">tempest-ServerBootFromVolumeStableRescueTest-93506270</nova:project>
Jul 29 13:50:07 user nova-compute[231753]:       </nova:owner>
Jul 29 13:50:07 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:50:07 user nova-compute[231753]:       <nova:ports>
Jul 29 13:50:07 user nova-compute[231753]:         <nova:port uuid="dba460c1-334b-4686-b6a3-7d85632d294d">
Jul 29 13:50:07 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 29 13:50:07 user nova-compute[231753]:         </nova:port>
Jul 29 13:50:07 user nova-compute[231753]:       </nova:ports>
Jul 29 13:50:07 user nova-compute[231753]:     </nova:instance>
Jul 29 13:50:07 user nova-compute[231753]:   </metadata>
Jul 29 13:50:07 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:50:07 user nova-compute[231753]:     <system>
Jul 29 13:50:07 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:50:07 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:50:07 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:50:07 user nova-compute[231753]:       <entry name="serial">ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965</entry>
Jul 29 13:50:07 user nova-compute[231753]:       <entry name="uuid">ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965</entry>
Jul 29 13:50:07 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:50:07 user nova-compute[231753]:     </system>
Jul 29 13:50:07 user nova-compute[231753]:   </sysinfo>
Jul 29 13:50:07 user nova-compute[231753]:   <os>
Jul 29 13:50:07 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:50:07 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:50:07 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:50:07 user nova-compute[231753]:   </os>
Jul 29 13:50:07 user nova-compute[231753]:   <features>
Jul 29 13:50:07 user nova-compute[231753]:     <acpi/>
Jul 29 13:50:07 user nova-compute[231753]:     <apic/>
Jul 29 13:50:07 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:50:07 user nova-compute[231753]:   </features>
Jul 29 13:50:07 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:50:07 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:50:07 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:50:07 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:50:07 user nova-compute[231753]:   </clock>
Jul 29 13:50:07 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:50:07 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:50:07 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:50:07 user nova-compute[231753]:   </cpu>
Jul 29 13:50:07 user nova-compute[231753]:   <devices>
Jul 29 13:50:07 user nova-compute[231753]:     <disk type="block" device="disk">
Jul 29 13:50:07 user nova-compute[231753]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:50:07 user nova-compute[231753]:       <source dev="/dev/sdb"/>
Jul 29 13:50:07 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:50:07 user nova-compute[231753]:       <serial>db901bd6-6e09-4679-be85-f2b92ffb7b6a</serial>
Jul 29 13:50:07 user nova-compute[231753]:     </disk>
Jul 29 13:50:07 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:50:07 user nova-compute[231753]:       <mac address="fa:16:3e:15:f4:85"/>
Jul 29 13:50:07 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:50:07 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:50:07 user nova-compute[231753]:       <target dev="tapdba460c1-33"/>
Jul 29 13:50:07 user nova-compute[231753]:     </interface>
Jul 29 13:50:07 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:50:07 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965/console.log" append="off"/>
Jul 29 13:50:07 user nova-compute[231753]:     </serial>
Jul 29 13:50:07 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:50:07 user nova-compute[231753]:     <video>
Jul 29 13:50:07 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:50:07 user nova-compute[231753]:     </video>
Jul 29 13:50:07 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:50:07 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:50:07 user nova-compute[231753]:     </rng>
Jul 29 13:50:07 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:50:07 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:50:07 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:50:07 user nova-compute[231753]:     </memballoon>
Jul 29 13:50:07 user nova-compute[231753]:   </devices>
Jul 29 13:50:07 user nova-compute[231753]: </domain>
Jul 29 13:50:07 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:49:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1967595438',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1967595438',id=35,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='c01165e83a3143ad83f050790f2b63fe',ramdisk_id='',reservation_id='r-tjkg3ouj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-93506270',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:49:43Z,user_data=None,user_id='618ce2d56c3c4ee8ace871d308ca45fb',uuid=ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dba460c1-334b-4686-b6a3-7d85632d294d", "address": "fa:16:3e:15:f4:85", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba460c1-33", "ovs_interfaceid": "dba460c1-334b-4686-b6a3-7d85632d294d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Converting VIF {"id": "dba460c1-334b-4686-b6a3-7d85632d294d", "address": "fa:16:3e:15:f4:85", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba460c1-33", "ovs_interfaceid": "dba460c1-334b-4686-b6a3-7d85632d294d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:15:f4:85,bridge_name='br-int',has_traffic_filtering=True,id=dba460c1-334b-4686-b6a3-7d85632d294d,network=Network(03362fcb-afd6-4b0a-af44-a54a848c59f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdba460c1-33') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG os_vif [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:f4:85,bridge_name='br-int',has_traffic_filtering=True,id=dba460c1-334b-4686-b6a3-7d85632d294d,network=Network(03362fcb-afd6-4b0a-af44-a54a848c59f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdba460c1-33') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdba460c1-33, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapdba460c1-33, col_values=(('external_ids', {'iface-id': 'dba460c1-334b-4686-b6a3-7d85632d294d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:15:f4:85', 'vm-uuid': 'ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[43eb6d61-257d-4732-ad85-446b00f0ef9b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a] added
Jul 29 13:50:07 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:07 user nova-compute[231753]: INFO os_vif [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:15:f4:85,bridge_name='br-int',has_traffic_filtering=True,id=dba460c1-334b-4686-b6a3-7d85632d294d,network=Network(03362fcb-afd6-4b0a-af44-a54a848c59f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdba460c1-33')
Jul 29 13:50:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.036s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9750485e-d632-4ddf-a05d-d15f5b2d727d]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c53cb1-6562-4644-9c14-5662e1b71b2d]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rIpRCYWA {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] No VIF found with MAC fa:16:3e:15:f4:85, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v rIpRCYWA" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[41995512-785c-4db8-b7b1-9ce82d0d0058]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'rIpRCYWA'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93eace8-f9be-4178-a088-8b08e0332a3c]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[462f24a5-5f52-4053-83a1-686158d479dd]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:50:07 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:50:07 user nova-compute[231753]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 (non-flash)
Jul 29 13:50:07 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:50:07 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:50:07 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:50:07 user nova-compute[231753]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 (non-flash)
Jul 29 13:50:07 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:50:07 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:50:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:08 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4988860-36c2-472d-9f43-b0eab811f3dd]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:50:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a, portal: 172.16.0.220,3260]
Jul 29 13:50:08 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a, portal: 172.16.0.220,3260] successful.
Jul 29 13:50:08 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:50:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:08 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2850285b-0739-4e03-9cbf-537306572a02]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:50:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:50:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:08 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b339e0-1862-449f-af25-22de246dccaf]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:50:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:50:08 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:50:08 user nova-compute[231753]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 (non-flash)
Jul 29 13:50:08 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:50:08 user nova-compute[231753]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a (non-flash)
Jul 29 13:50:08 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:50:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:50:08 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:50:08 user nova-compute[231753]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 (non-flash)
Jul 29 13:50:08 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:50:08 user nova-compute[231753]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a (non-flash)
Jul 29 13:50:08 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:50:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.332s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:50:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:50:08 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] HCTL ('37', '-', '-', 0) found on session 41 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:50:08 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:50:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:08 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec9e14e8-8851-4512-89db-6c3bcdacdc00]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:50:08 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Searching for a device in session 41 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:50:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIpRCYWA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:50:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.374s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:50:09 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] <== connect_volume: return (2490ms) {'type': 'block', 'scsi_wwn': '26436613133383534', 'path': '/dev/sdf'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:50:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26436613133383534', 'path': '/dev/sdf'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:50:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:49:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-987594824',display_name='tempest-TestVolumeBootPattern-server-987594824',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-987594824',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f45c92d3fe964066b9be87489b2c9f7e',ramdisk_id='',reservation_id='r-0r61y20r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-434673895',owner_user_name='tempest-TestVolumeBootPattern-434673895-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:49:53Z,user_data=None,user_id='d94a7ea0c19845b886e12c1689cf30a8',uuid=c5f39add-9361-4cf7-aa3a-643f0a8252a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51e44d6c-be82-409c-bf33-6bc0dc78f28d", "address": "fa:16:3e:9f:3d:88", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e44d6c-be", "ovs_interfaceid": "51e44d6c-be82-409c-bf33-6bc0dc78f28d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:50:09 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Converting VIF {"id": "51e44d6c-be82-409c-bf33-6bc0dc78f28d", "address": "fa:16:3e:9f:3d:88", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e44d6c-be", "ovs_interfaceid": "51e44d6c-be82-409c-bf33-6bc0dc78f28d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:50:09 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:3d:88,bridge_name='br-int',has_traffic_filtering=True,id=51e44d6c-be82-409c-bf33-6bc0dc78f28d,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51e44d6c-be') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:50:09 user nova-compute[231753]: DEBUG nova.objects.instance [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lazy-loading 'pci_devices' on Instance uuid c5f39add-9361-4cf7-aa3a-643f0a8252a7 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:50:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:50:09 user nova-compute[231753]:   <uuid>c5f39add-9361-4cf7-aa3a-643f0a8252a7</uuid>
Jul 29 13:50:09 user nova-compute[231753]:   <name>instance-00000024</name>
Jul 29 13:50:09 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:50:09 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:50:09 user nova-compute[231753]:   <metadata>
Jul 29 13:50:09 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:50:09 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:50:09 user nova-compute[231753]:       <nova:name>tempest-TestVolumeBootPattern-server-987594824</nova:name>
Jul 29 13:50:09 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:50:06</nova:creationTime>
Jul 29 13:50:09 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:50:09 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:50:09 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:50:09 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:50:09 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:50:09 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:50:09 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:50:09 user nova-compute[231753]:       <nova:owner>
Jul 29 13:50:09 user nova-compute[231753]:         <nova:user uuid="d94a7ea0c19845b886e12c1689cf30a8">tempest-TestVolumeBootPattern-434673895-project-member</nova:user>
Jul 29 13:50:09 user nova-compute[231753]:         <nova:project uuid="f45c92d3fe964066b9be87489b2c9f7e">tempest-TestVolumeBootPattern-434673895</nova:project>
Jul 29 13:50:09 user nova-compute[231753]:       </nova:owner>
Jul 29 13:50:09 user nova-compute[231753]:       <nova:ports>
Jul 29 13:50:09 user nova-compute[231753]:         <nova:port uuid="51e44d6c-be82-409c-bf33-6bc0dc78f28d">
Jul 29 13:50:09 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 29 13:50:09 user nova-compute[231753]:         </nova:port>
Jul 29 13:50:09 user nova-compute[231753]:       </nova:ports>
Jul 29 13:50:09 user nova-compute[231753]:     </nova:instance>
Jul 29 13:50:09 user nova-compute[231753]:   </metadata>
Jul 29 13:50:09 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:50:09 user nova-compute[231753]:     <system>
Jul 29 13:50:09 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:50:09 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:50:09 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:50:09 user nova-compute[231753]:       <entry name="serial">c5f39add-9361-4cf7-aa3a-643f0a8252a7</entry>
Jul 29 13:50:09 user nova-compute[231753]:       <entry name="uuid">c5f39add-9361-4cf7-aa3a-643f0a8252a7</entry>
Jul 29 13:50:09 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:50:09 user nova-compute[231753]:     </system>
Jul 29 13:50:09 user nova-compute[231753]:   </sysinfo>
Jul 29 13:50:09 user nova-compute[231753]:   <os>
Jul 29 13:50:09 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:50:09 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:50:09 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:50:09 user nova-compute[231753]:   </os>
Jul 29 13:50:09 user nova-compute[231753]:   <features>
Jul 29 13:50:09 user nova-compute[231753]:     <acpi/>
Jul 29 13:50:09 user nova-compute[231753]:     <apic/>
Jul 29 13:50:09 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:50:09 user nova-compute[231753]:   </features>
Jul 29 13:50:09 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:50:09 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:50:09 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:50:09 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:50:09 user nova-compute[231753]:   </clock>
Jul 29 13:50:09 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:50:09 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:50:09 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:50:09 user nova-compute[231753]:   </cpu>
Jul 29 13:50:09 user nova-compute[231753]:   <devices>
Jul 29 13:50:09 user nova-compute[231753]:     <disk type="block" device="disk">
Jul 29 13:50:09 user nova-compute[231753]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:50:09 user nova-compute[231753]:       <source dev="/dev/sdf"/>
Jul 29 13:50:09 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:50:09 user nova-compute[231753]:       <serial>3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a</serial>
Jul 29 13:50:09 user nova-compute[231753]:     </disk>
Jul 29 13:50:09 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:50:09 user nova-compute[231753]:       <mac address="fa:16:3e:9f:3d:88"/>
Jul 29 13:50:09 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:50:09 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:50:09 user nova-compute[231753]:       <target dev="tap51e44d6c-be"/>
Jul 29 13:50:09 user nova-compute[231753]:     </interface>
Jul 29 13:50:09 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:50:09 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/c5f39add-9361-4cf7-aa3a-643f0a8252a7/console.log" append="off"/>
Jul 29 13:50:09 user nova-compute[231753]:     </serial>
Jul 29 13:50:09 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:50:09 user nova-compute[231753]:     <video>
Jul 29 13:50:09 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:50:09 user nova-compute[231753]:     </video>
Jul 29 13:50:09 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:50:09 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:50:09 user nova-compute[231753]:     </rng>
Jul 29 13:50:09 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:50:09 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:50:09 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:50:09 user nova-compute[231753]:     </memballoon>
Jul 29 13:50:09 user nova-compute[231753]:   </devices>
Jul 29 13:50:09 user nova-compute[231753]: </domain>
Jul 29 13:50:09 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:50:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:49:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-987594824',display_name='tempest-TestVolumeBootPattern-server-987594824',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-987594824',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f45c92d3fe964066b9be87489b2c9f7e',ramdisk_id='',reservation_id='r-0r61y20r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-434673895',owner_user_name='tempest-TestVolumeBootPattern-434673895-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:49:53Z,user_data=None,user_id='d94a7ea0c19845b886e12c1689cf30a8',uuid=c5f39add-9361-4cf7-aa3a-643f0a8252a7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "51e44d6c-be82-409c-bf33-6bc0dc78f28d", "address": "fa:16:3e:9f:3d:88", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e44d6c-be", "ovs_interfaceid": "51e44d6c-be82-409c-bf33-6bc0dc78f28d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:50:09 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Converting VIF {"id": "51e44d6c-be82-409c-bf33-6bc0dc78f28d", "address": "fa:16:3e:9f:3d:88", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e44d6c-be", "ovs_interfaceid": "51e44d6c-be82-409c-bf33-6bc0dc78f28d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:50:09 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:3d:88,bridge_name='br-int',has_traffic_filtering=True,id=51e44d6c-be82-409c-bf33-6bc0dc78f28d,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51e44d6c-be') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:50:09 user nova-compute[231753]: DEBUG os_vif [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:3d:88,bridge_name='br-int',has_traffic_filtering=True,id=51e44d6c-be82-409c-bf33-6bc0dc78f28d,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51e44d6c-be') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:50:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:50:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:50:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap51e44d6c-be, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:50:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap51e44d6c-be, col_values=(('external_ids', {'iface-id': '51e44d6c-be82-409c-bf33-6bc0dc78f28d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9f:3d:88', 'vm-uuid': 'c5f39add-9361-4cf7-aa3a-643f0a8252a7'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:50:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:50:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:09 user nova-compute[231753]: INFO os_vif [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:3d:88,bridge_name='br-int',has_traffic_filtering=True,id=51e44d6c-be82-409c-bf33-6bc0dc78f28d,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51e44d6c-be')
Jul 29 13:50:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:50:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] No VIF found with MAC fa:16:3e:9f:3d:88, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:50:09 user nova-compute[231753]: DEBUG nova.compute.manager [req-e0b61671-cfc7-45c2-a628-d2ed612f3995 req-004a477e-7a83-4672-8257-53789fe2fee8 service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Received event network-vif-plugged-dba460c1-334b-4686-b6a3-7d85632d294d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:50:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e0b61671-cfc7-45c2-a628-d2ed612f3995 req-004a477e-7a83-4672-8257-53789fe2fee8 service nova] Acquiring lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:50:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e0b61671-cfc7-45c2-a628-d2ed612f3995 req-004a477e-7a83-4672-8257-53789fe2fee8 service nova] Lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:50:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e0b61671-cfc7-45c2-a628-d2ed612f3995 req-004a477e-7a83-4672-8257-53789fe2fee8 service nova] Lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:50:09 user nova-compute[231753]: DEBUG nova.compute.manager [req-e0b61671-cfc7-45c2-a628-d2ed612f3995 req-004a477e-7a83-4672-8257-53789fe2fee8 service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] No waiting events found dispatching network-vif-plugged-dba460c1-334b-4686-b6a3-7d85632d294d {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:50:09 user nova-compute[231753]: WARNING nova.compute.manager [req-e0b61671-cfc7-45c2-a628-d2ed612f3995 req-004a477e-7a83-4672-8257-53789fe2fee8 service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Received unexpected event network-vif-plugged-dba460c1-334b-4686-b6a3-7d85632d294d for instance with vm_state building and task_state spawning.
Jul 29 13:50:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:11 user nova-compute[231753]: DEBUG nova.compute.manager [req-157c805d-8e23-4d49-8288-534cbf62a555 req-eb73eef9-14e5-4dd8-ac99-e1af273ebb22 service nova] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Received event network-vif-plugged-51e44d6c-be82-409c-bf33-6bc0dc78f28d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:50:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-157c805d-8e23-4d49-8288-534cbf62a555 req-eb73eef9-14e5-4dd8-ac99-e1af273ebb22 service nova] Acquiring lock "c5f39add-9361-4cf7-aa3a-643f0a8252a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:50:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-157c805d-8e23-4d49-8288-534cbf62a555 req-eb73eef9-14e5-4dd8-ac99-e1af273ebb22 service nova] Lock "c5f39add-9361-4cf7-aa3a-643f0a8252a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:50:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-157c805d-8e23-4d49-8288-534cbf62a555 req-eb73eef9-14e5-4dd8-ac99-e1af273ebb22 service nova] Lock "c5f39add-9361-4cf7-aa3a-643f0a8252a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:50:11 user nova-compute[231753]: DEBUG nova.compute.manager [req-157c805d-8e23-4d49-8288-534cbf62a555 req-eb73eef9-14e5-4dd8-ac99-e1af273ebb22 service nova] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] No waiting events found dispatching network-vif-plugged-51e44d6c-be82-409c-bf33-6bc0dc78f28d {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:50:11 user nova-compute[231753]: WARNING nova.compute.manager [req-157c805d-8e23-4d49-8288-534cbf62a555 req-eb73eef9-14e5-4dd8-ac99-e1af273ebb22 service nova] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Received unexpected event network-vif-plugged-51e44d6c-be82-409c-bf33-6bc0dc78f28d for instance with vm_state building and task_state spawning.
Jul 29 13:50:11 user nova-compute[231753]: DEBUG nova.compute.manager [req-c3c38c02-b739-4a3a-b146-6051cc1d17d8 req-8de4f156-9762-406e-9250-47f35cfd9f96 service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Received event network-vif-plugged-dba460c1-334b-4686-b6a3-7d85632d294d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:50:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c3c38c02-b739-4a3a-b146-6051cc1d17d8 req-8de4f156-9762-406e-9250-47f35cfd9f96 service nova] Acquiring lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:50:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c3c38c02-b739-4a3a-b146-6051cc1d17d8 req-8de4f156-9762-406e-9250-47f35cfd9f96 service nova] Lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:50:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c3c38c02-b739-4a3a-b146-6051cc1d17d8 req-8de4f156-9762-406e-9250-47f35cfd9f96 service nova] Lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:50:11 user nova-compute[231753]: DEBUG nova.compute.manager [req-c3c38c02-b739-4a3a-b146-6051cc1d17d8 req-8de4f156-9762-406e-9250-47f35cfd9f96 service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] No waiting events found dispatching network-vif-plugged-dba460c1-334b-4686-b6a3-7d85632d294d {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:50:11 user nova-compute[231753]: WARNING nova.compute.manager [req-c3c38c02-b739-4a3a-b146-6051cc1d17d8 req-8de4f156-9762-406e-9250-47f35cfd9f96 service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Received unexpected event network-vif-plugged-dba460c1-334b-4686-b6a3-7d85632d294d for instance with vm_state building and task_state spawning.
Jul 29 13:50:11 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:11 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:12 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:50:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:50:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:50:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:50:12 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 13:50:12 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638612.5143938, ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:50:12 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] VM Resumed (Lifecycle Event)
Jul 29 13:50:12 user nova-compute[231753]: DEBUG nova.compute.manager [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:50:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:50:12 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Instance spawned successfully.
Jul 29 13:50:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:50:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:50:12 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:50:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:12 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:50:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:50:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:50:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:50:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:50:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:50:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:50:12 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:50:12 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638612.5153694, ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:50:12 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] VM Started (Lifecycle Event)
Jul 29 13:50:12 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:50:12 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:50:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:12 user nova-compute[231753]: INFO nova.compute.manager [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Took 6.40 seconds to spawn the instance on the hypervisor.
Jul 29 13:50:12 user nova-compute[231753]: DEBUG nova.compute.manager [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:50:12 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:50:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:12 user nova-compute[231753]: INFO nova.compute.manager [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Took 31.16 seconds to build instance.
Jul 29 13:50:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-41266d14-a021-4566-939e-be6f4de45b5f tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 31.318s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:50:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 30.514s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:50:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.036s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:50:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02501ee9-0dc6-4aa3-8fb8-055bb2989617/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:13 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638613.221318, c5f39add-9361-4cf7-aa3a-643f0a8252a7 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:50:13 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] VM Resumed (Lifecycle Event)
Jul 29 13:50:13 user nova-compute[231753]: DEBUG nova.compute.manager [req-5b8e8a49-e753-4612-a13c-92a4da3142f7 req-5afe3417-d2a7-4e13-b6da-255bd4122e84 service nova] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Received event network-vif-plugged-51e44d6c-be82-409c-bf33-6bc0dc78f28d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:50:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5b8e8a49-e753-4612-a13c-92a4da3142f7 req-5afe3417-d2a7-4e13-b6da-255bd4122e84 service nova] Acquiring lock "c5f39add-9361-4cf7-aa3a-643f0a8252a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:50:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5b8e8a49-e753-4612-a13c-92a4da3142f7 req-5afe3417-d2a7-4e13-b6da-255bd4122e84 service nova] Lock "c5f39add-9361-4cf7-aa3a-643f0a8252a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:50:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5b8e8a49-e753-4612-a13c-92a4da3142f7 req-5afe3417-d2a7-4e13-b6da-255bd4122e84 service nova] Lock "c5f39add-9361-4cf7-aa3a-643f0a8252a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:50:13 user nova-compute[231753]: DEBUG nova.compute.manager [req-5b8e8a49-e753-4612-a13c-92a4da3142f7 req-5afe3417-d2a7-4e13-b6da-255bd4122e84 service nova] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] No waiting events found dispatching network-vif-plugged-51e44d6c-be82-409c-bf33-6bc0dc78f28d {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:50:13 user nova-compute[231753]: WARNING nova.compute.manager [req-5b8e8a49-e753-4612-a13c-92a4da3142f7 req-5afe3417-d2a7-4e13-b6da-255bd4122e84 service nova] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Received unexpected event network-vif-plugged-51e44d6c-be82-409c-bf33-6bc0dc78f28d for instance with vm_state building and task_state spawning.
Jul 29 13:50:13 user nova-compute[231753]: DEBUG nova.compute.manager [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:50:13 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:50:13 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Instance spawned successfully.
Jul 29 13:50:13 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:50:13 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:50:13 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:50:13 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:50:13 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:50:13 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:50:13 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:50:13 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:50:13 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:50:13 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:50:13 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638613.2238832, c5f39add-9361-4cf7-aa3a-643f0a8252a7 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:50:13 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] VM Started (Lifecycle Event)
Jul 29 13:50:13 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:50:13 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:50:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02501ee9-0dc6-4aa3-8fb8-055bb2989617/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02501ee9-0dc6-4aa3-8fb8-055bb2989617/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:13 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:50:13 user nova-compute[231753]: INFO nova.compute.manager [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Took 6.85 seconds to spawn the instance on the hypervisor.
Jul 29 13:50:13 user nova-compute[231753]: DEBUG nova.compute.manager [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:50:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02501ee9-0dc6-4aa3-8fb8-055bb2989617/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:13 user nova-compute[231753]: INFO nova.compute.manager [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Took 21.04 seconds to build instance.
Jul 29 13:50:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-df103434-dde1-4435-b5d5-15da0b424b99 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "c5f39add-9361-4cf7-aa3a-643f0a8252a7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 21.153s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:50:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:13 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sde (vdb) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:50:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afd6468c-465d-49c9-b01c-93734f2a3e17/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afd6468c-465d-49c9-b01c-93734f2a3e17/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afd6468c-465d-49c9-b01c-93734f2a3e17/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afd6468c-465d-49c9-b01c-93734f2a3e17/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:50:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json" returned: 0 in 0.160s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json" returned: 0 in 0.152s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json" returned: 0 in 0.161s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk --force-share --output=json" returned: 0 in 0.171s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:15 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:50:15 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:50:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.173s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:16 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:50:16 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:50:16 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=7185MB free_disk=24.93747329711914GB free_vcpus=0 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 13:50:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:50:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:50:16 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 7e2615c1-b03e-4076-bcd9-3585fb11b8ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:50:16 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8ea52d41-7ec3-44d7-8421-133000ee887b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:50:16 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance cf326e80-7293-4764-9411-ed05a5aeba23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:50:16 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b99a72ba-73e2-4be7-b52b-7797351daa5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:50:16 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8dd26572-fe6a-40fd-8c58-6af862b340c4 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:50:16 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance aee15bbf-4d52-4611-9e75-6443c2384913 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:50:16 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b9751029-dfed-4342-ad92-9ae53d72fbc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:50:16 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b6be450b-ebe7-4385-b162-2d072237aa97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:50:16 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance afd6468c-465d-49c9-b01c-93734f2a3e17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:50:16 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 02501ee9-0dc6-4aa3-8fb8-055bb2989617 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:50:16 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:50:16 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance c5f39add-9361-4cf7-aa3a-643f0a8252a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:50:16 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 12 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 13:50:16 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=6656MB phys_disk=40GB used_disk=9GB total_vcpus=12 used_vcpus=12 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 13:50:17 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:50:17 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:50:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 13:50:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.804s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:50:18 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:50:18 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 13:50:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "refresh_cache-cf326e80-7293-4764-9411-ed05a5aeba23" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:50:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquired lock "refresh_cache-cf326e80-7293-4764-9411-ed05a5aeba23" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:50:18 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Forcefully refreshing network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 13:50:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:50:19 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Updating instance_info_cache with network_info: [{"id": "fbd63de1-966b-4791-8c72-6a5e2d26a7e2", "address": "fa:16:3e:09:75:c0", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd63de1-96", "ovs_interfaceid": "fbd63de1-966b-4791-8c72-6a5e2d26a7e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:50:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Releasing lock "refresh_cache-cf326e80-7293-4764-9411-ed05a5aeba23" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:50:19 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Updated the network info_cache for instance {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 13:50:19 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:50:19 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:50:19 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:50:19 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:50:19 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 13:50:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:20 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:50:20 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:50:20 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:50:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-45f2dd35-2f44-4ce8-abb8-edcbdea7a8c3 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "aee15bbf-4d52-4611-9e75-6443c2384913" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:50:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-45f2dd35-2f44-4ce8-abb8-edcbdea7a8c3 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "aee15bbf-4d52-4611-9e75-6443c2384913" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:50:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-45f2dd35-2f44-4ce8-abb8-edcbdea7a8c3 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:50:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-45f2dd35-2f44-4ce8-abb8-edcbdea7a8c3 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:50:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-45f2dd35-2f44-4ce8-abb8-edcbdea7a8c3 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:50:22 user nova-compute[231753]: INFO nova.compute.manager [None req-45f2dd35-2f44-4ce8-abb8-edcbdea7a8c3 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Terminating instance
Jul 29 13:50:22 user nova-compute[231753]: DEBUG nova.compute.manager [None req-45f2dd35-2f44-4ce8-abb8-edcbdea7a8c3 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:50:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:22 user nova-compute[231753]: DEBUG nova.compute.manager [req-34d99fac-2ddc-42ec-bdd1-6d2f3e1e9e00 req-c02c45f8-61a2-4a6a-b3ef-e7bfbb693a93 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Received event network-vif-unplugged-351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:50:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-34d99fac-2ddc-42ec-bdd1-6d2f3e1e9e00 req-c02c45f8-61a2-4a6a-b3ef-e7bfbb693a93 service nova] Acquiring lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:50:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-34d99fac-2ddc-42ec-bdd1-6d2f3e1e9e00 req-c02c45f8-61a2-4a6a-b3ef-e7bfbb693a93 service nova] Lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:50:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-34d99fac-2ddc-42ec-bdd1-6d2f3e1e9e00 req-c02c45f8-61a2-4a6a-b3ef-e7bfbb693a93 service nova] Lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:50:22 user nova-compute[231753]: DEBUG nova.compute.manager [req-34d99fac-2ddc-42ec-bdd1-6d2f3e1e9e00 req-c02c45f8-61a2-4a6a-b3ef-e7bfbb693a93 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] No waiting events found dispatching network-vif-unplugged-351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:50:22 user nova-compute[231753]: DEBUG nova.compute.manager [req-34d99fac-2ddc-42ec-bdd1-6d2f3e1e9e00 req-c02c45f8-61a2-4a6a-b3ef-e7bfbb693a93 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Received event network-vif-unplugged-351f3080-98ce-4f1f-a53f-d4415327255f for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:50:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:23 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Instance destroyed successfully.
Jul 29 13:50:23 user nova-compute[231753]: DEBUG nova.objects.instance [None req-45f2dd35-2f44-4ce8-abb8-edcbdea7a8c3 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lazy-loading 'resources' on Instance uuid aee15bbf-4d52-4611-9e75-6443c2384913 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:50:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-45f2dd35-2f44-4ce8-abb8-edcbdea7a8c3 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:45:05Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-1284255744',display_name='tempest-TestMinimumBasicScenario-server-1284255744',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-1284255744',id=29,image_ref='78adb53f-be8b-4033-a431-1a462bd1ead9',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKr8ekMLRc3v6qbOd8eRngk+ys5vegV1XgCj9XLuALI1iIMjOlfgT1s5XKib17FXpypyjWP6kJK3XT768WDJC2k5DNlfH8LLPqFoCUrFbdeUyhXm4lePDDUp4AQyBXC4Dg==',key_name='tempest-TestMinimumBasicScenario-949027565',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:45:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a0d7f4b7f8641f9890a4ac009942190',ramdisk_id='',reservation_id='r-f9wpz5wp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='78adb53f-be8b-4033-a431-1a462bd1ead9',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-187684118',owner_user_name='tempest-TestMinimumBasicScenario-187684118-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:47:40Z,user_data=None,user_id='68002afa2ff64150afe91714800481ae',uuid=aee15bbf-4d52-4611-9e75-6443c2384913,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "351f3080-98ce-4f1f-a53f-d4415327255f", "address": "fa:16:3e:ae:ff:c5", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351f3080-98", "ovs_interfaceid": "351f3080-98ce-4f1f-a53f-d4415327255f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:50:23 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-45f2dd35-2f44-4ce8-abb8-edcbdea7a8c3 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Converting VIF {"id": "351f3080-98ce-4f1f-a53f-d4415327255f", "address": "fa:16:3e:ae:ff:c5", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap351f3080-98", "ovs_interfaceid": "351f3080-98ce-4f1f-a53f-d4415327255f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:50:23 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-45f2dd35-2f44-4ce8-abb8-edcbdea7a8c3 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ae:ff:c5,bridge_name='br-int',has_traffic_filtering=True,id=351f3080-98ce-4f1f-a53f-d4415327255f,network=Network(70a92bb8-13dd-4b75-9986-5c136de68b16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap351f3080-98') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:50:23 user nova-compute[231753]: DEBUG os_vif [None req-45f2dd35-2f44-4ce8-abb8-edcbdea7a8c3 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:ff:c5,bridge_name='br-int',has_traffic_filtering=True,id=351f3080-98ce-4f1f-a53f-d4415327255f,network=Network(70a92bb8-13dd-4b75-9986-5c136de68b16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap351f3080-98') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:50:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap351f3080-98, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:50:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:50:23 user nova-compute[231753]: INFO os_vif [None req-45f2dd35-2f44-4ce8-abb8-edcbdea7a8c3 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ae:ff:c5,bridge_name='br-int',has_traffic_filtering=True,id=351f3080-98ce-4f1f-a53f-d4415327255f,network=Network(70a92bb8-13dd-4b75-9986-5c136de68b16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap351f3080-98')
Jul 29 13:50:23 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-45f2dd35-2f44-4ce8-abb8-edcbdea7a8c3 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Deleting instance files /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913_del
Jul 29 13:50:23 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-45f2dd35-2f44-4ce8-abb8-edcbdea7a8c3 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Deletion of /opt/stack/data/nova/instances/aee15bbf-4d52-4611-9e75-6443c2384913_del complete
Jul 29 13:50:23 user nova-compute[231753]: INFO nova.compute.manager [None req-45f2dd35-2f44-4ce8-abb8-edcbdea7a8c3 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Took 0.91 seconds to destroy the instance on the hypervisor.
Jul 29 13:50:23 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-45f2dd35-2f44-4ce8-abb8-edcbdea7a8c3 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:50:23 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:50:23 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:50:23 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:50:23 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Took 0.49 seconds to deallocate network for instance.
Jul 29 13:50:24 user nova-compute[231753]: DEBUG nova.compute.manager [req-35cf5897-c5fb-4742-9947-3d570f3d6f11 req-81826d2d-fa94-40e5-b5d2-e8ed5c0afe78 service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Received event network-vif-deleted-351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:50:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-45f2dd35-2f44-4ce8-abb8-edcbdea7a8c3 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:50:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-45f2dd35-2f44-4ce8-abb8-edcbdea7a8c3 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:50:24 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-45f2dd35-2f44-4ce8-abb8-edcbdea7a8c3 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:50:24 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-45f2dd35-2f44-4ce8-abb8-edcbdea7a8c3 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:50:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-45f2dd35-2f44-4ce8-abb8-edcbdea7a8c3 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.366s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:50:24 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-45f2dd35-2f44-4ce8-abb8-edcbdea7a8c3 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Deleted allocations for instance aee15bbf-4d52-4611-9e75-6443c2384913
Jul 29 13:50:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-45f2dd35-2f44-4ce8-abb8-edcbdea7a8c3 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "aee15bbf-4d52-4611-9e75-6443c2384913" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.950s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:50:25 user nova-compute[231753]: DEBUG nova.compute.manager [req-37019dc7-2722-4a65-87ff-6812ac73f980 req-068af0f4-68e2-4711-a910-e6da3be3f1ac service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Received event network-vif-plugged-351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:50:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-37019dc7-2722-4a65-87ff-6812ac73f980 req-068af0f4-68e2-4711-a910-e6da3be3f1ac service nova] Acquiring lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:50:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-37019dc7-2722-4a65-87ff-6812ac73f980 req-068af0f4-68e2-4711-a910-e6da3be3f1ac service nova] Lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.004s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:50:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-37019dc7-2722-4a65-87ff-6812ac73f980 req-068af0f4-68e2-4711-a910-e6da3be3f1ac service nova] Lock "aee15bbf-4d52-4611-9e75-6443c2384913-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:50:25 user nova-compute[231753]: DEBUG nova.compute.manager [req-37019dc7-2722-4a65-87ff-6812ac73f980 req-068af0f4-68e2-4711-a910-e6da3be3f1ac service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] No waiting events found dispatching network-vif-plugged-351f3080-98ce-4f1f-a53f-d4415327255f {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:50:25 user nova-compute[231753]: WARNING nova.compute.manager [req-37019dc7-2722-4a65-87ff-6812ac73f980 req-068af0f4-68e2-4711-a910-e6da3be3f1ac service nova] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Received unexpected event network-vif-plugged-351f3080-98ce-4f1f-a53f-d4415327255f for instance with vm_state deleted and task_state None.
Jul 29 13:50:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-97768ec3-d068-424b-a60c-97f370cb6e1f tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Acquiring lock "afd6468c-465d-49c9-b01c-93734f2a3e17" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:50:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-97768ec3-d068-424b-a60c-97f370cb6e1f tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "afd6468c-465d-49c9-b01c-93734f2a3e17" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:50:29 user nova-compute[231753]: INFO nova.compute.manager [None req-97768ec3-d068-424b-a60c-97f370cb6e1f tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Detaching volume 84f24568-fdbc-447d-bf70-28b6d5ef7477
Jul 29 13:50:29 user nova-compute[231753]: INFO nova.virt.block_device [None req-97768ec3-d068-424b-a60c-97f370cb6e1f tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Attempting to driver detach volume 84f24568-fdbc-447d-bf70-28b6d5ef7477 from mountpoint /dev/vdb
Jul 29 13:50:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-97768ec3-d068-424b-a60c-97f370cb6e1f tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Attempting to detach device vdb from instance afd6468c-465d-49c9-b01c-93734f2a3e17 from the persistent domain config. {{(pid=231753) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 13:50:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-97768ec3-d068-424b-a60c-97f370cb6e1f tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:50:29 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:50:29 user nova-compute[231753]:   <source dev="/dev/sdc"/>
Jul 29 13:50:29 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:50:29 user nova-compute[231753]:   <serial>84f24568-fdbc-447d-bf70-28b6d5ef7477</serial>
Jul 29 13:50:29 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 13:50:29 user nova-compute[231753]: </disk>
Jul 29 13:50:29 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:50:29 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-97768ec3-d068-424b-a60c-97f370cb6e1f tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Successfully detached device vdb from instance afd6468c-465d-49c9-b01c-93734f2a3e17 from the persistent domain config.
Jul 29 13:50:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-97768ec3-d068-424b-a60c-97f370cb6e1f tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance afd6468c-465d-49c9-b01c-93734f2a3e17 from the live domain config. {{(pid=231753) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 13:50:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-97768ec3-d068-424b-a60c-97f370cb6e1f tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:50:29 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:50:29 user nova-compute[231753]:   <source dev="/dev/sdc"/>
Jul 29 13:50:29 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:50:29 user nova-compute[231753]:   <serial>84f24568-fdbc-447d-bf70-28b6d5ef7477</serial>
Jul 29 13:50:29 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 13:50:29 user nova-compute[231753]: </disk>
Jul 29 13:50:29 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Received event <DeviceRemovedEvent: 1690638630.011761, afd6468c-465d-49c9-b01c-93734f2a3e17 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=231753) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-97768ec3-d068-424b-a60c-97f370cb6e1f tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance afd6468c-465d-49c9-b01c-93734f2a3e17 {{(pid=231753) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 13:50:30 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-97768ec3-d068-424b-a60c-97f370cb6e1f tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Successfully detached device vdb from instance afd6468c-465d-49c9-b01c-93734f2a3e17 from the live domain config.
Jul 29 13:50:30 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97768ec3-d068-424b-a60c-97f370cb6e1f tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-97768ec3-d068-424b-a60c-97f370cb6e1f tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'TYpEjyer', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:50:30 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-97768ec3-d068-424b-a60c-97f370cb6e1f tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:50:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-97768ec3-d068-424b-a60c-97f370cb6e1f tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-97768ec3-d068-424b-a60c-97f370cb6e1f tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f6a9ae-83b8-4a87-81bf-5d035ae73e7c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-97768ec3-d068-424b-a60c-97f370cb6e1f tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:50:30 user nova-compute[231753]: No targets found.
Jul 29 13:50:30 user nova-compute[231753]: iSNS:
Jul 29 13:50:30 user nova-compute[231753]: No targets found.
Jul 29 13:50:30 user nova-compute[231753]: STATIC:
Jul 29 13:50:30 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea
Jul 29 13:50:30 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:50:30 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:50:30 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477
Jul 29 13:50:30 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:50:30 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:50:30 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43
Jul 29 13:50:30 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:50:30 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:50:30 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a
Jul 29 13:50:30 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:50:30 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:50:30 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a
Jul 29 13:50:30 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:50:30 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:50:30 user nova-compute[231753]: FIRMWARE:
Jul 29 13:50:30 user nova-compute[231753]: No targets found.
Jul 29 13:50:30 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-97768ec3-d068-424b-a60c-97f370cb6e1f tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:50:30 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:50:30 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-97768ec3-d068-424b-a60c-97f370cb6e1f tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6ff2ef-b09e-458d-ae2a-9ad8fb2f064d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[78833c7a-08bd-418e-aa75-a6ab5a4d1442]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)\ntcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-97768ec3-d068-424b-a60c-97f370cb6e1f tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:50:30 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:50:30 user nova-compute[231753]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 (non-flash)
Jul 29 13:50:30 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:50:30 user nova-compute[231753]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a (non-flash)
Jul 29 13:50:30 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-97768ec3-d068-424b-a60c-97f370cb6e1f tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:50:30 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:50:30 user nova-compute[231753]: tcp: [38] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 (non-flash)
Jul 29 13:50:30 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:50:30 user nova-compute[231753]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a (non-flash)
Jul 29 13:50:30 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-97768ec3-d068-424b-a60c-97f370cb6e1f tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c982a92d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477'): ({'sdc'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-97768ec3-d068-424b-a60c-97f370cb6e1f tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Removing single pathed devices sdc {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d08b12e-7264-41a6-9dd8-ecd38cc494f5]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2864172-7ade-4736-bdba-378645e51dab]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-97768ec3-d068-424b-a60c-97f370cb6e1f tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Flushing IO for device /dev/sdc {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f385d608-fb5e-4ca8-be05-7bb2f6b3a4e7]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-97768ec3-d068-424b-a60c-97f370cb6e1f tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.043s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[99a42880-100c-48af-821b-79020ce4a419]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-97768ec3-d068-424b-a60c-97f370cb6e1f tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-97768ec3-d068-424b-a60c-97f370cb6e1f tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] SCSI volumes sdc have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-97768ec3-d068-424b-a60c-97f370cb6e1f tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a920a47-8b61-45f4-8540-4dbb0d7f14ef]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-97768ec3-d068-424b-a60c-97f370cb6e1f tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 -p 172.16.0.220:3260 --logout" returned: 0 in 0.047s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad487f4b-018d-4483-a2c1-7ab6e5eafd3b]: (4, ('Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477, portal: 172.16.0.220,3260]\nLogout of [sid: 38, target: iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-97768ec3-d068-424b-a60c-97f370cb6e1f tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 38, target: iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477, portal: 172.16.0.220,3260]
Jul 29 13:50:30 user nova-compute[231753]: Logout of [sid: 38, target: iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477, portal: 172.16.0.220,3260] successful.
Jul 29 13:50:30 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:84f24568-fdbc-447d-bf70-28b6d5ef7477 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b87b5176-a711-40f0-8b4e-870e85dbb357]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-97768ec3-d068-424b-a60c-97f370cb6e1f tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-97768ec3-d068-424b-a60c-97f370cb6e1f tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.298s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-97768ec3-d068-424b-a60c-97f370cb6e1f tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] <== disconnect_volume: return (300ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:50:30 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-97768ec3-d068-424b-a60c-97f370cb6e1f tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:50:31 user nova-compute[231753]: DEBUG nova.objects.instance [None req-97768ec3-d068-424b-a60c-97f370cb6e1f tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lazy-loading 'flavor' on Instance uuid afd6468c-465d-49c9-b01c-93734f2a3e17 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:50:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-97768ec3-d068-424b-a60c-97f370cb6e1f tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "afd6468c-465d-49c9-b01c-93734f2a3e17" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.611s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:50:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:38 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690638623.3945265, aee15bbf-4d52-4611-9e75-6443c2384913 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:50:38 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] VM Stopped (Lifecycle Event)
Jul 29 13:50:38 user nova-compute[231753]: DEBUG nova.compute.manager [None req-f797c562-aaea-459d-bf9e-a34bbfba5b18 None None] [instance: aee15bbf-4d52-4611-9e75-6443c2384913] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:50:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:46 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:50 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:55 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:50:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4b5fa2db-1b60-4333-9cd8-b744abf7f867 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "8dd26572-fe6a-40fd-8c58-6af862b340c4" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4b5fa2db-1b60-4333-9cd8-b744abf7f867 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4b5fa2db-1b60-4333-9cd8-b744abf7f867 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4b5fa2db-1b60-4333-9cd8-b744abf7f867 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4b5fa2db-1b60-4333-9cd8-b744abf7f867 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:00 user nova-compute[231753]: INFO nova.compute.manager [None req-4b5fa2db-1b60-4333-9cd8-b744abf7f867 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Terminating instance
Jul 29 13:51:00 user nova-compute[231753]: DEBUG nova.compute.manager [None req-4b5fa2db-1b60-4333-9cd8-b744abf7f867 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:51:00 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:00 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:00 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:00 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:00 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:00 user nova-compute[231753]: DEBUG nova.compute.manager [req-9d66e01d-b881-4553-9463-7bf19e6e12f3 req-d4376107-01e8-4d1c-99db-4bfc25b3b3ac service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Received event network-vif-unplugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:51:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9d66e01d-b881-4553-9463-7bf19e6e12f3 req-d4376107-01e8-4d1c-99db-4bfc25b3b3ac service nova] Acquiring lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9d66e01d-b881-4553-9463-7bf19e6e12f3 req-d4376107-01e8-4d1c-99db-4bfc25b3b3ac service nova] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9d66e01d-b881-4553-9463-7bf19e6e12f3 req-d4376107-01e8-4d1c-99db-4bfc25b3b3ac service nova] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:00 user nova-compute[231753]: DEBUG nova.compute.manager [req-9d66e01d-b881-4553-9463-7bf19e6e12f3 req-d4376107-01e8-4d1c-99db-4bfc25b3b3ac service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] No waiting events found dispatching network-vif-unplugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:51:00 user nova-compute[231753]: DEBUG nova.compute.manager [req-9d66e01d-b881-4553-9463-7bf19e6e12f3 req-d4376107-01e8-4d1c-99db-4bfc25b3b3ac service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Received event network-vif-unplugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:51:00 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Instance destroyed successfully.
Jul 29 13:51:00 user nova-compute[231753]: DEBUG nova.objects.instance [None req-4b5fa2db-1b60-4333-9cd8-b744abf7f867 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lazy-loading 'resources' on Instance uuid 8dd26572-fe6a-40fd-8c58-6af862b340c4 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:51:00 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-4b5fa2db-1b60-4333-9cd8-b744abf7f867 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:41:22Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-307508049',display_name='tempest-AttachVolumeTestJSON-server-307508049',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-307508049',id=25,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoyUAgpcSSQTthO61utyiF8t7eniB6Jq0RtxtqYL+lvLbvmf3WG4z2Y5S66oY+znDIezboeDRUEwg+7djUWhx8vLQF2KnXuxcUYlwL/5sSfLakxOteY7b7lI0VU3lUVUA==',key_name='tempest-keypair-441207824',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:41:29Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a8801c6bc4b46ef9b407426c5eb07e0',ramdisk_id='',reservation_id='r-tsz4sxhz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-695592502',owner_user_name='tempest-AttachVolumeTestJSON-695592502-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:49:14Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df1ccafc63e0418e9889541bb8ecd3d2',uuid=8dd26572-fe6a-40fd-8c58-6af862b340c4,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "address": "fa:16:3e:a7:22:05", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3e2ca8-62", "ovs_interfaceid": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:51:00 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-4b5fa2db-1b60-4333-9cd8-b744abf7f867 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Converting VIF {"id": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "address": "fa:16:3e:a7:22:05", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.6", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapef3e2ca8-62", "ovs_interfaceid": "ef3e2ca8-6228-4cd8-b815-d06cf34e15e0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:51:00 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-4b5fa2db-1b60-4333-9cd8-b744abf7f867 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a7:22:05,bridge_name='br-int',has_traffic_filtering=True,id=ef3e2ca8-6228-4cd8-b815-d06cf34e15e0,network=Network(dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef3e2ca8-62') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:51:00 user nova-compute[231753]: DEBUG os_vif [None req-4b5fa2db-1b60-4333-9cd8-b744abf7f867 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:22:05,bridge_name='br-int',has_traffic_filtering=True,id=ef3e2ca8-6228-4cd8-b815-d06cf34e15e0,network=Network(dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef3e2ca8-62') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:51:00 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:00 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapef3e2ca8-62, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:51:00 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:00 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:51:00 user nova-compute[231753]: INFO os_vif [None req-4b5fa2db-1b60-4333-9cd8-b744abf7f867 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a7:22:05,bridge_name='br-int',has_traffic_filtering=True,id=ef3e2ca8-6228-4cd8-b815-d06cf34e15e0,network=Network(dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapef3e2ca8-62')
Jul 29 13:51:00 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-4b5fa2db-1b60-4333-9cd8-b744abf7f867 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Deleting instance files /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4_del
Jul 29 13:51:00 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-4b5fa2db-1b60-4333-9cd8-b744abf7f867 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Deletion of /opt/stack/data/nova/instances/8dd26572-fe6a-40fd-8c58-6af862b340c4_del complete
Jul 29 13:51:00 user nova-compute[231753]: INFO nova.compute.manager [None req-4b5fa2db-1b60-4333-9cd8-b744abf7f867 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Took 0.67 seconds to destroy the instance on the hypervisor.
Jul 29 13:51:00 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-4b5fa2db-1b60-4333-9cd8-b744abf7f867 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:51:00 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:51:00 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:51:01 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:51:01 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Took 0.90 seconds to deallocate network for instance.
Jul 29 13:51:01 user nova-compute[231753]: DEBUG nova.compute.manager [req-202773e0-3a5e-41dd-a754-02c95bf8cb2b req-5f069e1c-6400-4100-a14c-a3e61074794e service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Received event network-vif-deleted-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:51:01 user nova-compute[231753]: INFO nova.compute.manager [req-202773e0-3a5e-41dd-a754-02c95bf8cb2b req-5f069e1c-6400-4100-a14c-a3e61074794e service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Neutron deleted interface ef3e2ca8-6228-4cd8-b815-d06cf34e15e0; detaching it from the instance and deleting it from the info cache
Jul 29 13:51:01 user nova-compute[231753]: DEBUG nova.network.neutron [req-202773e0-3a5e-41dd-a754-02c95bf8cb2b req-5f069e1c-6400-4100-a14c-a3e61074794e service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:51:01 user nova-compute[231753]: DEBUG nova.compute.manager [req-202773e0-3a5e-41dd-a754-02c95bf8cb2b req-5f069e1c-6400-4100-a14c-a3e61074794e service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Detach interface failed, port_id=ef3e2ca8-6228-4cd8-b815-d06cf34e15e0, reason: Instance 8dd26572-fe6a-40fd-8c58-6af862b340c4 could not be found. {{(pid=231753) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 13:51:01 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4b5fa2db-1b60-4333-9cd8-b744abf7f867 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:01 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4b5fa2db-1b60-4333-9cd8-b744abf7f867 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:01 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-4b5fa2db-1b60-4333-9cd8-b744abf7f867 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:51:01 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-4b5fa2db-1b60-4333-9cd8-b744abf7f867 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:51:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4b5fa2db-1b60-4333-9cd8-b744abf7f867 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.344s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:02 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-4b5fa2db-1b60-4333-9cd8-b744abf7f867 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Deleted allocations for instance 8dd26572-fe6a-40fd-8c58-6af862b340c4
Jul 29 13:51:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4b5fa2db-1b60-4333-9cd8-b744abf7f867 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.130s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:02 user nova-compute[231753]: DEBUG nova.compute.manager [req-6b8b45b3-2e0f-46be-8141-f18b2f230301 req-e16ad7e6-6367-4523-af27-3b6c34074e6e service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Received event network-vif-plugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:51:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6b8b45b3-2e0f-46be-8141-f18b2f230301 req-e16ad7e6-6367-4523-af27-3b6c34074e6e service nova] Acquiring lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6b8b45b3-2e0f-46be-8141-f18b2f230301 req-e16ad7e6-6367-4523-af27-3b6c34074e6e service nova] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:02 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6b8b45b3-2e0f-46be-8141-f18b2f230301 req-e16ad7e6-6367-4523-af27-3b6c34074e6e service nova] Lock "8dd26572-fe6a-40fd-8c58-6af862b340c4-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:02 user nova-compute[231753]: DEBUG nova.compute.manager [req-6b8b45b3-2e0f-46be-8141-f18b2f230301 req-e16ad7e6-6367-4523-af27-3b6c34074e6e service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] No waiting events found dispatching network-vif-plugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:51:02 user nova-compute[231753]: WARNING nova.compute.manager [req-6b8b45b3-2e0f-46be-8141-f18b2f230301 req-e16ad7e6-6367-4523-af27-3b6c34074e6e service nova] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Received unexpected event network-vif-plugged-ef3e2ca8-6228-4cd8-b815-d06cf34e15e0 for instance with vm_state deleted and task_state None.
Jul 29 13:51:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:05 user nova-compute[231753]: DEBUG nova.compute.manager [req-3acb778f-6f42-4a2b-a0c5-34d47ee5199c req-d33dc200-1c2a-4a72-9973-9139868ce07f service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Received event network-changed-a25ce12c-a83d-4128-ac1e-62ca02ae31fd {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:51:05 user nova-compute[231753]: DEBUG nova.compute.manager [req-3acb778f-6f42-4a2b-a0c5-34d47ee5199c req-d33dc200-1c2a-4a72-9973-9139868ce07f service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Refreshing instance network info cache due to event network-changed-a25ce12c-a83d-4128-ac1e-62ca02ae31fd. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:51:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3acb778f-6f42-4a2b-a0c5-34d47ee5199c req-d33dc200-1c2a-4a72-9973-9139868ce07f service nova] Acquiring lock "refresh_cache-b9751029-dfed-4342-ad92-9ae53d72fbc1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:51:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3acb778f-6f42-4a2b-a0c5-34d47ee5199c req-d33dc200-1c2a-4a72-9973-9139868ce07f service nova] Acquired lock "refresh_cache-b9751029-dfed-4342-ad92-9ae53d72fbc1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:51:05 user nova-compute[231753]: DEBUG nova.network.neutron [req-3acb778f-6f42-4a2b-a0c5-34d47ee5199c req-d33dc200-1c2a-4a72-9973-9139868ce07f service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Refreshing network info cache for port a25ce12c-a83d-4128-ac1e-62ca02ae31fd {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:51:05 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:05 user nova-compute[231753]: DEBUG nova.network.neutron [req-3acb778f-6f42-4a2b-a0c5-34d47ee5199c req-d33dc200-1c2a-4a72-9973-9139868ce07f service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Updated VIF entry in instance network info cache for port a25ce12c-a83d-4128-ac1e-62ca02ae31fd. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:51:05 user nova-compute[231753]: DEBUG nova.network.neutron [req-3acb778f-6f42-4a2b-a0c5-34d47ee5199c req-d33dc200-1c2a-4a72-9973-9139868ce07f service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Updating instance_info_cache with network_info: [{"id": "a25ce12c-a83d-4128-ac1e-62ca02ae31fd", "address": "fa:16:3e:8f:41:ff", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25ce12c-a8", "ovs_interfaceid": "a25ce12c-a83d-4128-ac1e-62ca02ae31fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:51:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0f3723c5-e80f-4fe5-bb38-7932813a5325 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "b9751029-dfed-4342-ad92-9ae53d72fbc1" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0f3723c5-e80f-4fe5-bb38-7932813a5325 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3acb778f-6f42-4a2b-a0c5-34d47ee5199c req-d33dc200-1c2a-4a72-9973-9139868ce07f service nova] Releasing lock "refresh_cache-b9751029-dfed-4342-ad92-9ae53d72fbc1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:51:05 user nova-compute[231753]: INFO nova.compute.manager [None req-0f3723c5-e80f-4fe5-bb38-7932813a5325 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Detaching volume c2fb3633-09eb-4b75-84b7-cdd15d3ceb43
Jul 29 13:51:05 user nova-compute[231753]: INFO nova.virt.block_device [None req-0f3723c5-e80f-4fe5-bb38-7932813a5325 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Attempting to driver detach volume c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 from mountpoint /dev/vdb
Jul 29 13:51:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0f3723c5-e80f-4fe5-bb38-7932813a5325 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Attempting to detach device vdb from instance b9751029-dfed-4342-ad92-9ae53d72fbc1 from the persistent domain config. {{(pid=231753) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 13:51:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-0f3723c5-e80f-4fe5-bb38-7932813a5325 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:51:05 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:51:05 user nova-compute[231753]:   <source dev="/dev/sde"/>
Jul 29 13:51:05 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:51:05 user nova-compute[231753]:   <serial>c2fb3633-09eb-4b75-84b7-cdd15d3ceb43</serial>
Jul 29 13:51:05 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 13:51:05 user nova-compute[231753]: </disk>
Jul 29 13:51:05 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:51:05 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-0f3723c5-e80f-4fe5-bb38-7932813a5325 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Successfully detached device vdb from instance b9751029-dfed-4342-ad92-9ae53d72fbc1 from the persistent domain config.
Jul 29 13:51:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0f3723c5-e80f-4fe5-bb38-7932813a5325 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance b9751029-dfed-4342-ad92-9ae53d72fbc1 from the live domain config. {{(pid=231753) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 13:51:05 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-0f3723c5-e80f-4fe5-bb38-7932813a5325 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:51:05 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:51:05 user nova-compute[231753]:   <source dev="/dev/sde"/>
Jul 29 13:51:05 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:51:05 user nova-compute[231753]:   <serial>c2fb3633-09eb-4b75-84b7-cdd15d3ceb43</serial>
Jul 29 13:51:05 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 13:51:05 user nova-compute[231753]: </disk>
Jul 29 13:51:05 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Received event <DeviceRemovedEvent: 1690638666.3033977, b9751029-dfed-4342-ad92-9ae53d72fbc1 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=231753) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-0f3723c5-e80f-4fe5-bb38-7932813a5325 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance b9751029-dfed-4342-ad92-9ae53d72fbc1 {{(pid=231753) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 13:51:06 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-0f3723c5-e80f-4fe5-bb38-7932813a5325 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Successfully detached device vdb from instance b9751029-dfed-4342-ad92-9ae53d72fbc1 from the live domain config.
Jul 29 13:51:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f3723c5-e80f-4fe5-bb38-7932813a5325 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3723c5-e80f-4fe5-bb38-7932813a5325 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'CoWzsqPE', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:51:06 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-0f3723c5-e80f-4fe5-bb38-7932813a5325 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:51:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-0f3723c5-e80f-4fe5-bb38-7932813a5325 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-0f3723c5-e80f-4fe5-bb38-7932813a5325 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04f2641-cf25-46ac-8337-6e1af008412a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3723c5-e80f-4fe5-bb38-7932813a5325 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:51:06 user nova-compute[231753]: No targets found.
Jul 29 13:51:06 user nova-compute[231753]: iSNS:
Jul 29 13:51:06 user nova-compute[231753]: No targets found.
Jul 29 13:51:06 user nova-compute[231753]: STATIC:
Jul 29 13:51:06 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea
Jul 29 13:51:06 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:51:06 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:51:06 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43
Jul 29 13:51:06 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:51:06 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:51:06 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a
Jul 29 13:51:06 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:51:06 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:51:06 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a
Jul 29 13:51:06 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:51:06 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:51:06 user nova-compute[231753]: FIRMWARE:
Jul 29 13:51:06 user nova-compute[231753]: No targets found.
Jul 29 13:51:06 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3723c5-e80f-4fe5-bb38-7932813a5325 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:51:06 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:51:06 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3723c5-e80f-4fe5-bb38-7932813a5325 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c8a9b1f-8936-44b1-a6e6-d49d2f4ff874]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee5aee6-de21-467e-99fb-0f871ffbd053]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3723c5-e80f-4fe5-bb38-7932813a5325 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:51:06 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:51:06 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:51:06 user nova-compute[231753]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a (non-flash)
Jul 29 13:51:06 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3723c5-e80f-4fe5-bb38-7932813a5325 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:51:06 user nova-compute[231753]: tcp: [35] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 (non-flash)
Jul 29 13:51:06 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:51:06 user nova-compute[231753]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a (non-flash)
Jul 29 13:51:06 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3723c5-e80f-4fe5-bb38-7932813a5325 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c80466e60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43'): ({'sde'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-0f3723c5-e80f-4fe5-bb38-7932813a5325 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Removing single pathed devices sde {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[60aa62fe-d381-441e-905b-fc3001472bd7]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f1fc5fa-0382-4fb4-b41c-7487c09ae769]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-0f3723c5-e80f-4fe5-bb38-7932813a5325 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Flushing IO for device /dev/sde {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2b962c9-95f7-4fa4-a85e-0db928129068]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-0f3723c5-e80f-4fe5-bb38-7932813a5325 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.039s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9ef4a8-8a48-4e5f-bd96-534d84399bcd]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-0f3723c5-e80f-4fe5-bb38-7932813a5325 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-0f3723c5-e80f-4fe5-bb38-7932813a5325 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] SCSI volumes sde have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3723c5-e80f-4fe5-bb38-7932813a5325 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f429ec1-6ed2-46c3-ad6a-abd0cb798f41]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3723c5-e80f-4fe5-bb38-7932813a5325 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f36b8ee3-d914-4dd9-b645-3b5897fd44b8]: (4, ('Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43, portal: 172.16.0.220,3260]\nLogout of [sid: 35, target: iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3723c5-e80f-4fe5-bb38-7932813a5325 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43, portal: 172.16.0.220,3260]
Jul 29 13:51:06 user nova-compute[231753]: Logout of [sid: 35, target: iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43, portal: 172.16.0.220,3260] successful.
Jul 29 13:51:06 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:c2fb3633-09eb-4b75-84b7-cdd15d3ceb43 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d42f8fa-2e9e-4f04-93cc-9b2d2ee1d78b]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3723c5-e80f-4fe5-bb38-7932813a5325 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-0f3723c5-e80f-4fe5-bb38-7932813a5325 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-0f3723c5-e80f-4fe5-bb38-7932813a5325 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] <== disconnect_volume: return (314ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:51:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-0f3723c5-e80f-4fe5-bb38-7932813a5325 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:51:07 user nova-compute[231753]: DEBUG nova.compute.manager [req-32f1c1e7-3ff7-4846-a493-6cee4b28f5ff req-bcd9bd31-b1e4-43f9-a6a5-db04c3cf4b29 service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Received event network-changed-a25ce12c-a83d-4128-ac1e-62ca02ae31fd {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:51:07 user nova-compute[231753]: DEBUG nova.compute.manager [req-32f1c1e7-3ff7-4846-a493-6cee4b28f5ff req-bcd9bd31-b1e4-43f9-a6a5-db04c3cf4b29 service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Refreshing instance network info cache due to event network-changed-a25ce12c-a83d-4128-ac1e-62ca02ae31fd. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:51:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-32f1c1e7-3ff7-4846-a493-6cee4b28f5ff req-bcd9bd31-b1e4-43f9-a6a5-db04c3cf4b29 service nova] Acquiring lock "refresh_cache-b9751029-dfed-4342-ad92-9ae53d72fbc1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:51:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-32f1c1e7-3ff7-4846-a493-6cee4b28f5ff req-bcd9bd31-b1e4-43f9-a6a5-db04c3cf4b29 service nova] Acquired lock "refresh_cache-b9751029-dfed-4342-ad92-9ae53d72fbc1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:51:07 user nova-compute[231753]: DEBUG nova.network.neutron [req-32f1c1e7-3ff7-4846-a493-6cee4b28f5ff req-bcd9bd31-b1e4-43f9-a6a5-db04c3cf4b29 service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Refreshing network info cache for port a25ce12c-a83d-4128-ac1e-62ca02ae31fd {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:51:07 user nova-compute[231753]: DEBUG nova.objects.instance [None req-0f3723c5-e80f-4fe5-bb38-7932813a5325 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lazy-loading 'flavor' on Instance uuid b9751029-dfed-4342-ad92-9ae53d72fbc1 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:51:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-0f3723c5-e80f-4fe5-bb38-7932813a5325 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.674s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:07 user nova-compute[231753]: DEBUG nova.network.neutron [req-32f1c1e7-3ff7-4846-a493-6cee4b28f5ff req-bcd9bd31-b1e4-43f9-a6a5-db04c3cf4b29 service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Updated VIF entry in instance network info cache for port a25ce12c-a83d-4128-ac1e-62ca02ae31fd. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:51:07 user nova-compute[231753]: DEBUG nova.network.neutron [req-32f1c1e7-3ff7-4846-a493-6cee4b28f5ff req-bcd9bd31-b1e4-43f9-a6a5-db04c3cf4b29 service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Updating instance_info_cache with network_info: [{"id": "a25ce12c-a83d-4128-ac1e-62ca02ae31fd", "address": "fa:16:3e:8f:41:ff", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25ce12c-a8", "ovs_interfaceid": "a25ce12c-a83d-4128-ac1e-62ca02ae31fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:51:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-32f1c1e7-3ff7-4846-a493-6cee4b28f5ff req-bcd9bd31-b1e4-43f9-a6a5-db04c3cf4b29 service nova] Releasing lock "refresh_cache-b9751029-dfed-4342-ad92-9ae53d72fbc1" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:51:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:14 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:51:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 13:51:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdf (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:51:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02501ee9-0dc6-4aa3-8fb8-055bb2989617/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02501ee9-0dc6-4aa3-8fb8-055bb2989617/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02501ee9-0dc6-4aa3-8fb8-055bb2989617/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02501ee9-0dc6-4aa3-8fb8-055bb2989617/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afd6468c-465d-49c9-b01c-93734f2a3e17/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afd6468c-465d-49c9-b01c-93734f2a3e17/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afd6468c-465d-49c9-b01c-93734f2a3e17/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:15 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690638660.5901058, 8dd26572-fe6a-40fd-8c58-6af862b340c4 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:51:15 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] VM Stopped (Lifecycle Event)
Jul 29 13:51:15 user nova-compute[231753]: DEBUG nova.compute.manager [None req-db73b0d9-2e11-4628-8c34-6e99cfcc20e4 None None] [instance: 8dd26572-fe6a-40fd-8c58-6af862b340c4] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:51:15 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/afd6468c-465d-49c9-b01c-93734f2a3e17/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json" returned: 0 in 0.145s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:51:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:51:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "97e71bc1-78c8-4cec-a935-878dd08ff941" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "97e71bc1-78c8-4cec-a935-878dd08ff941" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.003s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:16 user nova-compute[231753]: DEBUG nova.compute.manager [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:51:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:16 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:51:16 user nova-compute[231753]: INFO nova.compute.claims [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Claim successful on node user
Jul 29 13:51:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:17 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:51:17 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:51:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=7338MB free_disk=25.021053314208984GB free_vcpus=2 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 13:51:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:17 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:51:17 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:51:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.867s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:17 user nova-compute[231753]: DEBUG nova.compute.manager [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:51:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.365s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:17 user nova-compute[231753]: DEBUG nova.compute.manager [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:51:17 user nova-compute[231753]: DEBUG nova.network.neutron [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:51:17 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:51:17 user nova-compute[231753]: DEBUG nova.compute.manager [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:51:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 7e2615c1-b03e-4076-bcd9-3585fb11b8ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:51:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8ea52d41-7ec3-44d7-8421-133000ee887b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:51:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance cf326e80-7293-4764-9411-ed05a5aeba23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:51:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b99a72ba-73e2-4be7-b52b-7797351daa5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:51:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b9751029-dfed-4342-ad92-9ae53d72fbc1 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:51:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b6be450b-ebe7-4385-b162-2d072237aa97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:51:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance afd6468c-465d-49c9-b01c-93734f2a3e17 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:51:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 02501ee9-0dc6-4aa3-8fb8-055bb2989617 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:51:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:51:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance c5f39add-9361-4cf7-aa3a-643f0a8252a7 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:51:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 97e71bc1-78c8-4cec-a935-878dd08ff941 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:51:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 11 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 13:51:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=6144MB phys_disk=40GB used_disk=8GB total_vcpus=12 used_vcpus=11 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 13:51:17 user nova-compute[231753]: DEBUG nova.policy [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '68002afa2ff64150afe91714800481ae', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0d7f4b7f8641f9890a4ac009942190', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:51:17 user nova-compute[231753]: DEBUG nova.compute.manager [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:51:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:51:17 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Creating image(s)
Jul 29 13:51:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "/opt/stack/data/nova/instances/97e71bc1-78c8-4cec-a935-878dd08ff941/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "/opt/stack/data/nova/instances/97e71bc1-78c8-4cec-a935-878dd08ff941/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "/opt/stack/data/nova/instances/97e71bc1-78c8-4cec-a935-878dd08ff941/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "51233dd1e4970562644a3107ffa6994078a0c38b" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "51233dd1e4970562644a3107ffa6994078a0c38b" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51233dd1e4970562644a3107ffa6994078a0c38b.part --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51233dd1e4970562644a3107ffa6994078a0c38b.part --force-share --output=json" returned: 0 in 0.182s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:18 user nova-compute[231753]: DEBUG nova.virt.images [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] a69293a2-3e13-494a-9a0f-64f701eb7b42 was qcow2, converting to raw {{(pid=231753) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 29 13:51:18 user nova-compute[231753]: DEBUG nova.privsep.utils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=231753) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 29 13:51:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/51233dd1e4970562644a3107ffa6994078a0c38b.part /opt/stack/data/nova/instances/_base/51233dd1e4970562644a3107ffa6994078a0c38b.converted {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:18 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:51:18 user nova-compute[231753]: DEBUG nova.network.neutron [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Successfully created port: 75a46a16-882f-4bf9-96bf-a6874ecfbcc1 {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:51:18 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:51:18 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 13:51:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 1.071s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/51233dd1e4970562644a3107ffa6994078a0c38b.part /opt/stack/data/nova/instances/_base/51233dd1e4970562644a3107ffa6994078a0c38b.converted" returned: 0 in 0.415s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51233dd1e4970562644a3107ffa6994078a0c38b.converted --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51233dd1e4970562644a3107ffa6994078a0c38b.converted --force-share --output=json" returned: 0 in 0.142s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "51233dd1e4970562644a3107ffa6994078a0c38b" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.222s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51233dd1e4970562644a3107ffa6994078a0c38b --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51233dd1e4970562644a3107ffa6994078a0c38b --force-share --output=json" returned: 0 in 0.132s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "51233dd1e4970562644a3107ffa6994078a0c38b" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "51233dd1e4970562644a3107ffa6994078a0c38b" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51233dd1e4970562644a3107ffa6994078a0c38b --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51233dd1e4970562644a3107ffa6994078a0c38b --force-share --output=json" returned: 0 in 0.129s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/51233dd1e4970562644a3107ffa6994078a0c38b,backing_fmt=raw /opt/stack/data/nova/instances/97e71bc1-78c8-4cec-a935-878dd08ff941/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/51233dd1e4970562644a3107ffa6994078a0c38b,backing_fmt=raw /opt/stack/data/nova/instances/97e71bc1-78c8-4cec-a935-878dd08ff941/disk 1073741824" returned: 0 in 0.051s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "51233dd1e4970562644a3107ffa6994078a0c38b" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.188s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51233dd1e4970562644a3107ffa6994078a0c38b --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/51233dd1e4970562644a3107ffa6994078a0c38b --force-share --output=json" returned: 0 in 0.141s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:19 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Checking if we can resize image /opt/stack/data/nova/instances/97e71bc1-78c8-4cec-a935-878dd08ff941/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:51:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e71bc1-78c8-4cec-a935-878dd08ff941/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:19 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:51:19 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 13:51:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e71bc1-78c8-4cec-a935-878dd08ff941/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:19 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Cannot resize image /opt/stack/data/nova/instances/97e71bc1-78c8-4cec-a935-878dd08ff941/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:51:19 user nova-compute[231753]: DEBUG nova.objects.instance [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lazy-loading 'migration_context' on Instance uuid 97e71bc1-78c8-4cec-a935-878dd08ff941 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:51:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:51:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Ensure instance console log exists: /opt/stack/data/nova/instances/97e71bc1-78c8-4cec-a935-878dd08ff941/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:51:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "refresh_cache-b99a72ba-73e2-4be7-b52b-7797351daa5f" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:51:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquired lock "refresh_cache-b99a72ba-73e2-4be7-b52b-7797351daa5f" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:51:19 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Forcefully refreshing network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.network.neutron [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Successfully updated port: 75a46a16-882f-4bf9-96bf-a6874ecfbcc1 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "refresh_cache-97e71bc1-78c8-4cec-a935-878dd08ff941" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquired lock "refresh_cache-97e71bc1-78c8-4cec-a935-878dd08ff941" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.network.neutron [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.compute.manager [req-e4ddb59f-8d28-4f65-9181-fe948bb8633f req-de68a15c-f1a4-432c-8769-8d8ec0374ac9 service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Received event network-changed-75a46a16-882f-4bf9-96bf-a6874ecfbcc1 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.compute.manager [req-e4ddb59f-8d28-4f65-9181-fe948bb8633f req-de68a15c-f1a4-432c-8769-8d8ec0374ac9 service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Refreshing instance network info cache due to event network-changed-75a46a16-882f-4bf9-96bf-a6874ecfbcc1. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e4ddb59f-8d28-4f65-9181-fe948bb8633f req-de68a15c-f1a4-432c-8769-8d8ec0374ac9 service nova] Acquiring lock "refresh_cache-97e71bc1-78c8-4cec-a935-878dd08ff941" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.network.neutron [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1e8418f2-f020-406c-b051-4b0dd7fed2d9 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Acquiring lock "afd6468c-465d-49c9-b01c-93734f2a3e17" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1e8418f2-f020-406c-b051-4b0dd7fed2d9 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "afd6468c-465d-49c9-b01c-93734f2a3e17" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1e8418f2-f020-406c-b051-4b0dd7fed2d9 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Acquiring lock "afd6468c-465d-49c9-b01c-93734f2a3e17-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1e8418f2-f020-406c-b051-4b0dd7fed2d9 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "afd6468c-465d-49c9-b01c-93734f2a3e17-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1e8418f2-f020-406c-b051-4b0dd7fed2d9 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "afd6468c-465d-49c9-b01c-93734f2a3e17-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:20 user nova-compute[231753]: INFO nova.compute.manager [None req-1e8418f2-f020-406c-b051-4b0dd7fed2d9 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Terminating instance
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.compute.manager [None req-1e8418f2-f020-406c-b051-4b0dd7fed2d9 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Updating instance_info_cache with network_info: [{"id": "d145cf59-908e-42c4-ba8e-ce5abe640639", "address": "fa:16:3e:25:37:92", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd145cf59-90", "ovs_interfaceid": "d145cf59-908e-42c4-ba8e-ce5abe640639", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.network.neutron [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Updating instance_info_cache with network_info: [{"id": "75a46a16-882f-4bf9-96bf-a6874ecfbcc1", "address": "fa:16:3e:30:50:53", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a46a16-88", "ovs_interfaceid": "75a46a16-882f-4bf9-96bf-a6874ecfbcc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Releasing lock "refresh_cache-b99a72ba-73e2-4be7-b52b-7797351daa5f" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Updated the network info_cache for instance {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Releasing lock "refresh_cache-97e71bc1-78c8-4cec-a935-878dd08ff941" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.compute.manager [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Instance network_info: |[{"id": "75a46a16-882f-4bf9-96bf-a6874ecfbcc1", "address": "fa:16:3e:30:50:53", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a46a16-88", "ovs_interfaceid": "75a46a16-882f-4bf9-96bf-a6874ecfbcc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e4ddb59f-8d28-4f65-9181-fe948bb8633f req-de68a15c-f1a4-432c-8769-8d8ec0374ac9 service nova] Acquired lock "refresh_cache-97e71bc1-78c8-4cec-a935-878dd08ff941" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.network.neutron [req-e4ddb59f-8d28-4f65-9181-fe948bb8633f req-de68a15c-f1a4-432c-8769-8d8ec0374ac9 service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Refreshing network info cache for port 75a46a16-882f-4bf9-96bf-a6874ecfbcc1 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Start _get_guest_xml network_info=[{"id": "75a46a16-882f-4bf9-96bf-a6874ecfbcc1", "address": "fa:16:3e:30:50:53", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a46a16-88", "ovs_interfaceid": "75a46a16-882f-4bf9-96bf-a6874ecfbcc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:51:14Z,direct_url=<?>,disk_format='qcow2',id=a69293a2-3e13-494a-9a0f-64f701eb7b42,min_disk=0,min_ram=0,name='tempest-scenario-img--2021076457',owner='3a0d7f4b7f8641f9890a4ac009942190',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:51:15Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'a69293a2-3e13-494a-9a0f-64f701eb7b42'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:20 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:51:20 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:51:14Z,direct_url=<?>,disk_format='qcow2',id=a69293a2-3e13-494a-9a0f-64f701eb7b42,min_disk=0,min_ram=0,name='tempest-scenario-img--2021076457',owner='3a0d7f4b7f8641f9890a4ac009942190',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:51:15Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:51:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-623497348',display_name='tempest-TestMinimumBasicScenario-server-623497348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-623497348',id=37,image_ref='a69293a2-3e13-494a-9a0f-64f701eb7b42',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDOdfCNsbojYeYIkRNTLRDWsKJreXr26I372pDbUnepiBzx/HRGHPMMnhrKYhGNX4qRkP9AX1pbq9ip43Kw9pYI3s0aq6n5ZHgh/lwRbTaOa5eLkKoFj8x7EJE+lG3xfQ==',key_name='tempest-TestMinimumBasicScenario-1021821811',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a0d7f4b7f8641f9890a4ac009942190',ramdisk_id='',reservation_id='r-00c46pla',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a69293a2-3e13-494a-9a0f-64f701eb7b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-187684118',owner_user_name='tempest-TestMinimumBasicScenario-187684118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:51:18Z,user_data=None,user_id='68002afa2ff64150afe91714800481ae',uuid=97e71bc1-78c8-4cec-a935-878dd08ff941,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75a46a16-882f-4bf9-96bf-a6874ecfbcc1", "address": "fa:16:3e:30:50:53", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a46a16-88", "ovs_interfaceid": "75a46a16-882f-4bf9-96bf-a6874ecfbcc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Converting VIF {"id": "75a46a16-882f-4bf9-96bf-a6874ecfbcc1", "address": "fa:16:3e:30:50:53", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a46a16-88", "ovs_interfaceid": "75a46a16-882f-4bf9-96bf-a6874ecfbcc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:50:53,bridge_name='br-int',has_traffic_filtering=True,id=75a46a16-882f-4bf9-96bf-a6874ecfbcc1,network=Network(70a92bb8-13dd-4b75-9986-5c136de68b16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a46a16-88') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.objects.instance [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lazy-loading 'pci_devices' on Instance uuid 97e71bc1-78c8-4cec-a935-878dd08ff941 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:51:20 user nova-compute[231753]:   <uuid>97e71bc1-78c8-4cec-a935-878dd08ff941</uuid>
Jul 29 13:51:20 user nova-compute[231753]:   <name>instance-00000025</name>
Jul 29 13:51:20 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:51:20 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:51:20 user nova-compute[231753]:   <metadata>
Jul 29 13:51:20 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:51:20 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:51:20 user nova-compute[231753]:       <nova:name>tempest-TestMinimumBasicScenario-server-623497348</nova:name>
Jul 29 13:51:20 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:51:20</nova:creationTime>
Jul 29 13:51:20 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:51:20 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:51:20 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:51:20 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:51:20 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:51:20 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:51:20 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:51:20 user nova-compute[231753]:       <nova:owner>
Jul 29 13:51:20 user nova-compute[231753]:         <nova:user uuid="68002afa2ff64150afe91714800481ae">tempest-TestMinimumBasicScenario-187684118-project-member</nova:user>
Jul 29 13:51:20 user nova-compute[231753]:         <nova:project uuid="3a0d7f4b7f8641f9890a4ac009942190">tempest-TestMinimumBasicScenario-187684118</nova:project>
Jul 29 13:51:20 user nova-compute[231753]:       </nova:owner>
Jul 29 13:51:20 user nova-compute[231753]:       <nova:root type="image" uuid="a69293a2-3e13-494a-9a0f-64f701eb7b42"/>
Jul 29 13:51:20 user nova-compute[231753]:       <nova:ports>
Jul 29 13:51:20 user nova-compute[231753]:         <nova:port uuid="75a46a16-882f-4bf9-96bf-a6874ecfbcc1">
Jul 29 13:51:20 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 29 13:51:20 user nova-compute[231753]:         </nova:port>
Jul 29 13:51:20 user nova-compute[231753]:       </nova:ports>
Jul 29 13:51:20 user nova-compute[231753]:     </nova:instance>
Jul 29 13:51:20 user nova-compute[231753]:   </metadata>
Jul 29 13:51:20 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:51:20 user nova-compute[231753]:     <system>
Jul 29 13:51:20 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:51:20 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:51:20 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:51:20 user nova-compute[231753]:       <entry name="serial">97e71bc1-78c8-4cec-a935-878dd08ff941</entry>
Jul 29 13:51:20 user nova-compute[231753]:       <entry name="uuid">97e71bc1-78c8-4cec-a935-878dd08ff941</entry>
Jul 29 13:51:20 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:51:20 user nova-compute[231753]:     </system>
Jul 29 13:51:20 user nova-compute[231753]:   </sysinfo>
Jul 29 13:51:20 user nova-compute[231753]:   <os>
Jul 29 13:51:20 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:51:20 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:51:20 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:51:20 user nova-compute[231753]:   </os>
Jul 29 13:51:20 user nova-compute[231753]:   <features>
Jul 29 13:51:20 user nova-compute[231753]:     <acpi/>
Jul 29 13:51:20 user nova-compute[231753]:     <apic/>
Jul 29 13:51:20 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:51:20 user nova-compute[231753]:   </features>
Jul 29 13:51:20 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:51:20 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:51:20 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:51:20 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:51:20 user nova-compute[231753]:   </clock>
Jul 29 13:51:20 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:51:20 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:51:20 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:51:20 user nova-compute[231753]:   </cpu>
Jul 29 13:51:20 user nova-compute[231753]:   <devices>
Jul 29 13:51:20 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:51:20 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:51:20 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/97e71bc1-78c8-4cec-a935-878dd08ff941/disk"/>
Jul 29 13:51:20 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:51:20 user nova-compute[231753]:     </disk>
Jul 29 13:51:20 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:51:20 user nova-compute[231753]:       <mac address="fa:16:3e:30:50:53"/>
Jul 29 13:51:20 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:51:20 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:51:20 user nova-compute[231753]:       <target dev="tap75a46a16-88"/>
Jul 29 13:51:20 user nova-compute[231753]:     </interface>
Jul 29 13:51:20 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:51:20 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/97e71bc1-78c8-4cec-a935-878dd08ff941/console.log" append="off"/>
Jul 29 13:51:20 user nova-compute[231753]:     </serial>
Jul 29 13:51:20 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:51:20 user nova-compute[231753]:     <video>
Jul 29 13:51:20 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:51:20 user nova-compute[231753]:     </video>
Jul 29 13:51:20 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:51:20 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:51:20 user nova-compute[231753]:     </rng>
Jul 29 13:51:20 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:51:20 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:51:20 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:51:20 user nova-compute[231753]:     </memballoon>
Jul 29 13:51:20 user nova-compute[231753]:   </devices>
Jul 29 13:51:20 user nova-compute[231753]: </domain>
Jul 29 13:51:20 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:51:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-623497348',display_name='tempest-TestMinimumBasicScenario-server-623497348',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-623497348',id=37,image_ref='a69293a2-3e13-494a-9a0f-64f701eb7b42',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDOdfCNsbojYeYIkRNTLRDWsKJreXr26I372pDbUnepiBzx/HRGHPMMnhrKYhGNX4qRkP9AX1pbq9ip43Kw9pYI3s0aq6n5ZHgh/lwRbTaOa5eLkKoFj8x7EJE+lG3xfQ==',key_name='tempest-TestMinimumBasicScenario-1021821811',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='3a0d7f4b7f8641f9890a4ac009942190',ramdisk_id='',reservation_id='r-00c46pla',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a69293a2-3e13-494a-9a0f-64f701eb7b42',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-TestMinimumBasicScenario-187684118',owner_user_name='tempest-TestMinimumBasicScenario-187684118-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:51:18Z,user_data=None,user_id='68002afa2ff64150afe91714800481ae',uuid=97e71bc1-78c8-4cec-a935-878dd08ff941,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "75a46a16-882f-4bf9-96bf-a6874ecfbcc1", "address": "fa:16:3e:30:50:53", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a46a16-88", "ovs_interfaceid": "75a46a16-882f-4bf9-96bf-a6874ecfbcc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Converting VIF {"id": "75a46a16-882f-4bf9-96bf-a6874ecfbcc1", "address": "fa:16:3e:30:50:53", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a46a16-88", "ovs_interfaceid": "75a46a16-882f-4bf9-96bf-a6874ecfbcc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:30:50:53,bridge_name='br-int',has_traffic_filtering=True,id=75a46a16-882f-4bf9-96bf-a6874ecfbcc1,network=Network(70a92bb8-13dd-4b75-9986-5c136de68b16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a46a16-88') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG os_vif [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:50:53,bridge_name='br-int',has_traffic_filtering=True,id=75a46a16-882f-4bf9-96bf-a6874ecfbcc1,network=Network(70a92bb8-13dd-4b75-9986-5c136de68b16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a46a16-88') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap75a46a16-88, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap75a46a16-88, col_values=(('external_ids', {'iface-id': '75a46a16-882f-4bf9-96bf-a6874ecfbcc1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:30:50:53', 'vm-uuid': '97e71bc1-78c8-4cec-a935-878dd08ff941'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:20 user nova-compute[231753]: INFO os_vif [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:30:50:53,bridge_name='br-int',has_traffic_filtering=True,id=75a46a16-882f-4bf9-96bf-a6874ecfbcc1,network=Network(70a92bb8-13dd-4b75-9986-5c136de68b16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a46a16-88')
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:51:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] No VIF found with MAC fa:16:3e:30:50:53, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:51:21 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:51:21 user nova-compute[231753]: DEBUG nova.network.neutron [req-e4ddb59f-8d28-4f65-9181-fe948bb8633f req-de68a15c-f1a4-432c-8769-8d8ec0374ac9 service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Updated VIF entry in instance network info cache for port 75a46a16-882f-4bf9-96bf-a6874ecfbcc1. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:51:21 user nova-compute[231753]: DEBUG nova.network.neutron [req-e4ddb59f-8d28-4f65-9181-fe948bb8633f req-de68a15c-f1a4-432c-8769-8d8ec0374ac9 service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Updating instance_info_cache with network_info: [{"id": "75a46a16-882f-4bf9-96bf-a6874ecfbcc1", "address": "fa:16:3e:30:50:53", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a46a16-88", "ovs_interfaceid": "75a46a16-882f-4bf9-96bf-a6874ecfbcc1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:51:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e4ddb59f-8d28-4f65-9181-fe948bb8633f req-de68a15c-f1a4-432c-8769-8d8ec0374ac9 service nova] Releasing lock "refresh_cache-97e71bc1-78c8-4cec-a935-878dd08ff941" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:51:21 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:51:21 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:51:21 user nova-compute[231753]: DEBUG nova.compute.manager [req-bbd4ccf6-40d4-43e1-861f-ecae1339cf75 req-985220b6-8b5d-4747-92b3-38447a94ee2a service nova] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Received event network-vif-unplugged-c940d941-2958-47b0-a186-d56be39e524f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:51:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bbd4ccf6-40d4-43e1-861f-ecae1339cf75 req-985220b6-8b5d-4747-92b3-38447a94ee2a service nova] Acquiring lock "afd6468c-465d-49c9-b01c-93734f2a3e17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bbd4ccf6-40d4-43e1-861f-ecae1339cf75 req-985220b6-8b5d-4747-92b3-38447a94ee2a service nova] Lock "afd6468c-465d-49c9-b01c-93734f2a3e17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bbd4ccf6-40d4-43e1-861f-ecae1339cf75 req-985220b6-8b5d-4747-92b3-38447a94ee2a service nova] Lock "afd6468c-465d-49c9-b01c-93734f2a3e17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:21 user nova-compute[231753]: DEBUG nova.compute.manager [req-bbd4ccf6-40d4-43e1-861f-ecae1339cf75 req-985220b6-8b5d-4747-92b3-38447a94ee2a service nova] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] No waiting events found dispatching network-vif-unplugged-c940d941-2958-47b0-a186-d56be39e524f {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:51:21 user nova-compute[231753]: DEBUG nova.compute.manager [req-bbd4ccf6-40d4-43e1-861f-ecae1339cf75 req-985220b6-8b5d-4747-92b3-38447a94ee2a service nova] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Received event network-vif-unplugged-c940d941-2958-47b0-a186-d56be39e524f for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:51:21 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Instance destroyed successfully.
Jul 29 13:51:21 user nova-compute[231753]: DEBUG nova.objects.instance [None req-1e8418f2-f020-406c-b051-4b0dd7fed2d9 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lazy-loading 'resources' on Instance uuid afd6468c-465d-49c9-b01c-93734f2a3e17 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:51:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-1e8418f2-f020-406c-b051-4b0dd7fed2d9 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:47:15Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachmentScenario-server-1481110770',display_name='tempest-TestServerVolumeAttachmentScenario-server-1481110770',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachmentscenario-server-1481110770',id=33,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN/kDOAHpIapUpqn7h3NHfDM6ynEXAJ8jYQGkyLGs0GIeOss8BfqqQrNLNTRb3sHEsNZLEeq8fwO0YmpqI8DKBs/11c50sMi6qFf4jbutrdpPLlbmNaDftzOO3CPShnsTQ==',key_name='tempest-keypair-1581638911',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:47:24Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='9f0063caba494df79d23ee7ab6cca952',ramdisk_id='',reservation_id='r-iiyrv4ei',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachmentScenario-112712067',owner_user_name='tempest-TestServerVolumeAttachmentScenario-112712067-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:47:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='799028ef2fe14bebac752577fd148047',uuid=afd6468c-465d-49c9-b01c-93734f2a3e17,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c940d941-2958-47b0-a186-d56be39e524f", "address": "fa:16:3e:ad:34:94", "network": {"id": "e07105bf-cfaf-4a04-be90-27b9f5a1dce1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2002932258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f0063caba494df79d23ee7ab6cca952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc940d941-29", "ovs_interfaceid": "c940d941-2958-47b0-a186-d56be39e524f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:51:21 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-1e8418f2-f020-406c-b051-4b0dd7fed2d9 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Converting VIF {"id": "c940d941-2958-47b0-a186-d56be39e524f", "address": "fa:16:3e:ad:34:94", "network": {"id": "e07105bf-cfaf-4a04-be90-27b9f5a1dce1", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachmentScenario-2002932258-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "9f0063caba494df79d23ee7ab6cca952", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapc940d941-29", "ovs_interfaceid": "c940d941-2958-47b0-a186-d56be39e524f", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:51:21 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-1e8418f2-f020-406c-b051-4b0dd7fed2d9 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ad:34:94,bridge_name='br-int',has_traffic_filtering=True,id=c940d941-2958-47b0-a186-d56be39e524f,network=Network(e07105bf-cfaf-4a04-be90-27b9f5a1dce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc940d941-29') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:51:21 user nova-compute[231753]: DEBUG os_vif [None req-1e8418f2-f020-406c-b051-4b0dd7fed2d9 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:34:94,bridge_name='br-int',has_traffic_filtering=True,id=c940d941-2958-47b0-a186-d56be39e524f,network=Network(e07105bf-cfaf-4a04-be90-27b9f5a1dce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc940d941-29') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:51:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc940d941-29, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:51:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:51:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:21 user nova-compute[231753]: INFO os_vif [None req-1e8418f2-f020-406c-b051-4b0dd7fed2d9 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ad:34:94,bridge_name='br-int',has_traffic_filtering=True,id=c940d941-2958-47b0-a186-d56be39e524f,network=Network(e07105bf-cfaf-4a04-be90-27b9f5a1dce1),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc940d941-29')
Jul 29 13:51:21 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-1e8418f2-f020-406c-b051-4b0dd7fed2d9 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Deleting instance files /opt/stack/data/nova/instances/afd6468c-465d-49c9-b01c-93734f2a3e17_del
Jul 29 13:51:21 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-1e8418f2-f020-406c-b051-4b0dd7fed2d9 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Deletion of /opt/stack/data/nova/instances/afd6468c-465d-49c9-b01c-93734f2a3e17_del complete
Jul 29 13:51:22 user nova-compute[231753]: INFO nova.compute.manager [None req-1e8418f2-f020-406c-b051-4b0dd7fed2d9 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Took 1.65 seconds to destroy the instance on the hypervisor.
Jul 29 13:51:22 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-1e8418f2-f020-406c-b051-4b0dd7fed2d9 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:51:22 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:51:22 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:51:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:22 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:51:22 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Took 0.93 seconds to deallocate network for instance.
Jul 29 13:51:22 user nova-compute[231753]: DEBUG nova.compute.manager [req-825a49ca-c319-405a-9d7a-5cbde50b8cbb req-08bb3d78-4335-49b0-a8ad-15e3982bc34f service nova] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Received event network-vif-deleted-c940d941-2958-47b0-a186-d56be39e524f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:51:22 user nova-compute[231753]: INFO nova.compute.manager [req-825a49ca-c319-405a-9d7a-5cbde50b8cbb req-08bb3d78-4335-49b0-a8ad-15e3982bc34f service nova] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Neutron deleted interface c940d941-2958-47b0-a186-d56be39e524f; detaching it from the instance and deleting it from the info cache
Jul 29 13:51:22 user nova-compute[231753]: DEBUG nova.network.neutron [req-825a49ca-c319-405a-9d7a-5cbde50b8cbb req-08bb3d78-4335-49b0-a8ad-15e3982bc34f service nova] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:51:22 user nova-compute[231753]: DEBUG nova.compute.manager [req-825a49ca-c319-405a-9d7a-5cbde50b8cbb req-08bb3d78-4335-49b0-a8ad-15e3982bc34f service nova] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Detach interface failed, port_id=c940d941-2958-47b0-a186-d56be39e524f, reason: Instance afd6468c-465d-49c9-b01c-93734f2a3e17 could not be found. {{(pid=231753) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 13:51:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1e8418f2-f020-406c-b051-4b0dd7fed2d9 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1e8418f2-f020-406c-b051-4b0dd7fed2d9 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:23 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-1e8418f2-f020-406c-b051-4b0dd7fed2d9 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:51:23 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-1e8418f2-f020-406c-b051-4b0dd7fed2d9 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:51:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1e8418f2-f020-406c-b051-4b0dd7fed2d9 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.427s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:23 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-1e8418f2-f020-406c-b051-4b0dd7fed2d9 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Deleted allocations for instance afd6468c-465d-49c9-b01c-93734f2a3e17
Jul 29 13:51:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1e8418f2-f020-406c-b051-4b0dd7fed2d9 tempest-TestServerVolumeAttachmentScenario-112712067 tempest-TestServerVolumeAttachmentScenario-112712067-project-member] Lock "afd6468c-465d-49c9-b01c-93734f2a3e17" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.300s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:23 user nova-compute[231753]: DEBUG nova.compute.manager [req-ade70529-4c8e-4fca-b3fb-6d5e84776672 req-bba1ab56-8856-436f-8db4-01c276209ebe service nova] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Received event network-changed-5efea429-64cb-4dde-aa19-0b5152a03181 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:51:23 user nova-compute[231753]: DEBUG nova.compute.manager [req-ade70529-4c8e-4fca-b3fb-6d5e84776672 req-bba1ab56-8856-436f-8db4-01c276209ebe service nova] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Refreshing instance network info cache due to event network-changed-5efea429-64cb-4dde-aa19-0b5152a03181. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:51:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ade70529-4c8e-4fca-b3fb-6d5e84776672 req-bba1ab56-8856-436f-8db4-01c276209ebe service nova] Acquiring lock "refresh_cache-02501ee9-0dc6-4aa3-8fb8-055bb2989617" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:51:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ade70529-4c8e-4fca-b3fb-6d5e84776672 req-bba1ab56-8856-436f-8db4-01c276209ebe service nova] Acquired lock "refresh_cache-02501ee9-0dc6-4aa3-8fb8-055bb2989617" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:51:23 user nova-compute[231753]: DEBUG nova.network.neutron [req-ade70529-4c8e-4fca-b3fb-6d5e84776672 req-bba1ab56-8856-436f-8db4-01c276209ebe service nova] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Refreshing network info cache for port 5efea429-64cb-4dde-aa19-0b5152a03181 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:51:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:24 user nova-compute[231753]: DEBUG nova.network.neutron [req-ade70529-4c8e-4fca-b3fb-6d5e84776672 req-bba1ab56-8856-436f-8db4-01c276209ebe service nova] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Updated VIF entry in instance network info cache for port 5efea429-64cb-4dde-aa19-0b5152a03181. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:51:24 user nova-compute[231753]: DEBUG nova.network.neutron [req-ade70529-4c8e-4fca-b3fb-6d5e84776672 req-bba1ab56-8856-436f-8db4-01c276209ebe service nova] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Updating instance_info_cache with network_info: [{"id": "5efea429-64cb-4dde-aa19-0b5152a03181", "address": "fa:16:3e:eb:f5:54", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5efea429-64", "ovs_interfaceid": "5efea429-64cb-4dde-aa19-0b5152a03181", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:51:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ade70529-4c8e-4fca-b3fb-6d5e84776672 req-bba1ab56-8856-436f-8db4-01c276209ebe service nova] Releasing lock "refresh_cache-02501ee9-0dc6-4aa3-8fb8-055bb2989617" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:51:24 user nova-compute[231753]: DEBUG nova.compute.manager [req-ade70529-4c8e-4fca-b3fb-6d5e84776672 req-bba1ab56-8856-436f-8db4-01c276209ebe service nova] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Received event network-vif-plugged-c940d941-2958-47b0-a186-d56be39e524f {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:51:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ade70529-4c8e-4fca-b3fb-6d5e84776672 req-bba1ab56-8856-436f-8db4-01c276209ebe service nova] Acquiring lock "afd6468c-465d-49c9-b01c-93734f2a3e17-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ade70529-4c8e-4fca-b3fb-6d5e84776672 req-bba1ab56-8856-436f-8db4-01c276209ebe service nova] Lock "afd6468c-465d-49c9-b01c-93734f2a3e17-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ade70529-4c8e-4fca-b3fb-6d5e84776672 req-bba1ab56-8856-436f-8db4-01c276209ebe service nova] Lock "afd6468c-465d-49c9-b01c-93734f2a3e17-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:24 user nova-compute[231753]: DEBUG nova.compute.manager [req-ade70529-4c8e-4fca-b3fb-6d5e84776672 req-bba1ab56-8856-436f-8db4-01c276209ebe service nova] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] No waiting events found dispatching network-vif-plugged-c940d941-2958-47b0-a186-d56be39e524f {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:51:24 user nova-compute[231753]: WARNING nova.compute.manager [req-ade70529-4c8e-4fca-b3fb-6d5e84776672 req-bba1ab56-8856-436f-8db4-01c276209ebe service nova] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Received unexpected event network-vif-plugged-c940d941-2958-47b0-a186-d56be39e524f for instance with vm_state deleted and task_state None.
Jul 29 13:51:24 user nova-compute[231753]: DEBUG nova.compute.manager [req-ade70529-4c8e-4fca-b3fb-6d5e84776672 req-bba1ab56-8856-436f-8db4-01c276209ebe service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Received event network-vif-plugged-75a46a16-882f-4bf9-96bf-a6874ecfbcc1 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:51:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ade70529-4c8e-4fca-b3fb-6d5e84776672 req-bba1ab56-8856-436f-8db4-01c276209ebe service nova] Acquiring lock "97e71bc1-78c8-4cec-a935-878dd08ff941-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ade70529-4c8e-4fca-b3fb-6d5e84776672 req-bba1ab56-8856-436f-8db4-01c276209ebe service nova] Lock "97e71bc1-78c8-4cec-a935-878dd08ff941-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ade70529-4c8e-4fca-b3fb-6d5e84776672 req-bba1ab56-8856-436f-8db4-01c276209ebe service nova] Lock "97e71bc1-78c8-4cec-a935-878dd08ff941-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:24 user nova-compute[231753]: DEBUG nova.compute.manager [req-ade70529-4c8e-4fca-b3fb-6d5e84776672 req-bba1ab56-8856-436f-8db4-01c276209ebe service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] No waiting events found dispatching network-vif-plugged-75a46a16-882f-4bf9-96bf-a6874ecfbcc1 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:51:24 user nova-compute[231753]: WARNING nova.compute.manager [req-ade70529-4c8e-4fca-b3fb-6d5e84776672 req-bba1ab56-8856-436f-8db4-01c276209ebe service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Received unexpected event network-vif-plugged-75a46a16-882f-4bf9-96bf-a6874ecfbcc1 for instance with vm_state building and task_state spawning.
Jul 29 13:51:24 user nova-compute[231753]: DEBUG nova.compute.manager [req-ade70529-4c8e-4fca-b3fb-6d5e84776672 req-bba1ab56-8856-436f-8db4-01c276209ebe service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Received event network-vif-plugged-75a46a16-882f-4bf9-96bf-a6874ecfbcc1 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:51:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ade70529-4c8e-4fca-b3fb-6d5e84776672 req-bba1ab56-8856-436f-8db4-01c276209ebe service nova] Acquiring lock "97e71bc1-78c8-4cec-a935-878dd08ff941-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ade70529-4c8e-4fca-b3fb-6d5e84776672 req-bba1ab56-8856-436f-8db4-01c276209ebe service nova] Lock "97e71bc1-78c8-4cec-a935-878dd08ff941-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ade70529-4c8e-4fca-b3fb-6d5e84776672 req-bba1ab56-8856-436f-8db4-01c276209ebe service nova] Lock "97e71bc1-78c8-4cec-a935-878dd08ff941-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:24 user nova-compute[231753]: DEBUG nova.compute.manager [req-ade70529-4c8e-4fca-b3fb-6d5e84776672 req-bba1ab56-8856-436f-8db4-01c276209ebe service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] No waiting events found dispatching network-vif-plugged-75a46a16-882f-4bf9-96bf-a6874ecfbcc1 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:51:24 user nova-compute[231753]: WARNING nova.compute.manager [req-ade70529-4c8e-4fca-b3fb-6d5e84776672 req-bba1ab56-8856-436f-8db4-01c276209ebe service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Received unexpected event network-vif-plugged-75a46a16-882f-4bf9-96bf-a6874ecfbcc1 for instance with vm_state building and task_state spawning.
Jul 29 13:51:25 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638685.066314, 97e71bc1-78c8-4cec-a935-878dd08ff941 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:51:25 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] VM Resumed (Lifecycle Event)
Jul 29 13:51:25 user nova-compute[231753]: DEBUG nova.compute.manager [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:51:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:51:25 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Instance spawned successfully.
Jul 29 13:51:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:51:25 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:51:25 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:51:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:51:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:51:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:51:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:51:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:51:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:51:25 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:51:25 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638685.068647, 97e71bc1-78c8-4cec-a935-878dd08ff941 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:51:25 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] VM Started (Lifecycle Event)
Jul 29 13:51:25 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:51:25 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:51:25 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:51:25 user nova-compute[231753]: INFO nova.compute.manager [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Took 7.18 seconds to spawn the instance on the hypervisor.
Jul 29 13:51:25 user nova-compute[231753]: DEBUG nova.compute.manager [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:51:25 user nova-compute[231753]: INFO nova.compute.manager [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Took 8.46 seconds to build instance.
Jul 29 13:51:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-bef38641-6836-486c-b4d3-f33323a94fd2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "97e71bc1-78c8-4cec-a935-878dd08ff941" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 8.589s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "02501ee9-0dc6-4aa3-8fb8-055bb2989617" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "02501ee9-0dc6-4aa3-8fb8-055bb2989617" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:25 user nova-compute[231753]: DEBUG nova.objects.instance [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lazy-loading 'flavor' on Instance uuid 02501ee9-0dc6-4aa3-8fb8-055bb2989617 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:51:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "02501ee9-0dc6-4aa3-8fb8-055bb2989617" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.105s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "02501ee9-0dc6-4aa3-8fb8-055bb2989617" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "02501ee9-0dc6-4aa3-8fb8-055bb2989617" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:25 user nova-compute[231753]: INFO nova.compute.manager [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Attaching volume b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7 to /dev/vdb
Jul 29 13:51:25 user nova-compute[231753]: DEBUG os_brick.utils [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:51:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc5663b-901a-4d38-bff3-c5ce7cb61d38]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:25 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab926a3d-d5f1-4b0c-86a3-6fad18047c69]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:25 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:26 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a8679f-e74e-49a1-bace-d4b30315dc40]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:26 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a796a3-cf1c-4eed-b664-61256706f083]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:51:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:51:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:51:26 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:51:26 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b73bfbf-84ca-48ba-ba5b-9b35c7e1c6db]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:51:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:51:26 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:51:26 user nova-compute[231753]: DEBUG os_brick.utils [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:51:26 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Updating existing volume attachment record: 3b162ea5-2d1c-4fa8-a7ff-9b74b6256f81 {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:51:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:32 user nova-compute[231753]: INFO nova.compute.manager [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Rescuing
Jul 29 13:51:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "refresh_cache-ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:51:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquired lock "refresh_cache-ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:51:32 user nova-compute[231753]: DEBUG nova.network.neutron [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:51:33 user nova-compute[231753]: DEBUG nova.network.neutron [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Updating instance_info_cache with network_info: [{"id": "dba460c1-334b-4686-b6a3-7d85632d294d", "address": "fa:16:3e:15:f4:85", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba460c1-33", "ovs_interfaceid": "dba460c1-334b-4686-b6a3-7d85632d294d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:51:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Releasing lock "refresh_cache-ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:51:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:33 user nova-compute[231753]: DEBUG nova.compute.manager [req-a2c03720-0b74-4280-8a29-5155539ab47b req-b2476e43-39b9-4758-82ef-0720430d87d7 service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Received event network-vif-unplugged-dba460c1-334b-4686-b6a3-7d85632d294d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:51:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a2c03720-0b74-4280-8a29-5155539ab47b req-b2476e43-39b9-4758-82ef-0720430d87d7 service nova] Acquiring lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a2c03720-0b74-4280-8a29-5155539ab47b req-b2476e43-39b9-4758-82ef-0720430d87d7 service nova] Lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a2c03720-0b74-4280-8a29-5155539ab47b req-b2476e43-39b9-4758-82ef-0720430d87d7 service nova] Lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:33 user nova-compute[231753]: DEBUG nova.compute.manager [req-a2c03720-0b74-4280-8a29-5155539ab47b req-b2476e43-39b9-4758-82ef-0720430d87d7 service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] No waiting events found dispatching network-vif-unplugged-dba460c1-334b-4686-b6a3-7d85632d294d {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:51:33 user nova-compute[231753]: WARNING nova.compute.manager [req-a2c03720-0b74-4280-8a29-5155539ab47b req-b2476e43-39b9-4758-82ef-0720430d87d7 service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Received unexpected event network-vif-unplugged-dba460c1-334b-4686-b6a3-7d85632d294d for instance with vm_state active and task_state rescuing.
Jul 29 13:51:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:33 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Instance destroyed successfully.
Jul 29 13:51:33 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Attempting a stable device rescue
Jul 29 13:51:33 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=231753) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4308}}
Jul 29 13:51:33 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:51:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vDSZEzqf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:51:33 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:51:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:51:34 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:51:34 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:51:34 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:51:34 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:51:34 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:51:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7 -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Instance directory exists: not creating {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4713}}
Jul 29 13:51:34 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Creating image(s)
Jul 29 13:51:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "/opt/stack/data/nova/instances/ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "/opt/stack/data/nova/instances/ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "/opt/stack/data/nova/instances/ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.010s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:34 user nova-compute[231753]: DEBUG nova.objects.instance [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lazy-loading 'trusted_certs' on Instance uuid ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:51:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:34 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b10f91d9-e87c-4e84-a4e2-45c12d2f6ad7]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:34 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:51:34 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:51:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7 -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "cda80058a7f57e29ca4651870917b85da1d19511" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "cda80058a7f57e29ca4651870917b85da1d19511" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:34 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c11d21a-8bc2-4a1c-9831-259145fff709]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:34 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7] added
Jul 29 13:51:34 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:51:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:34 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16044d4-667a-4f86-bbee-99b08400a7bb]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:34 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:51:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:34 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc49c00-fe39-41f0-934f-3448b81bc4d6]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:34 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:51:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vDSZEzqf {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vDSZEzqf" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:34 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca31155a-ed1e-4e24-bd4d-0ef880f5307d]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:34 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vDSZEzqf'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:51:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cda80058a7f57e29ca4651870917b85da1d19511.part --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[08563429-3e60-4145-965c-24a5f767756f]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d4bf66b-6836-42c2-b74c-4f6a10a19383]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:51:35 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:51:35 user nova-compute[231753]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a (non-flash)
Jul 29 13:51:35 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:51:35 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:51:35 user nova-compute[231753]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a (non-flash)
Jul 29 13:51:35 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7 -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cda80058a7f57e29ca4651870917b85da1d19511.part --force-share --output=json" returned: 0 in 0.145s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG nova.virt.images [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] 3b26f13c-45e7-46cc-8957-7975f270f7ef was qcow2, converting to raw {{(pid=231753) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG nova.privsep.utils [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=231753) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cda80058a7f57e29ca4651870917b85da1d19511.part /opt/stack/data/nova/instances/_base/cda80058a7f57e29ca4651870917b85da1d19511.converted {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f52e7d7-0a13-4006-aadf-6c946f03368e]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7, portal: 172.16.0.220,3260]
Jul 29 13:51:35 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7, portal: 172.16.0.220,3260] successful.
Jul 29 13:51:35 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30cb6c0-494c-446e-baf9-a3d7fa1a8927]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[946ed834-e78d-4c74-a70b-24162dee9d47]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:51:35 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:51:35 user nova-compute[231753]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a (non-flash)
Jul 29 13:51:35 user nova-compute[231753]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7 (non-flash)
Jul 29 13:51:35 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:51:35 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:51:35 user nova-compute[231753]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a (non-flash)
Jul 29 13:51:35 user nova-compute[231753]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7 (non-flash)
Jul 29 13:51:35 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.460s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] HCTL ('34', '-', '-', 0) found on session 42 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.029s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd0eea63-c49d-43c3-9110-cf35945c33bc]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Searching for a device in session 42 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vDSZEzqf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG nova.compute.manager [req-622ab2e4-5ee9-40d4-b62b-dc4d56b6ccbc req-87ae4a59-c267-4727-9d67-d89614b23bde service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Received event network-vif-plugged-dba460c1-334b-4686-b6a3-7d85632d294d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-622ab2e4-5ee9-40d4-b62b-dc4d56b6ccbc req-87ae4a59-c267-4727-9d67-d89614b23bde service nova] Acquiring lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-622ab2e4-5ee9-40d4-b62b-dc4d56b6ccbc req-87ae4a59-c267-4727-9d67-d89614b23bde service nova] Lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-622ab2e4-5ee9-40d4-b62b-dc4d56b6ccbc req-87ae4a59-c267-4727-9d67-d89614b23bde service nova] Lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG nova.compute.manager [req-622ab2e4-5ee9-40d4-b62b-dc4d56b6ccbc req-87ae4a59-c267-4727-9d67-d89614b23bde service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] No waiting events found dispatching network-vif-plugged-dba460c1-334b-4686-b6a3-7d85632d294d {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:51:35 user nova-compute[231753]: WARNING nova.compute.manager [req-622ab2e4-5ee9-40d4-b62b-dc4d56b6ccbc req-87ae4a59-c267-4727-9d67-d89614b23bde service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Received unexpected event network-vif-plugged-dba460c1-334b-4686-b6a3-7d85632d294d for instance with vm_state active and task_state rescuing.
Jul 29 13:51:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cda80058a7f57e29ca4651870917b85da1d19511.part /opt/stack/data/nova/instances/_base/cda80058a7f57e29ca4651870917b85da1d19511.converted" returned: 0 in 0.495s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cda80058a7f57e29ca4651870917b85da1d19511.converted --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cda80058a7f57e29ca4651870917b85da1d19511.converted --force-share --output=json" returned: 0 in 0.140s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "cda80058a7f57e29ca4651870917b85da1d19511" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.964s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "cda80058a7f57e29ca4651870917b85da1d19511" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "cda80058a7f57e29ca4651870917b85da1d19511" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cda80058a7f57e29ca4651870917b85da1d19511 --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cda80058a7f57e29ca4651870917b85da1d19511 --force-share --output=json" returned: 0 in 0.151s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cda80058a7f57e29ca4651870917b85da1d19511,backing_fmt=raw /opt/stack/data/nova/instances/ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965/disk.rescue {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cda80058a7f57e29ca4651870917b85da1d19511,backing_fmt=raw /opt/stack/data/nova/instances/ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965/disk.rescue" returned: 0 in 0.051s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "cda80058a7f57e29ca4651870917b85da1d19511" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.209s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.objects.instance [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lazy-loading 'migration_context' on Instance uuid ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Start _get_guest_xml network_info=[{"id": "dba460c1-334b-4686-b6a3-7d85632d294d", "address": "fa:16:3e:15:f4:85", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "vif_mac": "fa:16:3e:15:f4:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba460c1-33", "ovs_interfaceid": "dba460c1-334b-4686-b6a3-7d85632d294d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue={'image_id': '3b26f13c-45e7-46cc-8957-7975f270f7ef', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yRsdFEaM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, 'status': 'reserved', 'instance': 'ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965', 'attached_at': '', 'detached_at': '', 'volume_id': 'db901bd6-6e09-4679-be85-f2b92ffb7b6a', 'serial': 'db901bd6-6e09-4679-be85-f2b92ffb7b6a'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '18bc45d2-b9b5-4646-871f-7e518c1b567d', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.objects.instance [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lazy-loading 'resources' on Instance uuid ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.objects.instance [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lazy-loading 'numa_topology' on Instance uuid ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:51:36 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:51:36 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.objects.instance [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lazy-loading 'vcpu_model' on Instance uuid ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yRsdFEaM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:51:36 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:51:36 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.511s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] <== connect_volume: return (2514ms) {'type': 'block', 'scsi_wwn': '23262616633366332', 'path': '/dev/sdc'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23262616633366332', 'path': '/dev/sdc'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.159s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:51:36 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:51:36 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:51:36 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:51:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.objects.instance [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lazy-loading 'flavor' on Instance uuid 02501ee9-0dc6-4aa3-8fb8-055bb2989617 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a -p 172.16.0.220:3260" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[66bb5676-3743-482e-8072-6c8f9829e62f]: (4, ('# BEGIN RECORD 2.1.5\nnode.name = iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a\nnode.tpgt = -1\nnode.startup = automatic\nnode.leading_login = No\niface.iscsi_ifacename = default\niface.net_ifacename = <empty>\niface.ipaddress = <empty>\niface.prefix_len = 0\niface.hwaddress = <empty>\niface.transport_name = tcp\niface.initiatorname = <empty>\niface.state = <empty>\niface.vlan_id = 0\niface.vlan_priority = 0\niface.vlan_state = <empty>\niface.iface_num = 0\niface.mtu = 0\niface.port = 0\niface.bootproto = <empty>\niface.subnet_mask = <empty>\niface.gateway = <empty>\niface.dhcp_alt_client_id_state = <empty>\niface.dhcp_alt_client_id = <empty>\niface.dhcp_dns = <empty>\niface.dhcp_learn_iqn = <empty>\niface.dhcp_req_vendor_id_state = <empty>\niface.dhcp_vendor_id_state = <empty>\niface.dhcp_vendor_id = <empty>\niface.dhcp_slp_da = <empty>\niface.fragmentation = <empty>\niface.gratuitous_arp = <empty>\niface.incoming_forwarding = <empty>\niface.tos_state = <empty>\niface.tos = 0\niface.ttl = 0\niface.delayed_ack = <empty>\niface.tcp_nagle = <empty>\niface.tcp_wsf_state = <empty>\niface.tcp_wsf = 0\niface.tcp_timer_scale = 0\niface.tcp_timestamp = <empty>\niface.redirect = <empty>\niface.def_task_mgmt_timeout = 0\niface.header_digest = <empty>\niface.data_digest = <empty>\niface.immediate_data = <empty>\niface.initial_r2t = <empty>\niface.data_seq_inorder = <empty>\niface.data_pdu_inorder = <empty>\niface.erl = 0\niface.max_receive_data_len = 0\niface.first_burst_len = 0\niface.max_outstanding_r2t = 0\niface.max_burst_len = 0\niface.chap_auth = <empty>\niface.bidi_chap = <empty>\niface.strict_login_compliance = <empty>\niface.discovery_auth = <empty>\niface.discovery_logout = <empty>\nnode.discovery_address = <empty>\nnode.discovery_port = 0\nnode.discovery_type = static\nnode.session.initial_cmdsn = 0\nnode.session.initial_login_retry_max = 8\nnode.session.xmit_thread_priority = -20\nnode.session.cmds_max = 128\nnode.session.queue_depth = 32\nnode.session.nr_sessions = 1\nnode.session.auth.authmethod = CHAP\nnode.session.auth.username = yRsdFEaM\nnode.session.auth.password = ********\nnode.session.auth.username_in = <empty>\nnode.session.auth.password_in = <empty>\nnode.session.auth.chap_algs = MD5\nnode.session.timeo.replacement_timeout = 120\nnode.session.err_timeo.abort_timeout = 15\nnode.session.err_timeo.lu_reset_timeout = 30\nnode.session.err_timeo.tgt_reset_timeout = 30\nnode.session.err_timeo.host_reset_timeout = 60\nnode.session.iscsi.FastAbort = Yes\nnode.session.iscsi.InitialR2T = No\nnode.session.iscsi.ImmediateData = Yes\nnode.session.iscsi.FirstBurstLength = 262144\nnode.session.iscsi.MaxBurstLength = 16776192\nnode.session.iscsi.DefaultTime2Retain = 0\nnode.session.iscsi.DefaultTime2Wait = 2\nnode.session.iscsi.MaxConnections = 1\nnode.session.iscsi.MaxOutstandingR2T = 1\nnode.session.iscsi.ERL = 0\nnode.session.scan = manual\nnode.session.reopen_max = 0\nnode.conn[0].address = 172.16.0.220\nnode.conn[0].port = 3260\nnode.conn[0].startup = manual\nnode.conn[0].tcp.window_size = 524288\nnode.conn[0].tcp.type_of_service = 0\nnode.conn[0].timeo.logout_timeout = 15\nnode.conn[0].timeo.login_timeout = 15\nnode.conn[0].timeo.auth_timeout = 45\nnode.conn[0].timeo.noop_out_interval = 5\nnode.conn[0].timeo.noop_out_timeout = 5\nnode.conn[0].iscsi.MaxXmitDataSegmentLength = 0\nnode.conn[0].iscsi.MaxRecvDataSegmentLength = 262144\nnode.conn[0].iscsi.HeaderDigest = None\nnode.conn[0].iscsi.DataDigest = None\nnode.conn[0].iscsi.IFMarker = No\nnode.conn[0].iscsi.OFMarker = No\n# END RECORD\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.5
Jul 29 13:51:36 user nova-compute[231753]: node.name = iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a
Jul 29 13:51:36 user nova-compute[231753]: node.tpgt = -1
Jul 29 13:51:36 user nova-compute[231753]: node.startup = automatic
Jul 29 13:51:36 user nova-compute[231753]: node.leading_login = No
Jul 29 13:51:36 user nova-compute[231753]: iface.iscsi_ifacename = default
Jul 29 13:51:36 user nova-compute[231753]: iface.net_ifacename = <empty>
Jul 29 13:51:36 user nova-compute[231753]: iface.ipaddress = <empty>
Jul 29 13:51:36 user nova-compute[231753]: iface.prefix_len = 0
Jul 29 13:51:36 user nova-compute[231753]: iface.hwaddress = <empty>
Jul 29 13:51:36 user nova-compute[231753]: iface.transport_name = tcp
Jul 29 13:51:36 user nova-compute[231753]: iface.initiatorname = <empty>
Jul 29 13:51:36 user nova-compute[231753]: iface.state = <empty>
Jul 29 13:51:36 user nova-compute[231753]: iface.vlan_id = 0
Jul 29 13:51:36 user nova-compute[231753]: iface.vlan_priority = 0
Jul 29 13:51:36 user nova-compute[231753]: iface.vlan_state = <empty>
Jul 29 13:51:36 user nova-compute[231753]: iface.iface_num = 0
Jul 29 13:51:36 user nova-compute[231753]: iface.mtu = 0
Jul 29 13:51:36 user nova-compute[231753]: iface.port = 0
Jul 29 13:51:36 user nova-compute[231753]: iface.bootproto = <empty>
Jul 29 13:51:36 user nova-compute[231753]: iface.subnet_mask = <empty>
Jul 29 13:51:36 user nova-compute[231753]: iface.gateway = <empty>
Jul 29 13:51:36 user nova-compute[231753]: iface.dhcp_alt_client_id_state = <empty>
Jul 29 13:51:36 user nova-compute[231753]: iface.dhcp_alt_client_id = <empty>
Jul 29 13:51:36 user nova-compute[231753]: iface.dhcp_dns = <empty>
Jul 29 13:51:36 user nova-compute[231753]: iface.dhcp_learn_iqn = <empty>
Jul 29 13:51:36 user nova-compute[231753]: iface.dhcp_req_vendor_id_state = <empty>
Jul 29 13:51:36 user nova-compute[231753]: iface.dhcp_vendor_id_state = <empty>
Jul 29 13:51:36 user nova-compute[231753]: iface.dhcp_vendor_id = <empty>
Jul 29 13:51:36 user nova-compute[231753]: iface.dhcp_slp_da = <empty>
Jul 29 13:51:36 user nova-compute[231753]: iface.fragmentation = <empty>
Jul 29 13:51:36 user nova-compute[231753]: iface.gratuitous_arp = <empty>
Jul 29 13:51:36 user nova-compute[231753]: iface.incoming_forwarding = <empty>
Jul 29 13:51:36 user nova-compute[231753]: iface.tos_state = <empty>
Jul 29 13:51:36 user nova-compute[231753]: iface.tos = 0
Jul 29 13:51:36 user nova-compute[231753]: iface.ttl = 0
Jul 29 13:51:36 user nova-compute[231753]: iface.delayed_ack = <empty>
Jul 29 13:51:36 user nova-compute[231753]: iface.tcp_nagle = <empty>
Jul 29 13:51:36 user nova-compute[231753]: iface.tcp_wsf_state = <empty>
Jul 29 13:51:36 user nova-compute[231753]: iface.tcp_wsf = 0
Jul 29 13:51:36 user nova-compute[231753]: iface.tcp_timer_scale = 0
Jul 29 13:51:36 user nova-compute[231753]: iface.tcp_timestamp = <empty>
Jul 29 13:51:36 user nova-compute[231753]: iface.redirect = <empty>
Jul 29 13:51:36 user nova-compute[231753]: iface.def_task_mgmt_timeout = 0
Jul 29 13:51:36 user nova-compute[231753]: iface.header_digest = <empty>
Jul 29 13:51:36 user nova-compute[231753]: iface.data_digest = <empty>
Jul 29 13:51:36 user nova-compute[231753]: iface.immediate_data = <empty>
Jul 29 13:51:36 user nova-compute[231753]: iface.initial_r2t = <empty>
Jul 29 13:51:36 user nova-compute[231753]: iface.data_seq_inorder = <empty>
Jul 29 13:51:36 user nova-compute[231753]: iface.data_pdu_inorder = <empty>
Jul 29 13:51:36 user nova-compute[231753]: iface.erl = 0
Jul 29 13:51:36 user nova-compute[231753]: iface.max_receive_data_len = 0
Jul 29 13:51:36 user nova-compute[231753]: iface.first_burst_len = 0
Jul 29 13:51:36 user nova-compute[231753]: iface.max_outstanding_r2t = 0
Jul 29 13:51:36 user nova-compute[231753]: iface.max_burst_len = 0
Jul 29 13:51:36 user nova-compute[231753]: iface.chap_auth = <empty>
Jul 29 13:51:36 user nova-compute[231753]: iface.bidi_chap = <empty>
Jul 29 13:51:36 user nova-compute[231753]: iface.strict_login_compliance = <empty>
Jul 29 13:51:36 user nova-compute[231753]: iface.discovery_auth = <empty>
Jul 29 13:51:36 user nova-compute[231753]: iface.discovery_logout = <empty>
Jul 29 13:51:36 user nova-compute[231753]: node.discovery_address = <empty>
Jul 29 13:51:36 user nova-compute[231753]: node.discovery_port = 0
Jul 29 13:51:36 user nova-compute[231753]: node.discovery_type = static
Jul 29 13:51:36 user nova-compute[231753]: node.session.initial_cmdsn = 0
Jul 29 13:51:36 user nova-compute[231753]: node.session.initial_login_retry_max = 8
Jul 29 13:51:36 user nova-compute[231753]: node.session.xmit_thread_priority = -20
Jul 29 13:51:36 user nova-compute[231753]: node.session.cmds_max = 128
Jul 29 13:51:36 user nova-compute[231753]: node.session.queue_depth = 32
Jul 29 13:51:36 user nova-compute[231753]: node.session.nr_sessions = 1
Jul 29 13:51:36 user nova-compute[231753]: node.session.auth.authmethod = CHAP
Jul 29 13:51:36 user nova-compute[231753]: node.session.auth.username = yRsdFEaM
Jul 29 13:51:36 user nova-compute[231753]: node.session.auth.password = ***
Jul 29 13:51:36 user nova-compute[231753]: node.session.auth.username_in = <empty>
Jul 29 13:51:36 user nova-compute[231753]: node.session.auth.password_in = <empty>
Jul 29 13:51:36 user nova-compute[231753]: node.session.auth.chap_algs = MD5
Jul 29 13:51:36 user nova-compute[231753]: node.session.timeo.replacement_timeout = 120
Jul 29 13:51:36 user nova-compute[231753]: node.session.err_timeo.abort_timeout = 15
Jul 29 13:51:36 user nova-compute[231753]: node.session.err_timeo.lu_reset_timeout = 30
Jul 29 13:51:36 user nova-compute[231753]: node.session.err_timeo.tgt_reset_timeout = 30
Jul 29 13:51:36 user nova-compute[231753]: node.session.err_timeo.host_reset_timeout = 60
Jul 29 13:51:36 user nova-compute[231753]: node.session.iscsi.FastAbort = Yes
Jul 29 13:51:36 user nova-compute[231753]: node.session.iscsi.InitialR2T = No
Jul 29 13:51:36 user nova-compute[231753]: node.session.iscsi.ImmediateData = Yes
Jul 29 13:51:36 user nova-compute[231753]: node.session.iscsi.FirstBurstLength = 262144
Jul 29 13:51:36 user nova-compute[231753]: node.session.iscsi.MaxBurstLength = 16776192
Jul 29 13:51:36 user nova-compute[231753]: node.session.iscsi.DefaultTime2Retain = 0
Jul 29 13:51:36 user nova-compute[231753]: node.session.iscsi.DefaultTime2Wait = 2
Jul 29 13:51:36 user nova-compute[231753]: node.session.iscsi.MaxConnections = 1
Jul 29 13:51:36 user nova-compute[231753]: node.session.iscsi.MaxOutstandingR2T = 1
Jul 29 13:51:36 user nova-compute[231753]: node.session.iscsi.ERL = 0
Jul 29 13:51:36 user nova-compute[231753]: node.session.scan = manual
Jul 29 13:51:36 user nova-compute[231753]: node.session.reopen_max = 0
Jul 29 13:51:36 user nova-compute[231753]: node.conn[0].address = 172.16.0.220
Jul 29 13:51:36 user nova-compute[231753]: node.conn[0].port = 3260
Jul 29 13:51:36 user nova-compute[231753]: node.conn[0].startup = manual
Jul 29 13:51:36 user nova-compute[231753]: node.conn[0].tcp.window_size = 524288
Jul 29 13:51:36 user nova-compute[231753]: node.conn[0].tcp.type_of_service = 0
Jul 29 13:51:36 user nova-compute[231753]: node.conn[0].timeo.logout_timeout = 15
Jul 29 13:51:36 user nova-compute[231753]: node.conn[0].timeo.login_timeout = 15
Jul 29 13:51:36 user nova-compute[231753]: node.conn[0].timeo.auth_timeout = 45
Jul 29 13:51:36 user nova-compute[231753]: node.conn[0].timeo.noop_out_interval = 5
Jul 29 13:51:36 user nova-compute[231753]: node.conn[0].timeo.noop_out_timeout = 5
Jul 29 13:51:36 user nova-compute[231753]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0
Jul 29 13:51:36 user nova-compute[231753]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144
Jul 29 13:51:36 user nova-compute[231753]: node.conn[0].iscsi.HeaderDigest = None
Jul 29 13:51:36 user nova-compute[231753]: node.conn[0].iscsi.DataDigest = None
Jul 29 13:51:36 user nova-compute[231753]: node.conn[0].iscsi.IFMarker = No
Jul 29 13:51:36 user nova-compute[231753]: node.conn[0].iscsi.OFMarker = No
Jul 29 13:51:36 user nova-compute[231753]: # END RECORD
Jul 29 13:51:36 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 13:51:36 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:51:36 user nova-compute[231753]:   <source dev="/dev/sdc"/>
Jul 29 13:51:36 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:51:36 user nova-compute[231753]:   <serial>b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7</serial>
Jul 29 13:51:36 user nova-compute[231753]: </disk>
Jul 29 13:51:36 user nova-compute[231753]:  {{(pid=231753) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.029s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8831c6-f98d-4749-9509-7ade4c30df43]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5c42208-1eb7-4bd0-a3d6-c174b7b33f00]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yRsdFEaM {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v yRsdFEaM" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda7f1ee-3b2c-4173-bf6d-8cb0daf83281]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'yRsdFEaM'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2f24467-0492-47a4-b87f-0ee278d60b26]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0165be92-c9c5-4a66-a507-c0d11c12bf9d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:51:36 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:51:36 user nova-compute[231753]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a (non-flash)
Jul 29 13:51:36 user nova-compute[231753]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7 (non-flash)
Jul 29 13:51:36 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:51:36 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:51:36 user nova-compute[231753]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a (non-flash)
Jul 29 13:51:36 user nova-compute[231753]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7 (non-flash)
Jul 29 13:51:36 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.170s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] HCTL ('33', '0', '0', 0) found on session 40 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Scanning host 33 c: 0, t: 0, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3dd024e-6191-4687-8266-89cb39febd1d]: (4, ('0 0 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Searching for a device in session 40 and hctl ('33', '0', '0', 0) yield: sdb {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yRsdFEaM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path'} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 0.207s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] <== connect_volume: return (365ms) {'type': 'block', 'scsi_wwn': '23461373965333230', 'path': '/dev/sdb'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23461373965333230', 'path': '/dev/sdb'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:49:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1967595438',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1967595438',id=35,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:50:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c01165e83a3143ad83f050790f2b63fe',ramdisk_id='',reservation_id='r-tjkg3ouj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-93506270',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member'},tags=<?>,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:50:13Z,user_data=None,user_id='618ce2d56c3c4ee8ace871d308ca45fb',uuid=ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dba460c1-334b-4686-b6a3-7d85632d294d", "address": "fa:16:3e:15:f4:85", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "vif_mac": "fa:16:3e:15:f4:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba460c1-33", "ovs_interfaceid": "dba460c1-334b-4686-b6a3-7d85632d294d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Converting VIF {"id": "dba460c1-334b-4686-b6a3-7d85632d294d", "address": "fa:16:3e:15:f4:85", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "vif_mac": "fa:16:3e:15:f4:85"}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba460c1-33", "ovs_interfaceid": "dba460c1-334b-4686-b6a3-7d85632d294d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:f4:85,bridge_name='br-int',has_traffic_filtering=True,id=dba460c1-334b-4686-b6a3-7d85632d294d,network=Network(03362fcb-afd6-4b0a-af44-a54a848c59f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdba460c1-33') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.objects.instance [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lazy-loading 'pci_devices' on Instance uuid ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:51:36 user nova-compute[231753]:   <uuid>ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965</uuid>
Jul 29 13:51:36 user nova-compute[231753]:   <name>instance-00000023</name>
Jul 29 13:51:36 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:51:36 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:51:36 user nova-compute[231753]:   <metadata>
Jul 29 13:51:36 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:51:36 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:51:36 user nova-compute[231753]:       <nova:name>tempest-ServerBootFromVolumeStableRescueTest-server-1967595438</nova:name>
Jul 29 13:51:36 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:51:36</nova:creationTime>
Jul 29 13:51:36 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:51:36 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:51:36 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:51:36 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:51:36 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:51:36 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:51:36 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:51:36 user nova-compute[231753]:       <nova:owner>
Jul 29 13:51:36 user nova-compute[231753]:         <nova:user uuid="618ce2d56c3c4ee8ace871d308ca45fb">tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member</nova:user>
Jul 29 13:51:36 user nova-compute[231753]:         <nova:project uuid="c01165e83a3143ad83f050790f2b63fe">tempest-ServerBootFromVolumeStableRescueTest-93506270</nova:project>
Jul 29 13:51:36 user nova-compute[231753]:       </nova:owner>
Jul 29 13:51:36 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:51:36 user nova-compute[231753]:       <nova:ports>
Jul 29 13:51:36 user nova-compute[231753]:         <nova:port uuid="dba460c1-334b-4686-b6a3-7d85632d294d">
Jul 29 13:51:36 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 29 13:51:36 user nova-compute[231753]:         </nova:port>
Jul 29 13:51:36 user nova-compute[231753]:       </nova:ports>
Jul 29 13:51:36 user nova-compute[231753]:     </nova:instance>
Jul 29 13:51:36 user nova-compute[231753]:   </metadata>
Jul 29 13:51:36 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:51:36 user nova-compute[231753]:     <system>
Jul 29 13:51:36 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:51:36 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:51:36 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:51:36 user nova-compute[231753]:       <entry name="serial">ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965</entry>
Jul 29 13:51:36 user nova-compute[231753]:       <entry name="uuid">ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965</entry>
Jul 29 13:51:36 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:51:36 user nova-compute[231753]:     </system>
Jul 29 13:51:36 user nova-compute[231753]:   </sysinfo>
Jul 29 13:51:36 user nova-compute[231753]:   <os>
Jul 29 13:51:36 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:51:36 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:51:36 user nova-compute[231753]:   </os>
Jul 29 13:51:36 user nova-compute[231753]:   <features>
Jul 29 13:51:36 user nova-compute[231753]:     <acpi/>
Jul 29 13:51:36 user nova-compute[231753]:     <apic/>
Jul 29 13:51:36 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:51:36 user nova-compute[231753]:   </features>
Jul 29 13:51:36 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:51:36 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:51:36 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:51:36 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:51:36 user nova-compute[231753]:   </clock>
Jul 29 13:51:36 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:51:36 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:51:36 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:51:36 user nova-compute[231753]:   </cpu>
Jul 29 13:51:36 user nova-compute[231753]:   <devices>
Jul 29 13:51:36 user nova-compute[231753]:     <disk type="block" device="disk">
Jul 29 13:51:36 user nova-compute[231753]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:51:36 user nova-compute[231753]:       <source dev="/dev/sdb"/>
Jul 29 13:51:36 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:51:36 user nova-compute[231753]:       <serial>db901bd6-6e09-4679-be85-f2b92ffb7b6a</serial>
Jul 29 13:51:36 user nova-compute[231753]:     </disk>
Jul 29 13:51:36 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:51:36 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:51:36 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965/disk.rescue"/>
Jul 29 13:51:36 user nova-compute[231753]:       <target dev="vdb" bus="virtio"/>
Jul 29 13:51:36 user nova-compute[231753]:       <boot order="1"/>
Jul 29 13:51:36 user nova-compute[231753]:     </disk>
Jul 29 13:51:36 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:51:36 user nova-compute[231753]:       <mac address="fa:16:3e:15:f4:85"/>
Jul 29 13:51:36 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:51:36 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:51:36 user nova-compute[231753]:       <target dev="tapdba460c1-33"/>
Jul 29 13:51:36 user nova-compute[231753]:     </interface>
Jul 29 13:51:36 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:51:36 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965/console.log" append="off"/>
Jul 29 13:51:36 user nova-compute[231753]:     </serial>
Jul 29 13:51:36 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:51:36 user nova-compute[231753]:     <video>
Jul 29 13:51:36 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:51:36 user nova-compute[231753]:     </video>
Jul 29 13:51:36 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:51:36 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:51:36 user nova-compute[231753]:     </rng>
Jul 29 13:51:36 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:51:36 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:51:36 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:51:36 user nova-compute[231753]:     </memballoon>
Jul 29 13:51:36 user nova-compute[231753]:   </devices>
Jul 29 13:51:36 user nova-compute[231753]: </domain>
Jul 29 13:51:36 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:51:36 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Instance destroyed successfully.
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] No BDM found with device name vdb, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] No VIF found with MAC fa:16:3e:15:f4:85, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690638681.8685544, afd6468c-465d-49c9-b01c-93734f2a3e17 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:51:36 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] VM Stopped (Lifecycle Event)
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.compute.manager [None req-bd47572c-4766-473a-8fa8-d75be2dc7706 None None] [instance: afd6468c-465d-49c9-b01c-93734f2a3e17] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] No BDM found with device name vdb, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:51:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] No VIF found with MAC fa:16:3e:eb:f5:54, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:51:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-29788432-0154-49b9-8d3e-9c08d03b1489 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "02501ee9-0dc6-4aa3-8fb8-055bb2989617" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.263s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-df0339de-cc09-4422-bb25-ce9ffa939f13 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "02501ee9-0dc6-4aa3-8fb8-055bb2989617" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-df0339de-cc09-4422-bb25-ce9ffa939f13 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "02501ee9-0dc6-4aa3-8fb8-055bb2989617" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:38 user nova-compute[231753]: INFO nova.compute.manager [None req-df0339de-cc09-4422-bb25-ce9ffa939f13 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Detaching volume b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7
Jul 29 13:51:38 user nova-compute[231753]: INFO nova.virt.block_device [None req-df0339de-cc09-4422-bb25-ce9ffa939f13 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Attempting to driver detach volume b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7 from mountpoint /dev/vdb
Jul 29 13:51:38 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-df0339de-cc09-4422-bb25-ce9ffa939f13 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Attempting to detach device vdb from instance 02501ee9-0dc6-4aa3-8fb8-055bb2989617 from the persistent domain config. {{(pid=231753) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 13:51:38 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-df0339de-cc09-4422-bb25-ce9ffa939f13 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:51:38 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:51:38 user nova-compute[231753]:   <source dev="/dev/sdc"/>
Jul 29 13:51:38 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:51:38 user nova-compute[231753]:   <serial>b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7</serial>
Jul 29 13:51:38 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 13:51:38 user nova-compute[231753]: </disk>
Jul 29 13:51:38 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:51:38 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-df0339de-cc09-4422-bb25-ce9ffa939f13 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Successfully detached device vdb from instance 02501ee9-0dc6-4aa3-8fb8-055bb2989617 from the persistent domain config.
Jul 29 13:51:38 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-df0339de-cc09-4422-bb25-ce9ffa939f13 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 02501ee9-0dc6-4aa3-8fb8-055bb2989617 from the live domain config. {{(pid=231753) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 13:51:38 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-df0339de-cc09-4422-bb25-ce9ffa939f13 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:51:38 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:51:38 user nova-compute[231753]:   <source dev="/dev/sdc"/>
Jul 29 13:51:38 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:51:38 user nova-compute[231753]:   <serial>b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7</serial>
Jul 29 13:51:38 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 13:51:38 user nova-compute[231753]: </disk>
Jul 29 13:51:38 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:51:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:38 user nova-compute[231753]: DEBUG nova.compute.manager [req-a122bc89-8557-42a8-b6ae-df04e58f9511 req-1bb78c7c-3a23-4bac-b18f-fdc835355a5d service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Received event network-vif-plugged-dba460c1-334b-4686-b6a3-7d85632d294d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:51:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a122bc89-8557-42a8-b6ae-df04e58f9511 req-1bb78c7c-3a23-4bac-b18f-fdc835355a5d service nova] Acquiring lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a122bc89-8557-42a8-b6ae-df04e58f9511 req-1bb78c7c-3a23-4bac-b18f-fdc835355a5d service nova] Lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a122bc89-8557-42a8-b6ae-df04e58f9511 req-1bb78c7c-3a23-4bac-b18f-fdc835355a5d service nova] Lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:38 user nova-compute[231753]: DEBUG nova.compute.manager [req-a122bc89-8557-42a8-b6ae-df04e58f9511 req-1bb78c7c-3a23-4bac-b18f-fdc835355a5d service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] No waiting events found dispatching network-vif-plugged-dba460c1-334b-4686-b6a3-7d85632d294d {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:51:38 user nova-compute[231753]: WARNING nova.compute.manager [req-a122bc89-8557-42a8-b6ae-df04e58f9511 req-1bb78c7c-3a23-4bac-b18f-fdc835355a5d service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Received unexpected event network-vif-plugged-dba460c1-334b-4686-b6a3-7d85632d294d for instance with vm_state active and task_state rescuing.
Jul 29 13:51:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Received event <DeviceRemovedEvent: 1690638699.17065, 02501ee9-0dc6-4aa3-8fb8-055bb2989617 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=231753) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-df0339de-cc09-4422-bb25-ce9ffa939f13 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 02501ee9-0dc6-4aa3-8fb8-055bb2989617 {{(pid=231753) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 13:51:39 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-df0339de-cc09-4422-bb25-ce9ffa939f13 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Successfully detached device vdb from instance 02501ee9-0dc6-4aa3-8fb8-055bb2989617 from the live domain config.
Jul 29 13:51:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df0339de-cc09-4422-bb25-ce9ffa939f13 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0339de-cc09-4422-bb25-ce9ffa939f13 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vDSZEzqf', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:51:39 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-df0339de-cc09-4422-bb25-ce9ffa939f13 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:51:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-df0339de-cc09-4422-bb25-ce9ffa939f13 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-df0339de-cc09-4422-bb25-ce9ffa939f13 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.029s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8bb66fb-15c4-46b4-b5ba-76884727ea10]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0339de-cc09-4422-bb25-ce9ffa939f13 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:51:39 user nova-compute[231753]: No targets found.
Jul 29 13:51:39 user nova-compute[231753]: iSNS:
Jul 29 13:51:39 user nova-compute[231753]: No targets found.
Jul 29 13:51:39 user nova-compute[231753]: STATIC:
Jul 29 13:51:39 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea
Jul 29 13:51:39 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:51:39 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:51:39 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7
Jul 29 13:51:39 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:51:39 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:51:39 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a
Jul 29 13:51:39 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:51:39 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:51:39 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a
Jul 29 13:51:39 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:51:39 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:51:39 user nova-compute[231753]: FIRMWARE:
Jul 29 13:51:39 user nova-compute[231753]: No targets found.
Jul 29 13:51:39 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0339de-cc09-4422-bb25-ce9ffa939f13 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:51:39 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:51:39 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0339de-cc09-4422-bb25-ce9ffa939f13 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[03b4a067-98b4-461f-acf5-496f800d6093]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d9f84e5-a6d6-4a1b-80a1-8b56074e6e26]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a (non-flash)\ntcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0339de-cc09-4422-bb25-ce9ffa939f13 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:51:39 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:51:39 user nova-compute[231753]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a (non-flash)
Jul 29 13:51:39 user nova-compute[231753]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7 (non-flash)
Jul 29 13:51:39 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0339de-cc09-4422-bb25-ce9ffa939f13 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:51:39 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:51:39 user nova-compute[231753]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a (non-flash)
Jul 29 13:51:39 user nova-compute[231753]: tcp: [42] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7 (non-flash)
Jul 29 13:51:39 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0339de-cc09-4422-bb25-ce9ffa939f13 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c80466c20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7'): ({'sdc'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-df0339de-cc09-4422-bb25-ce9ffa939f13 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Removing single pathed devices sdc {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4072c2bf-7313-4b0f-86a6-af6d6bd7e01c]: (4, ('path checker states:\nup                  3\npending             1\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5458e77e-74c3-4ef6-a6ef-eee769ff9177]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-df0339de-cc09-4422-bb25-ce9ffa939f13 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Flushing IO for device /dev/sdc {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.044s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7210009b-5ed8-403f-8d9e-ac0d5db73836]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-df0339de-cc09-4422-bb25-ce9ffa939f13 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.100s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4d28a17-5e3c-4a5f-b616-557004261fe6]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-df0339de-cc09-4422-bb25-ce9ffa939f13 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-df0339de-cc09-4422-bb25-ce9ffa939f13 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] SCSI volumes sdc have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0339de-cc09-4422-bb25-ce9ffa939f13 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d813cbbd-2aba-4f7b-8b1e-2d8903e5a452]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0339de-cc09-4422-bb25-ce9ffa939f13 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7 -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7 -p 172.16.0.220:3260 --logout" returned: 0 in 0.060s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7589e7-144e-4549-9e8f-06070075b005]: (4, ('Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7, portal: 172.16.0.220,3260]\nLogout of [sid: 42, target: iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0339de-cc09-4422-bb25-ce9ffa939f13 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 42, target: iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7, portal: 172.16.0.220,3260]
Jul 29 13:51:39 user nova-compute[231753]: Logout of [sid: 42, target: iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7, portal: 172.16.0.220,3260] successful.
Jul 29 13:51:39 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7 -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:b04e2b30-2ce2-4bc1-88ff-ea7724c7bbf7 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.041s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b60401c0-9408-4296-8f96-2f26a462af17]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0339de-cc09-4422-bb25-ce9ffa939f13 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-df0339de-cc09-4422-bb25-ce9ffa939f13 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.469s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-df0339de-cc09-4422-bb25-ce9ffa939f13 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] <== disconnect_volume: return (470ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:51:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-df0339de-cc09-4422-bb25-ce9ffa939f13 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:51:40 user nova-compute[231753]: DEBUG nova.compute.manager [req-f657ec10-86cf-4a26-943a-fe0ba2eb44e4 req-154c47c2-a250-450d-9b0f-09e74b2cc00f service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Received event network-vif-plugged-dba460c1-334b-4686-b6a3-7d85632d294d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:51:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-f657ec10-86cf-4a26-943a-fe0ba2eb44e4 req-154c47c2-a250-450d-9b0f-09e74b2cc00f service nova] Acquiring lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-f657ec10-86cf-4a26-943a-fe0ba2eb44e4 req-154c47c2-a250-450d-9b0f-09e74b2cc00f service nova] Lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-f657ec10-86cf-4a26-943a-fe0ba2eb44e4 req-154c47c2-a250-450d-9b0f-09e74b2cc00f service nova] Lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:40 user nova-compute[231753]: DEBUG nova.compute.manager [req-f657ec10-86cf-4a26-943a-fe0ba2eb44e4 req-154c47c2-a250-450d-9b0f-09e74b2cc00f service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] No waiting events found dispatching network-vif-plugged-dba460c1-334b-4686-b6a3-7d85632d294d {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:51:40 user nova-compute[231753]: WARNING nova.compute.manager [req-f657ec10-86cf-4a26-943a-fe0ba2eb44e4 req-154c47c2-a250-450d-9b0f-09e74b2cc00f service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Received unexpected event network-vif-plugged-dba460c1-334b-4686-b6a3-7d85632d294d for instance with vm_state active and task_state rescuing.
Jul 29 13:51:41 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Removed pending event for ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965 due to event {{(pid=231753) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 29 13:51:41 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638701.454855, ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:51:41 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] VM Resumed (Lifecycle Event)
Jul 29 13:51:41 user nova-compute[231753]: DEBUG nova.compute.manager [None req-1cc6897b-161a-40e2-a04d-edf369214a88 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:51:41 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:51:41 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:51:41 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] During sync_power_state the instance has a pending task (rescuing). Skip.
Jul 29 13:51:41 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638701.455307, ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:51:41 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] VM Started (Lifecycle Event)
Jul 29 13:51:41 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:51:41 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:51:41 user nova-compute[231753]: DEBUG nova.objects.instance [None req-df0339de-cc09-4422-bb25-ce9ffa939f13 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lazy-loading 'flavor' on Instance uuid 02501ee9-0dc6-4aa3-8fb8-055bb2989617 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:51:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-df0339de-cc09-4422-bb25-ce9ffa939f13 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "02501ee9-0dc6-4aa3-8fb8-055bb2989617" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 3.594s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:41 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "c5f39add-9361-4cf7-aa3a-643f0a8252a7" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "c5f39add-9361-4cf7-aa3a-643f0a8252a7" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "c5f39add-9361-4cf7-aa3a-643f0a8252a7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "c5f39add-9361-4cf7-aa3a-643f0a8252a7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "c5f39add-9361-4cf7-aa3a-643f0a8252a7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:43 user nova-compute[231753]: INFO nova.compute.manager [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Terminating instance
Jul 29 13:51:43 user nova-compute[231753]: DEBUG nova.compute.manager [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:51:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:43 user nova-compute[231753]: DEBUG nova.compute.manager [req-42c6b918-b120-477f-a9a6-99a33368b762 req-12084601-e9f6-45e3-ba0d-d7ddf61c8e3b service nova] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Received event network-vif-unplugged-51e44d6c-be82-409c-bf33-6bc0dc78f28d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:51:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-42c6b918-b120-477f-a9a6-99a33368b762 req-12084601-e9f6-45e3-ba0d-d7ddf61c8e3b service nova] Acquiring lock "c5f39add-9361-4cf7-aa3a-643f0a8252a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-42c6b918-b120-477f-a9a6-99a33368b762 req-12084601-e9f6-45e3-ba0d-d7ddf61c8e3b service nova] Lock "c5f39add-9361-4cf7-aa3a-643f0a8252a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-42c6b918-b120-477f-a9a6-99a33368b762 req-12084601-e9f6-45e3-ba0d-d7ddf61c8e3b service nova] Lock "c5f39add-9361-4cf7-aa3a-643f0a8252a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:43 user nova-compute[231753]: DEBUG nova.compute.manager [req-42c6b918-b120-477f-a9a6-99a33368b762 req-12084601-e9f6-45e3-ba0d-d7ddf61c8e3b service nova] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] No waiting events found dispatching network-vif-unplugged-51e44d6c-be82-409c-bf33-6bc0dc78f28d {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:51:43 user nova-compute[231753]: DEBUG nova.compute.manager [req-42c6b918-b120-477f-a9a6-99a33368b762 req-12084601-e9f6-45e3-ba0d-d7ddf61c8e3b service nova] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Received event network-vif-unplugged-51e44d6c-be82-409c-bf33-6bc0dc78f28d for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:44 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Instance destroyed successfully.
Jul 29 13:51:44 user nova-compute[231753]: DEBUG nova.objects.instance [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lazy-loading 'resources' on Instance uuid c5f39add-9361-4cf7-aa3a-643f0a8252a7 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:49:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-987594824',display_name='tempest-TestVolumeBootPattern-server-987594824',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-987594824',id=36,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:50:13Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f45c92d3fe964066b9be87489b2c9f7e',ramdisk_id='',reservation_id='r-0r61y20r',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-434673895',owner_user_name='tempest-TestVolumeBootPattern-434673895-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:50:14Z,user_data=None,user_id='d94a7ea0c19845b886e12c1689cf30a8',uuid=c5f39add-9361-4cf7-aa3a-643f0a8252a7,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "51e44d6c-be82-409c-bf33-6bc0dc78f28d", "address": "fa:16:3e:9f:3d:88", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e44d6c-be", "ovs_interfaceid": "51e44d6c-be82-409c-bf33-6bc0dc78f28d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Converting VIF {"id": "51e44d6c-be82-409c-bf33-6bc0dc78f28d", "address": "fa:16:3e:9f:3d:88", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap51e44d6c-be", "ovs_interfaceid": "51e44d6c-be82-409c-bf33-6bc0dc78f28d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9f:3d:88,bridge_name='br-int',has_traffic_filtering=True,id=51e44d6c-be82-409c-bf33-6bc0dc78f28d,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51e44d6c-be') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG os_vif [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:3d:88,bridge_name='br-int',has_traffic_filtering=True,id=51e44d6c-be82-409c-bf33-6bc0dc78f28d,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51e44d6c-be') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap51e44d6c-be, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:51:44 user nova-compute[231753]: INFO os_vif [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9f:3d:88,bridge_name='br-int',has_traffic_filtering=True,id=51e44d6c-be82-409c-bf33-6bc0dc78f28d,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap51e44d6c-be')
Jul 29 13:51:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'rIpRCYWA', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': True}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:51:44 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:51:44 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca159ec-c201-4b61-89be-749b7969099a]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:51:44 user nova-compute[231753]: No targets found.
Jul 29 13:51:44 user nova-compute[231753]: iSNS:
Jul 29 13:51:44 user nova-compute[231753]: No targets found.
Jul 29 13:51:44 user nova-compute[231753]: STATIC:
Jul 29 13:51:44 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea
Jul 29 13:51:44 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:51:44 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:51:44 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a
Jul 29 13:51:44 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:51:44 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:51:44 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a
Jul 29 13:51:44 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:51:44 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:51:44 user nova-compute[231753]: FIRMWARE:
Jul 29 13:51:44 user nova-compute[231753]: No targets found.
Jul 29 13:51:44 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:51:44 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:51:44 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.028s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fab28d4-47e7-46f9-9418-63847bf28386]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e71f62a5-9d21-418d-85e1-909e642979d8]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)\ntcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:51:44 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:51:44 user nova-compute[231753]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a (non-flash)
Jul 29 13:51:44 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:51:44 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:51:44 user nova-compute[231753]: tcp: [41] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a (non-flash)
Jul 29 13:51:44 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c80465000>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a'): ({'sdf'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Removing single pathed devices sdf {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.033s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5221aae4-947f-42e5-ab02-750b621a9747]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.030s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe479039-b96c-4585-9e33-fb3797ab8c6e]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Flushing IO for device /dev/sdf {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[381eaf9d-1de5-4d16-9ede-da0e152555dd]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.063s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[06056976-0e78-48ce-adfc-de00c148b824]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] SCSI volumes sdf have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd92e149-ed9a-4adb-9cb2-5ea41312b86c]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a -p 172.16.0.220:3260 --logout" returned: 0 in 0.057s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f0b6d5-913a-4123-9c5f-b2981ee39479]: (4, ('Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a, portal: 172.16.0.220,3260]\nLogout of [sid: 41, target: iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a, portal: 172.16.0.220,3260]
Jul 29 13:51:44 user nova-compute[231753]: Logout of [sid: 41, target: iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a, portal: 172.16.0.220,3260] successful.
Jul 29 13:51:44 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d61d0db4-3d50-43f9-b10d-624a1859f5a2]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.380s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] <== disconnect_volume: return (381ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:51:44 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Deleting instance files /opt/stack/data/nova/instances/c5f39add-9361-4cf7-aa3a-643f0a8252a7_del
Jul 29 13:51:44 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Deletion of /opt/stack/data/nova/instances/c5f39add-9361-4cf7-aa3a-643f0a8252a7_del complete
Jul 29 13:51:44 user nova-compute[231753]: INFO nova.compute.manager [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Took 1.28 seconds to destroy the instance on the hypervisor.
Jul 29 13:51:44 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:45 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:45 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:51:45 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Took 0.61 seconds to deallocate network for instance.
Jul 29 13:51:45 user nova-compute[231753]: DEBUG nova.compute.manager [req-993b1bf2-167b-4bdb-8e9f-48fd3dc82f51 req-d6647014-bb3b-4696-885a-8a0246e348d0 service nova] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Received event network-vif-plugged-51e44d6c-be82-409c-bf33-6bc0dc78f28d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:51:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-993b1bf2-167b-4bdb-8e9f-48fd3dc82f51 req-d6647014-bb3b-4696-885a-8a0246e348d0 service nova] Acquiring lock "c5f39add-9361-4cf7-aa3a-643f0a8252a7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-993b1bf2-167b-4bdb-8e9f-48fd3dc82f51 req-d6647014-bb3b-4696-885a-8a0246e348d0 service nova] Lock "c5f39add-9361-4cf7-aa3a-643f0a8252a7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-993b1bf2-167b-4bdb-8e9f-48fd3dc82f51 req-d6647014-bb3b-4696-885a-8a0246e348d0 service nova] Lock "c5f39add-9361-4cf7-aa3a-643f0a8252a7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:45 user nova-compute[231753]: DEBUG nova.compute.manager [req-993b1bf2-167b-4bdb-8e9f-48fd3dc82f51 req-d6647014-bb3b-4696-885a-8a0246e348d0 service nova] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] No waiting events found dispatching network-vif-plugged-51e44d6c-be82-409c-bf33-6bc0dc78f28d {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:51:45 user nova-compute[231753]: WARNING nova.compute.manager [req-993b1bf2-167b-4bdb-8e9f-48fd3dc82f51 req-d6647014-bb3b-4696-885a-8a0246e348d0 service nova] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Received unexpected event network-vif-plugged-51e44d6c-be82-409c-bf33-6bc0dc78f28d for instance with vm_state active and task_state deleting.
Jul 29 13:51:45 user nova-compute[231753]: DEBUG nova.compute.manager [req-993b1bf2-167b-4bdb-8e9f-48fd3dc82f51 req-d6647014-bb3b-4696-885a-8a0246e348d0 service nova] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Received event network-vif-deleted-51e44d6c-be82-409c-bf33-6bc0dc78f28d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:51:46 user nova-compute[231753]: INFO nova.compute.manager [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Took 0.80 seconds to detach 1 volumes for instance.
Jul 29 13:51:46 user nova-compute[231753]: DEBUG nova.compute.manager [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Deleting volume: 3a09a9ec-c15d-4d5f-b2fd-76f67d7d541a {{(pid=231753) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 29 13:51:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:46 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:51:46 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:51:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.573s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:46 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Deleted allocations for instance c5f39add-9361-4cf7-aa3a-643f0a8252a7
Jul 29 13:51:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-069f8ada-b4ac-4645-bbf9-dcb9a73cab73 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "c5f39add-9361-4cf7-aa3a-643f0a8252a7" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.651s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "8e153c4d-75b5-4507-aac7-21620479209b" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "8e153c4d-75b5-4507-aac7-21620479209b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:54 user nova-compute[231753]: DEBUG nova.compute.manager [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:51:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:54 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:51:54 user nova-compute[231753]: INFO nova.compute.claims [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Claim successful on node user
Jul 29 13:51:54 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:51:54 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:51:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.415s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:54 user nova-compute[231753]: DEBUG nova.compute.manager [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:51:54 user nova-compute[231753]: DEBUG nova.compute.manager [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:51:54 user nova-compute[231753]: DEBUG nova.network.neutron [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:51:54 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:51:54 user nova-compute[231753]: DEBUG nova.compute.manager [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:51:54 user nova-compute[231753]: DEBUG nova.policy [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'df1ccafc63e0418e9889541bb8ecd3d2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4a8801c6bc4b46ef9b407426c5eb07e0', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:51:54 user nova-compute[231753]: DEBUG nova.compute.manager [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:51:54 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:51:54 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Creating image(s)
Jul 29 13:51:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "/opt/stack/data/nova/instances/8e153c4d-75b5-4507-aac7-21620479209b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "/opt/stack/data/nova/instances/8e153c4d-75b5-4507-aac7-21620479209b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "/opt/stack/data/nova/instances/8e153c4d-75b5-4507-aac7-21620479209b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.134s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.153s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/8e153c4d-75b5-4507-aac7-21620479209b/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/8e153c4d-75b5-4507-aac7-21620479209b/disk 1073741824" returned: 0 in 0.098s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.259s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.137s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:55 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e153c4d-75b5-4507-aac7-21620479209b/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:51:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e153c4d-75b5-4507-aac7-21620479209b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:51:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e153c4d-75b5-4507-aac7-21620479209b/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:51:55 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Cannot resize image /opt/stack/data/nova/instances/8e153c4d-75b5-4507-aac7-21620479209b/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:51:55 user nova-compute[231753]: DEBUG nova.objects.instance [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lazy-loading 'migration_context' on Instance uuid 8e153c4d-75b5-4507-aac7-21620479209b {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:51:55 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:51:55 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Ensure instance console log exists: /opt/stack/data/nova/instances/8e153c4d-75b5-4507-aac7-21620479209b/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:51:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-582cd80a-7680-497b-867e-169c9a6489ab tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "b9751029-dfed-4342-ad92-9ae53d72fbc1" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-582cd80a-7680-497b-867e-169c9a6489ab tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-582cd80a-7680-497b-867e-169c9a6489ab tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-582cd80a-7680-497b-867e-169c9a6489ab tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-582cd80a-7680-497b-867e-169c9a6489ab tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:56 user nova-compute[231753]: INFO nova.compute.manager [None req-582cd80a-7680-497b-867e-169c9a6489ab tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Terminating instance
Jul 29 13:51:56 user nova-compute[231753]: DEBUG nova.compute.manager [None req-582cd80a-7680-497b-867e-169c9a6489ab tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:51:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:56 user nova-compute[231753]: DEBUG nova.compute.manager [req-ff564175-7664-4ef5-8d82-bed8173afa37 req-b42dc7cb-92e1-471b-9a61-4ee57848893e service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Received event network-vif-unplugged-a25ce12c-a83d-4128-ac1e-62ca02ae31fd {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:51:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ff564175-7664-4ef5-8d82-bed8173afa37 req-b42dc7cb-92e1-471b-9a61-4ee57848893e service nova] Acquiring lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ff564175-7664-4ef5-8d82-bed8173afa37 req-b42dc7cb-92e1-471b-9a61-4ee57848893e service nova] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ff564175-7664-4ef5-8d82-bed8173afa37 req-b42dc7cb-92e1-471b-9a61-4ee57848893e service nova] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:56 user nova-compute[231753]: DEBUG nova.compute.manager [req-ff564175-7664-4ef5-8d82-bed8173afa37 req-b42dc7cb-92e1-471b-9a61-4ee57848893e service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] No waiting events found dispatching network-vif-unplugged-a25ce12c-a83d-4128-ac1e-62ca02ae31fd {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:51:56 user nova-compute[231753]: DEBUG nova.compute.manager [req-ff564175-7664-4ef5-8d82-bed8173afa37 req-b42dc7cb-92e1-471b-9a61-4ee57848893e service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Received event network-vif-unplugged-a25ce12c-a83d-4128-ac1e-62ca02ae31fd for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:51:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:56 user nova-compute[231753]: DEBUG nova.network.neutron [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Successfully created port: 259c966b-ba73-42ca-9f38-7cba6bdc671c {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:51:56 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Instance destroyed successfully.
Jul 29 13:51:56 user nova-compute[231753]: DEBUG nova.objects.instance [None req-582cd80a-7680-497b-867e-169c9a6489ab tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lazy-loading 'resources' on Instance uuid b9751029-dfed-4342-ad92-9ae53d72fbc1 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:51:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-582cd80a-7680-497b-867e-169c9a6489ab tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:45:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1353679928',display_name='tempest-ServerRescueNegativeTestJSON-server-1353679928',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1353679928',id=30,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPyqkIk/mHZFeegD1t3ptlpbHx03xO8udA7bbSIZfXHD2TqVVmNTQHOJm3Ynbo+HPT9yM0akjPtiAtsZY0rh56MyFHx5g8gunx9fj5pIS+vVgJEMoD4LC8RWOTY18wNCtg==',key_name='tempest-keypair-1425594541',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:47:26Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7aa6e9e70b4a49cb994440e868203c99',ramdisk_id='',reservation_id='r-q5ty12vq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-700305152',owner_user_name='tempest-ServerRescueNegativeTestJSON-700305152-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:49:19Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='01b32889cd7442399a8bceaff3d05662',uuid=b9751029-dfed-4342-ad92-9ae53d72fbc1,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a25ce12c-a83d-4128-ac1e-62ca02ae31fd", "address": "fa:16:3e:8f:41:ff", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25ce12c-a8", "ovs_interfaceid": "a25ce12c-a83d-4128-ac1e-62ca02ae31fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:51:56 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-582cd80a-7680-497b-867e-169c9a6489ab tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Converting VIF {"id": "a25ce12c-a83d-4128-ac1e-62ca02ae31fd", "address": "fa:16:3e:8f:41:ff", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.208", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapa25ce12c-a8", "ovs_interfaceid": "a25ce12c-a83d-4128-ac1e-62ca02ae31fd", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:51:56 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-582cd80a-7680-497b-867e-169c9a6489ab tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8f:41:ff,bridge_name='br-int',has_traffic_filtering=True,id=a25ce12c-a83d-4128-ac1e-62ca02ae31fd,network=Network(e1a83272-2e22-47dc-95ae-2ab9861c5925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa25ce12c-a8') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:51:56 user nova-compute[231753]: DEBUG os_vif [None req-582cd80a-7680-497b-867e-169c9a6489ab tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:41:ff,bridge_name='br-int',has_traffic_filtering=True,id=a25ce12c-a83d-4128-ac1e-62ca02ae31fd,network=Network(e1a83272-2e22-47dc-95ae-2ab9861c5925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa25ce12c-a8') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:51:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa25ce12c-a8, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:51:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:56 user nova-compute[231753]: INFO os_vif [None req-582cd80a-7680-497b-867e-169c9a6489ab tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8f:41:ff,bridge_name='br-int',has_traffic_filtering=True,id=a25ce12c-a83d-4128-ac1e-62ca02ae31fd,network=Network(e1a83272-2e22-47dc-95ae-2ab9861c5925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapa25ce12c-a8')
Jul 29 13:51:56 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-582cd80a-7680-497b-867e-169c9a6489ab tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Deleting instance files /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1_del
Jul 29 13:51:56 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-582cd80a-7680-497b-867e-169c9a6489ab tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Deletion of /opt/stack/data/nova/instances/b9751029-dfed-4342-ad92-9ae53d72fbc1_del complete
Jul 29 13:51:57 user nova-compute[231753]: INFO nova.compute.manager [None req-582cd80a-7680-497b-867e-169c9a6489ab tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Took 0.90 seconds to destroy the instance on the hypervisor.
Jul 29 13:51:57 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-582cd80a-7680-497b-867e-169c9a6489ab tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG nova.network.neutron [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Successfully updated port: 259c966b-ba73-42ca-9f38-7cba6bdc671c {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "refresh_cache-8e153c4d-75b5-4507-aac7-21620479209b" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquired lock "refresh_cache-8e153c4d-75b5-4507-aac7-21620479209b" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG nova.network.neutron [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG nova.compute.manager [req-cdfda142-4eb5-4b8e-a1bd-a69fe237bf45 req-0933d374-97d3-4144-8c37-c12e0f069ab5 service nova] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Received event network-changed-259c966b-ba73-42ca-9f38-7cba6bdc671c {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG nova.compute.manager [req-cdfda142-4eb5-4b8e-a1bd-a69fe237bf45 req-0933d374-97d3-4144-8c37-c12e0f069ab5 service nova] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Refreshing instance network info cache due to event network-changed-259c966b-ba73-42ca-9f38-7cba6bdc671c. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-cdfda142-4eb5-4b8e-a1bd-a69fe237bf45 req-0933d374-97d3-4144-8c37-c12e0f069ab5 service nova] Acquiring lock "refresh_cache-8e153c4d-75b5-4507-aac7-21620479209b" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG nova.network.neutron [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG nova.network.neutron [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Updating instance_info_cache with network_info: [{"id": "259c966b-ba73-42ca-9f38-7cba6bdc671c", "address": "fa:16:3e:4f:c8:e7", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259c966b-ba", "ovs_interfaceid": "259c966b-ba73-42ca-9f38-7cba6bdc671c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Releasing lock "refresh_cache-8e153c4d-75b5-4507-aac7-21620479209b" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG nova.compute.manager [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Instance network_info: |[{"id": "259c966b-ba73-42ca-9f38-7cba6bdc671c", "address": "fa:16:3e:4f:c8:e7", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259c966b-ba", "ovs_interfaceid": "259c966b-ba73-42ca-9f38-7cba6bdc671c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-cdfda142-4eb5-4b8e-a1bd-a69fe237bf45 req-0933d374-97d3-4144-8c37-c12e0f069ab5 service nova] Acquired lock "refresh_cache-8e153c4d-75b5-4507-aac7-21620479209b" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG nova.network.neutron [req-cdfda142-4eb5-4b8e-a1bd-a69fe237bf45 req-0933d374-97d3-4144-8c37-c12e0f069ab5 service nova] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Refreshing network info cache for port 259c966b-ba73-42ca-9f38-7cba6bdc671c {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Start _get_guest_xml network_info=[{"id": "259c966b-ba73-42ca-9f38-7cba6bdc671c", "address": "fa:16:3e:4f:c8:e7", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259c966b-ba", "ovs_interfaceid": "259c966b-ba73-42ca-9f38-7cba6bdc671c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:51:57 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:51:57 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:51:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:51:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-896554044',display_name='tempest-AttachVolumeTestJSON-server-896554044',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-896554044',id=38,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9IE6nSuVWJK41sX7BdajBXy6W41BPt0CXAIFZk19avwqF3lPYOXRAfcl7i6fRXc7WNirxpNsvUDclGK9D6D0AErb6WR3iw7Hlx2F2qbX/SyYE9P7wDuj1Uh1NXox7aFQ==',key_name='tempest-keypair-525173827',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a8801c6bc4b46ef9b407426c5eb07e0',ramdisk_id='',reservation_id='r-f1jvzamr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-695592502',owner_user_name='tempest-AttachVolumeTestJSON-695592502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:51:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df1ccafc63e0418e9889541bb8ecd3d2',uuid=8e153c4d-75b5-4507-aac7-21620479209b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "259c966b-ba73-42ca-9f38-7cba6bdc671c", "address": "fa:16:3e:4f:c8:e7", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259c966b-ba", "ovs_interfaceid": "259c966b-ba73-42ca-9f38-7cba6bdc671c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Converting VIF {"id": "259c966b-ba73-42ca-9f38-7cba6bdc671c", "address": "fa:16:3e:4f:c8:e7", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259c966b-ba", "ovs_interfaceid": "259c966b-ba73-42ca-9f38-7cba6bdc671c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:c8:e7,bridge_name='br-int',has_traffic_filtering=True,id=259c966b-ba73-42ca-9f38-7cba6bdc671c,network=Network(dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap259c966b-ba') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG nova.objects.instance [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e153c4d-75b5-4507-aac7-21620479209b {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:51:57 user nova-compute[231753]:   <uuid>8e153c4d-75b5-4507-aac7-21620479209b</uuid>
Jul 29 13:51:57 user nova-compute[231753]:   <name>instance-00000026</name>
Jul 29 13:51:57 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:51:57 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:51:57 user nova-compute[231753]:   <metadata>
Jul 29 13:51:57 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:51:57 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:51:57 user nova-compute[231753]:       <nova:name>tempest-AttachVolumeTestJSON-server-896554044</nova:name>
Jul 29 13:51:57 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:51:57</nova:creationTime>
Jul 29 13:51:57 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:51:57 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:51:57 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:51:57 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:51:57 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:51:57 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:51:57 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:51:57 user nova-compute[231753]:       <nova:owner>
Jul 29 13:51:57 user nova-compute[231753]:         <nova:user uuid="df1ccafc63e0418e9889541bb8ecd3d2">tempest-AttachVolumeTestJSON-695592502-project-member</nova:user>
Jul 29 13:51:57 user nova-compute[231753]:         <nova:project uuid="4a8801c6bc4b46ef9b407426c5eb07e0">tempest-AttachVolumeTestJSON-695592502</nova:project>
Jul 29 13:51:57 user nova-compute[231753]:       </nova:owner>
Jul 29 13:51:57 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:51:57 user nova-compute[231753]:       <nova:ports>
Jul 29 13:51:57 user nova-compute[231753]:         <nova:port uuid="259c966b-ba73-42ca-9f38-7cba6bdc671c">
Jul 29 13:51:57 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.3" ipVersion="4"/>
Jul 29 13:51:57 user nova-compute[231753]:         </nova:port>
Jul 29 13:51:57 user nova-compute[231753]:       </nova:ports>
Jul 29 13:51:57 user nova-compute[231753]:     </nova:instance>
Jul 29 13:51:57 user nova-compute[231753]:   </metadata>
Jul 29 13:51:57 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:51:57 user nova-compute[231753]:     <system>
Jul 29 13:51:57 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:51:57 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:51:57 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:51:57 user nova-compute[231753]:       <entry name="serial">8e153c4d-75b5-4507-aac7-21620479209b</entry>
Jul 29 13:51:57 user nova-compute[231753]:       <entry name="uuid">8e153c4d-75b5-4507-aac7-21620479209b</entry>
Jul 29 13:51:57 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:51:57 user nova-compute[231753]:     </system>
Jul 29 13:51:57 user nova-compute[231753]:   </sysinfo>
Jul 29 13:51:57 user nova-compute[231753]:   <os>
Jul 29 13:51:57 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:51:57 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:51:57 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:51:57 user nova-compute[231753]:   </os>
Jul 29 13:51:57 user nova-compute[231753]:   <features>
Jul 29 13:51:57 user nova-compute[231753]:     <acpi/>
Jul 29 13:51:57 user nova-compute[231753]:     <apic/>
Jul 29 13:51:57 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:51:57 user nova-compute[231753]:   </features>
Jul 29 13:51:57 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:51:57 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:51:57 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:51:57 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:51:57 user nova-compute[231753]:   </clock>
Jul 29 13:51:57 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:51:57 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:51:57 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:51:57 user nova-compute[231753]:   </cpu>
Jul 29 13:51:57 user nova-compute[231753]:   <devices>
Jul 29 13:51:57 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:51:57 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:51:57 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/8e153c4d-75b5-4507-aac7-21620479209b/disk"/>
Jul 29 13:51:57 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:51:57 user nova-compute[231753]:     </disk>
Jul 29 13:51:57 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:51:57 user nova-compute[231753]:       <mac address="fa:16:3e:4f:c8:e7"/>
Jul 29 13:51:57 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:51:57 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:51:57 user nova-compute[231753]:       <target dev="tap259c966b-ba"/>
Jul 29 13:51:57 user nova-compute[231753]:     </interface>
Jul 29 13:51:57 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:51:57 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/8e153c4d-75b5-4507-aac7-21620479209b/console.log" append="off"/>
Jul 29 13:51:57 user nova-compute[231753]:     </serial>
Jul 29 13:51:57 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:51:57 user nova-compute[231753]:     <video>
Jul 29 13:51:57 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:51:57 user nova-compute[231753]:     </video>
Jul 29 13:51:57 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:51:57 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:51:57 user nova-compute[231753]:     </rng>
Jul 29 13:51:57 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:51:57 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:51:57 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:51:57 user nova-compute[231753]:     </memballoon>
Jul 29 13:51:57 user nova-compute[231753]:   </devices>
Jul 29 13:51:57 user nova-compute[231753]: </domain>
Jul 29 13:51:57 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:51:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-896554044',display_name='tempest-AttachVolumeTestJSON-server-896554044',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-896554044',id=38,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9IE6nSuVWJK41sX7BdajBXy6W41BPt0CXAIFZk19avwqF3lPYOXRAfcl7i6fRXc7WNirxpNsvUDclGK9D6D0AErb6WR3iw7Hlx2F2qbX/SyYE9P7wDuj1Uh1NXox7aFQ==',key_name='tempest-keypair-525173827',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4a8801c6bc4b46ef9b407426c5eb07e0',ramdisk_id='',reservation_id='r-f1jvzamr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeTestJSON-695592502',owner_user_name='tempest-AttachVolumeTestJSON-695592502-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:51:55Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df1ccafc63e0418e9889541bb8ecd3d2',uuid=8e153c4d-75b5-4507-aac7-21620479209b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "259c966b-ba73-42ca-9f38-7cba6bdc671c", "address": "fa:16:3e:4f:c8:e7", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259c966b-ba", "ovs_interfaceid": "259c966b-ba73-42ca-9f38-7cba6bdc671c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Converting VIF {"id": "259c966b-ba73-42ca-9f38-7cba6bdc671c", "address": "fa:16:3e:4f:c8:e7", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259c966b-ba", "ovs_interfaceid": "259c966b-ba73-42ca-9f38-7cba6bdc671c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4f:c8:e7,bridge_name='br-int',has_traffic_filtering=True,id=259c966b-ba73-42ca-9f38-7cba6bdc671c,network=Network(dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap259c966b-ba') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG os_vif [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:c8:e7,bridge_name='br-int',has_traffic_filtering=True,id=259c966b-ba73-42ca-9f38-7cba6bdc671c,network=Network(dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap259c966b-ba') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap259c966b-ba, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap259c966b-ba, col_values=(('external_ids', {'iface-id': '259c966b-ba73-42ca-9f38-7cba6bdc671c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4f:c8:e7', 'vm-uuid': '8e153c4d-75b5-4507-aac7-21620479209b'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:51:57 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:57 user nova-compute[231753]: INFO os_vif [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4f:c8:e7,bridge_name='br-int',has_traffic_filtering=True,id=259c966b-ba73-42ca-9f38-7cba6bdc671c,network=Network(dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap259c966b-ba')
Jul 29 13:51:58 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:51:58 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] No VIF found with MAC fa:16:3e:4f:c8:e7, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:51:58 user nova-compute[231753]: DEBUG nova.network.neutron [req-cdfda142-4eb5-4b8e-a1bd-a69fe237bf45 req-0933d374-97d3-4144-8c37-c12e0f069ab5 service nova] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Updated VIF entry in instance network info cache for port 259c966b-ba73-42ca-9f38-7cba6bdc671c. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:51:58 user nova-compute[231753]: DEBUG nova.network.neutron [req-cdfda142-4eb5-4b8e-a1bd-a69fe237bf45 req-0933d374-97d3-4144-8c37-c12e0f069ab5 service nova] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Updating instance_info_cache with network_info: [{"id": "259c966b-ba73-42ca-9f38-7cba6bdc671c", "address": "fa:16:3e:4f:c8:e7", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259c966b-ba", "ovs_interfaceid": "259c966b-ba73-42ca-9f38-7cba6bdc671c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:51:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-cdfda142-4eb5-4b8e-a1bd-a69fe237bf45 req-0933d374-97d3-4144-8c37-c12e0f069ab5 service nova] Releasing lock "refresh_cache-8e153c4d-75b5-4507-aac7-21620479209b" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:51:58 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:51:58 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Took 1.41 seconds to deallocate network for instance.
Jul 29 13:51:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-582cd80a-7680-497b-867e-169c9a6489ab tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-582cd80a-7680-497b-867e-169c9a6489ab tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:58 user nova-compute[231753]: DEBUG nova.compute.manager [req-da831c63-f311-46d0-9304-747e9bdd1b57 req-1965036d-bbb2-4e5c-bab8-466df6f19371 service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Received event network-vif-plugged-a25ce12c-a83d-4128-ac1e-62ca02ae31fd {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:51:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-da831c63-f311-46d0-9304-747e9bdd1b57 req-1965036d-bbb2-4e5c-bab8-466df6f19371 service nova] Acquiring lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-da831c63-f311-46d0-9304-747e9bdd1b57 req-1965036d-bbb2-4e5c-bab8-466df6f19371 service nova] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-da831c63-f311-46d0-9304-747e9bdd1b57 req-1965036d-bbb2-4e5c-bab8-466df6f19371 service nova] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:58 user nova-compute[231753]: DEBUG nova.compute.manager [req-da831c63-f311-46d0-9304-747e9bdd1b57 req-1965036d-bbb2-4e5c-bab8-466df6f19371 service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] No waiting events found dispatching network-vif-plugged-a25ce12c-a83d-4128-ac1e-62ca02ae31fd {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:51:58 user nova-compute[231753]: WARNING nova.compute.manager [req-da831c63-f311-46d0-9304-747e9bdd1b57 req-1965036d-bbb2-4e5c-bab8-466df6f19371 service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Received unexpected event network-vif-plugged-a25ce12c-a83d-4128-ac1e-62ca02ae31fd for instance with vm_state deleted and task_state None.
Jul 29 13:51:58 user nova-compute[231753]: DEBUG nova.compute.manager [req-da831c63-f311-46d0-9304-747e9bdd1b57 req-1965036d-bbb2-4e5c-bab8-466df6f19371 service nova] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Received event network-vif-deleted-a25ce12c-a83d-4128-ac1e-62ca02ae31fd {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:51:58 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-582cd80a-7680-497b-867e-169c9a6489ab tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:51:58 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-582cd80a-7680-497b-867e-169c9a6489ab tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:51:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-582cd80a-7680-497b-867e-169c9a6489ab tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.422s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:58 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-582cd80a-7680-497b-867e-169c9a6489ab tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Deleted allocations for instance b9751029-dfed-4342-ad92-9ae53d72fbc1
Jul 29 13:51:59 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-582cd80a-7680-497b-867e-169c9a6489ab tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "b9751029-dfed-4342-ad92-9ae53d72fbc1" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.937s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:59 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690638704.1611056, c5f39add-9361-4cf7-aa3a-643f0a8252a7 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:51:59 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] VM Stopped (Lifecycle Event)
Jul 29 13:51:59 user nova-compute[231753]: DEBUG nova.compute.manager [None req-14faac8a-5b65-401c-8730-61362e0bcd30 None None] [instance: c5f39add-9361-4cf7-aa3a-643f0a8252a7] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:51:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:51:59 user nova-compute[231753]: DEBUG nova.compute.manager [req-951bcb7b-e1ad-4ea7-89e6-58f285918dc8 req-f58b0dd8-f695-475c-adbc-e1fc75e49269 service nova] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Received event network-vif-plugged-259c966b-ba73-42ca-9f38-7cba6bdc671c {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:51:59 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-951bcb7b-e1ad-4ea7-89e6-58f285918dc8 req-f58b0dd8-f695-475c-adbc-e1fc75e49269 service nova] Acquiring lock "8e153c4d-75b5-4507-aac7-21620479209b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:51:59 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-951bcb7b-e1ad-4ea7-89e6-58f285918dc8 req-f58b0dd8-f695-475c-adbc-e1fc75e49269 service nova] Lock "8e153c4d-75b5-4507-aac7-21620479209b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:51:59 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-951bcb7b-e1ad-4ea7-89e6-58f285918dc8 req-f58b0dd8-f695-475c-adbc-e1fc75e49269 service nova] Lock "8e153c4d-75b5-4507-aac7-21620479209b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:51:59 user nova-compute[231753]: DEBUG nova.compute.manager [req-951bcb7b-e1ad-4ea7-89e6-58f285918dc8 req-f58b0dd8-f695-475c-adbc-e1fc75e49269 service nova] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] No waiting events found dispatching network-vif-plugged-259c966b-ba73-42ca-9f38-7cba6bdc671c {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:51:59 user nova-compute[231753]: WARNING nova.compute.manager [req-951bcb7b-e1ad-4ea7-89e6-58f285918dc8 req-f58b0dd8-f695-475c-adbc-e1fc75e49269 service nova] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Received unexpected event network-vif-plugged-259c966b-ba73-42ca-9f38-7cba6bdc671c for instance with vm_state building and task_state spawning.
Jul 29 13:51:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:00 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:00 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:01 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638721.5483286, 8e153c4d-75b5-4507-aac7-21620479209b => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:52:01 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] VM Resumed (Lifecycle Event)
Jul 29 13:52:01 user nova-compute[231753]: DEBUG nova.compute.manager [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:52:01 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:52:01 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Instance spawned successfully.
Jul 29 13:52:01 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:52:01 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:52:01 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:52:01 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:52:01 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:52:01 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:52:01 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:52:01 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:52:01 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:52:01 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:52:01 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638721.5516653, 8e153c4d-75b5-4507-aac7-21620479209b => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:52:01 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] VM Started (Lifecycle Event)
Jul 29 13:52:01 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:52:01 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:52:01 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:52:01 user nova-compute[231753]: INFO nova.compute.manager [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Took 6.72 seconds to spawn the instance on the hypervisor.
Jul 29 13:52:01 user nova-compute[231753]: DEBUG nova.compute.manager [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:52:01 user nova-compute[231753]: DEBUG nova.compute.manager [req-3f8675d9-ed20-4a1e-9188-2bdc73faed7b req-4ce451aa-7839-4c8d-b763-0cedb347503d service nova] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Received event network-vif-plugged-259c966b-ba73-42ca-9f38-7cba6bdc671c {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:52:01 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3f8675d9-ed20-4a1e-9188-2bdc73faed7b req-4ce451aa-7839-4c8d-b763-0cedb347503d service nova] Acquiring lock "8e153c4d-75b5-4507-aac7-21620479209b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:52:01 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3f8675d9-ed20-4a1e-9188-2bdc73faed7b req-4ce451aa-7839-4c8d-b763-0cedb347503d service nova] Lock "8e153c4d-75b5-4507-aac7-21620479209b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:52:01 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3f8675d9-ed20-4a1e-9188-2bdc73faed7b req-4ce451aa-7839-4c8d-b763-0cedb347503d service nova] Lock "8e153c4d-75b5-4507-aac7-21620479209b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:52:01 user nova-compute[231753]: DEBUG nova.compute.manager [req-3f8675d9-ed20-4a1e-9188-2bdc73faed7b req-4ce451aa-7839-4c8d-b763-0cedb347503d service nova] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] No waiting events found dispatching network-vif-plugged-259c966b-ba73-42ca-9f38-7cba6bdc671c {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:52:01 user nova-compute[231753]: WARNING nova.compute.manager [req-3f8675d9-ed20-4a1e-9188-2bdc73faed7b req-4ce451aa-7839-4c8d-b763-0cedb347503d service nova] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Received unexpected event network-vif-plugged-259c966b-ba73-42ca-9f38-7cba6bdc671c for instance with vm_state building and task_state spawning.
Jul 29 13:52:01 user nova-compute[231753]: INFO nova.compute.manager [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Took 7.44 seconds to build instance.
Jul 29 13:52:01 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e1d54113-b750-44d2-857a-9bd3cc64fb21 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "8e153c4d-75b5-4507-aac7-21620479209b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.533s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:52:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:11 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690638716.920635, b9751029-dfed-4342-ad92-9ae53d72fbc1 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:52:11 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] VM Stopped (Lifecycle Event)
Jul 29 13:52:11 user nova-compute[231753]: DEBUG nova.compute.manager [None req-8fd46d84-64c8-4341-89ea-f931e7ae2f60 None None] [instance: b9751029-dfed-4342-ad92-9ae53d72fbc1] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:52:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:14 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:52:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:52:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:52:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:52:14 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 13:52:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:52:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:52:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:52:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json" returned: 0 in 0.151s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:52:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02501ee9-0dc6-4aa3-8fb8-055bb2989617/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:52:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02501ee9-0dc6-4aa3-8fb8-055bb2989617/disk --force-share --output=json" returned: 0 in 0.145s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:52:14 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02501ee9-0dc6-4aa3-8fb8-055bb2989617/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:52:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/02501ee9-0dc6-4aa3-8fb8-055bb2989617/disk --force-share --output=json" returned: 0 in 0.186s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:52:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:52:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:52:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:52:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:52:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:52:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json" returned: 0 in 0.133s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:52:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:52:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk.rescue --force-share --output=json" returned: 0 in 0.135s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:52:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:52:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:52:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:52:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:52:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e153c4d-75b5-4507-aac7-21620479209b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:52:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e153c4d-75b5-4507-aac7-21620479209b/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:52:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e153c4d-75b5-4507-aac7-21620479209b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:52:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e153c4d-75b5-4507-aac7-21620479209b/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:52:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:52:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:52:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965/disk.rescue --force-share --output=json" returned: 0 in 0.186s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:52:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:52:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:52:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:52:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e71bc1-78c8-4cec-a935-878dd08ff941/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:52:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e71bc1-78c8-4cec-a935-878dd08ff941/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:52:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e71bc1-78c8-4cec-a935-878dd08ff941/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:52:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e71bc1-78c8-4cec-a935-878dd08ff941/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:52:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:52:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:52:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:52:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:52:17 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:52:17 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:52:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=7376MB free_disk=24.879058837890625GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 13:52:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:52:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:52:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 7e2615c1-b03e-4076-bcd9-3585fb11b8ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:52:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8ea52d41-7ec3-44d7-8421-133000ee887b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:52:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance cf326e80-7293-4764-9411-ed05a5aeba23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:52:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b99a72ba-73e2-4be7-b52b-7797351daa5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:52:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b6be450b-ebe7-4385-b162-2d072237aa97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:52:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 02501ee9-0dc6-4aa3-8fb8-055bb2989617 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:52:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:52:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 97e71bc1-78c8-4cec-a935-878dd08ff941 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:52:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8e153c4d-75b5-4507-aac7-21620479209b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:52:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 13:52:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=7GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 13:52:17 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:18 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:52:18 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:52:18 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 13:52:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.508s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:52:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:19 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:52:19 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:52:19 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:52:19 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 13:52:19 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:52:19 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 13:52:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "refresh_cache-b6be450b-ebe7-4385-b162-2d072237aa97" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:52:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquired lock "refresh_cache-b6be450b-ebe7-4385-b162-2d072237aa97" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:52:19 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Forcefully refreshing network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 13:52:19 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Updating instance_info_cache with network_info: [{"id": "89f0da4e-b00a-4840-b7d3-0b455f6ed266", "address": "fa:16:3e:73:e6:fa", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f0da4e-b0", "ovs_interfaceid": "89f0da4e-b00a-4840-b7d3-0b455f6ed266", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:52:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Releasing lock "refresh_cache-b6be450b-ebe7-4385-b162-2d072237aa97" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:52:19 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Updated the network info_cache for instance {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 13:52:20 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:52:21 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:52:22 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:52:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:23 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:52:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c855a93d-cc9e-4435-86ce-f4f92c235c75 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "02501ee9-0dc6-4aa3-8fb8-055bb2989617" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:52:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c855a93d-cc9e-4435-86ce-f4f92c235c75 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "02501ee9-0dc6-4aa3-8fb8-055bb2989617" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:52:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c855a93d-cc9e-4435-86ce-f4f92c235c75 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "02501ee9-0dc6-4aa3-8fb8-055bb2989617-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:52:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c855a93d-cc9e-4435-86ce-f4f92c235c75 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "02501ee9-0dc6-4aa3-8fb8-055bb2989617-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:52:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c855a93d-cc9e-4435-86ce-f4f92c235c75 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "02501ee9-0dc6-4aa3-8fb8-055bb2989617-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:52:28 user nova-compute[231753]: INFO nova.compute.manager [None req-c855a93d-cc9e-4435-86ce-f4f92c235c75 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Terminating instance
Jul 29 13:52:28 user nova-compute[231753]: DEBUG nova.compute.manager [None req-c855a93d-cc9e-4435-86ce-f4f92c235c75 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:52:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:28 user nova-compute[231753]: DEBUG nova.compute.manager [req-d7333c0a-a1ce-4430-993f-80aa10a0822b req-34d90cac-614f-455a-8140-71d0e245e517 service nova] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Received event network-vif-unplugged-5efea429-64cb-4dde-aa19-0b5152a03181 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:52:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d7333c0a-a1ce-4430-993f-80aa10a0822b req-34d90cac-614f-455a-8140-71d0e245e517 service nova] Acquiring lock "02501ee9-0dc6-4aa3-8fb8-055bb2989617-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:52:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d7333c0a-a1ce-4430-993f-80aa10a0822b req-34d90cac-614f-455a-8140-71d0e245e517 service nova] Lock "02501ee9-0dc6-4aa3-8fb8-055bb2989617-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:52:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-d7333c0a-a1ce-4430-993f-80aa10a0822b req-34d90cac-614f-455a-8140-71d0e245e517 service nova] Lock "02501ee9-0dc6-4aa3-8fb8-055bb2989617-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:52:28 user nova-compute[231753]: DEBUG nova.compute.manager [req-d7333c0a-a1ce-4430-993f-80aa10a0822b req-34d90cac-614f-455a-8140-71d0e245e517 service nova] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] No waiting events found dispatching network-vif-unplugged-5efea429-64cb-4dde-aa19-0b5152a03181 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:52:28 user nova-compute[231753]: DEBUG nova.compute.manager [req-d7333c0a-a1ce-4430-993f-80aa10a0822b req-34d90cac-614f-455a-8140-71d0e245e517 service nova] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Received event network-vif-unplugged-5efea429-64cb-4dde-aa19-0b5152a03181 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:52:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:29 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Instance destroyed successfully.
Jul 29 13:52:29 user nova-compute[231753]: DEBUG nova.objects.instance [None req-c855a93d-cc9e-4435-86ce-f4f92c235c75 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lazy-loading 'resources' on Instance uuid 02501ee9-0dc6-4aa3-8fb8-055bb2989617 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:52:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-c855a93d-cc9e-4435-86ce-f4f92c235c75 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:49:28Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeNegativeTest-server-816449773',display_name='tempest-AttachVolumeNegativeTest-server-816449773',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumenegativetest-server-816449773',id=34,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNkXD9yc60vb4MNT0cCgAfpCMu1Q/Vk2JAMb3utpRZEkQ8MV1TPiwL3OV1ALNn2/4ikHvB816sQq9uvqyOJXuP14Lzcz8qU3UV+UrBc2J19/0nTOkYNkfwVv7BSwrnyweQ==',key_name='tempest-keypair-2018580862',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:49:36Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f3122196c4504a82a2a01774ab60406a',ramdisk_id='',reservation_id='r-87tl7djz',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeNegativeTest-1031975907',owner_user_name='tempest-AttachVolumeNegativeTest-1031975907-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:49:37Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='a09de75c8ab742fe951604b612ea5839',uuid=02501ee9-0dc6-4aa3-8fb8-055bb2989617,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "5efea429-64cb-4dde-aa19-0b5152a03181", "address": "fa:16:3e:eb:f5:54", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5efea429-64", "ovs_interfaceid": "5efea429-64cb-4dde-aa19-0b5152a03181", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:52:29 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-c855a93d-cc9e-4435-86ce-f4f92c235c75 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Converting VIF {"id": "5efea429-64cb-4dde-aa19-0b5152a03181", "address": "fa:16:3e:eb:f5:54", "network": {"id": "1ff03660-77ea-4ec6-8eeb-55df7e78096b", "bridge": "br-int", "label": "tempest-AttachVolumeNegativeTest-1054893879-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.80", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f3122196c4504a82a2a01774ab60406a", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap5efea429-64", "ovs_interfaceid": "5efea429-64cb-4dde-aa19-0b5152a03181", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:52:29 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-c855a93d-cc9e-4435-86ce-f4f92c235c75 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:eb:f5:54,bridge_name='br-int',has_traffic_filtering=True,id=5efea429-64cb-4dde-aa19-0b5152a03181,network=Network(1ff03660-77ea-4ec6-8eeb-55df7e78096b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5efea429-64') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:52:29 user nova-compute[231753]: DEBUG os_vif [None req-c855a93d-cc9e-4435-86ce-f4f92c235c75 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:f5:54,bridge_name='br-int',has_traffic_filtering=True,id=5efea429-64cb-4dde-aa19-0b5152a03181,network=Network(1ff03660-77ea-4ec6-8eeb-55df7e78096b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5efea429-64') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:52:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap5efea429-64, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:52:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:52:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:29 user nova-compute[231753]: INFO os_vif [None req-c855a93d-cc9e-4435-86ce-f4f92c235c75 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:eb:f5:54,bridge_name='br-int',has_traffic_filtering=True,id=5efea429-64cb-4dde-aa19-0b5152a03181,network=Network(1ff03660-77ea-4ec6-8eeb-55df7e78096b),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap5efea429-64')
Jul 29 13:52:29 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-c855a93d-cc9e-4435-86ce-f4f92c235c75 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Deleting instance files /opt/stack/data/nova/instances/02501ee9-0dc6-4aa3-8fb8-055bb2989617_del
Jul 29 13:52:29 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-c855a93d-cc9e-4435-86ce-f4f92c235c75 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Deletion of /opt/stack/data/nova/instances/02501ee9-0dc6-4aa3-8fb8-055bb2989617_del complete
Jul 29 13:52:29 user nova-compute[231753]: INFO nova.compute.manager [None req-c855a93d-cc9e-4435-86ce-f4f92c235c75 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 29 13:52:29 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-c855a93d-cc9e-4435-86ce-f4f92c235c75 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:52:29 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:52:29 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:52:30 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:52:30 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Took 1.09 seconds to deallocate network for instance.
Jul 29 13:52:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c855a93d-cc9e-4435-86ce-f4f92c235c75 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:52:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c855a93d-cc9e-4435-86ce-f4f92c235c75 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:52:30 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-c855a93d-cc9e-4435-86ce-f4f92c235c75 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:52:30 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-c855a93d-cc9e-4435-86ce-f4f92c235c75 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:52:30 user nova-compute[231753]: DEBUG nova.compute.manager [req-80b953dd-3e75-491d-9d35-171f40993f3d req-63322a97-92a5-4575-a708-5630b3ea2c10 service nova] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Received event network-vif-plugged-5efea429-64cb-4dde-aa19-0b5152a03181 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:52:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-80b953dd-3e75-491d-9d35-171f40993f3d req-63322a97-92a5-4575-a708-5630b3ea2c10 service nova] Acquiring lock "02501ee9-0dc6-4aa3-8fb8-055bb2989617-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:52:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-80b953dd-3e75-491d-9d35-171f40993f3d req-63322a97-92a5-4575-a708-5630b3ea2c10 service nova] Lock "02501ee9-0dc6-4aa3-8fb8-055bb2989617-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:52:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-80b953dd-3e75-491d-9d35-171f40993f3d req-63322a97-92a5-4575-a708-5630b3ea2c10 service nova] Lock "02501ee9-0dc6-4aa3-8fb8-055bb2989617-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:52:30 user nova-compute[231753]: DEBUG nova.compute.manager [req-80b953dd-3e75-491d-9d35-171f40993f3d req-63322a97-92a5-4575-a708-5630b3ea2c10 service nova] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] No waiting events found dispatching network-vif-plugged-5efea429-64cb-4dde-aa19-0b5152a03181 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:52:30 user nova-compute[231753]: WARNING nova.compute.manager [req-80b953dd-3e75-491d-9d35-171f40993f3d req-63322a97-92a5-4575-a708-5630b3ea2c10 service nova] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Received unexpected event network-vif-plugged-5efea429-64cb-4dde-aa19-0b5152a03181 for instance with vm_state deleted and task_state None.
Jul 29 13:52:30 user nova-compute[231753]: DEBUG nova.compute.manager [req-80b953dd-3e75-491d-9d35-171f40993f3d req-63322a97-92a5-4575-a708-5630b3ea2c10 service nova] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Received event network-vif-deleted-5efea429-64cb-4dde-aa19-0b5152a03181 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:52:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c855a93d-cc9e-4435-86ce-f4f92c235c75 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.353s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:52:31 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-c855a93d-cc9e-4435-86ce-f4f92c235c75 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Deleted allocations for instance 02501ee9-0dc6-4aa3-8fb8-055bb2989617
Jul 29 13:52:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c855a93d-cc9e-4435-86ce-f4f92c235c75 tempest-AttachVolumeNegativeTest-1031975907 tempest-AttachVolumeNegativeTest-1031975907-project-member] Lock "02501ee9-0dc6-4aa3-8fb8-055bb2989617" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.556s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:52:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:35 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:44 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690638749.3752882, 02501ee9-0dc6-4aa3-8fb8-055bb2989617 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:52:44 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] VM Stopped (Lifecycle Event)
Jul 29 13:52:44 user nova-compute[231753]: DEBUG nova.compute.manager [None req-e1761618-fb26-4bcc-bedd-bfc61f4563b6 None None] [instance: 02501ee9-0dc6-4aa3-8fb8-055bb2989617] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:52:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:52 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "1c4a953b-67c9-4c69-950a-7487735e917c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:52:52 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "1c4a953b-67c9-4c69-950a-7487735e917c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:52:52 user nova-compute[231753]: DEBUG nova.compute.manager [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:52:52 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:52:52 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:52:52 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:52:52 user nova-compute[231753]: INFO nova.compute.claims [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Claim successful on node user
Jul 29 13:52:52 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:52:52 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:52:52 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.378s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:52:52 user nova-compute[231753]: DEBUG nova.compute.manager [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:52:52 user nova-compute[231753]: DEBUG nova.compute.manager [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:52:52 user nova-compute[231753]: DEBUG nova.network.neutron [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:52:52 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:52:52 user nova-compute[231753]: DEBUG nova.compute.manager [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:52:52 user nova-compute[231753]: DEBUG nova.policy [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd94a7ea0c19845b886e12c1689cf30a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45c92d3fe964066b9be87489b2c9f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:52:52 user nova-compute[231753]: INFO nova.virt.block_device [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Booting with volume a4fd52a0-187e-4105-9637-1cd908377699 at /dev/vda
Jul 29 13:52:53 user nova-compute[231753]: DEBUG os_brick.utils [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:52:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:52:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:52:53 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[85c2ed88-05b7-4180-9f75-cc9903bc130b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:52:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:52:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:52:53 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b7d7dad-ffd4-4a52-b56a-24912820cfd4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:52:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:52:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:52:53 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[321f30c8-2a6a-4e91-bcab-c162fafe1fb0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:52:53 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[60474ecd-559b-486e-8eb2-e62d1351aa59]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:52:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:52:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:52:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:52:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:52:53 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:52:53 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:52:53 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf664407-da4d-40dd-8841-0fb3feb03f3c]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:52:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:52:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:52:53 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:52:53 user nova-compute[231753]: DEBUG os_brick.utils [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:52:53 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Updating existing volume attachment record: b9718c7c-d61b-4c3f-869b-29065461e9ca {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:52:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Acquiring lock "a3f9ad53-db31-404a-8442-37cf53f11cbc" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:52:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lock "a3f9ad53-db31-404a-8442-37cf53f11cbc" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:52:53 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:52:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:52:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:52:54 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:52:54 user nova-compute[231753]: INFO nova.compute.claims [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Claim successful on node user
Jul 29 13:52:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:54 user nova-compute[231753]: DEBUG nova.network.neutron [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Successfully created port: da91541f-4471-455f-adf7-cfa9eb63de88 {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:52:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:54 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:52:54 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:52:54 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.461s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:52:54 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:52:54 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:52:54 user nova-compute[231753]: DEBUG nova.network.neutron [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:52:54 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:52:54 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:52:54 user nova-compute[231753]: INFO nova.virt.block_device [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Booting with volume 3be506b8-85e1-474c-8c6b-6f8ef82b95bf at /dev/vda
Jul 29 13:52:54 user nova-compute[231753]: DEBUG nova.policy [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d35af1d300041a2b0fd8039d1a4b623', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '06b552c0991c456eb101472ca6777f19', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:52:54 user nova-compute[231753]: DEBUG os_brick.utils [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:52:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:52:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:52:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6e30e41-d6eb-4460-acb1-8180e669b9b9]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:52:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:52:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:52:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f7f01a-6960-4fbf-a228-c1cb34287f25]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:52:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:52:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:52:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[97553a8a-86a4-4e86-ba43-bb81a5632318]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:52:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[826cf1cc-183d-4a4c-8a2c-129c381a3a2b]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:52:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:52:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:52:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:52:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:52:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:52:54 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:52:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[318fc6cf-5a51-477c-89b5-a677865a89ef]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:52:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:52:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:52:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:52:54 user nova-compute[231753]: DEBUG os_brick.utils [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] <== get_connector_properties: return (130ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:52:54 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Updating existing volume attachment record: 4e4c9c8f-967d-4ead-9c5e-6b0a8a5f7773 {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:52:55 user nova-compute[231753]: DEBUG nova.network.neutron [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Successfully updated port: da91541f-4471-455f-adf7-cfa9eb63de88 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:52:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "refresh_cache-1c4a953b-67c9-4c69-950a-7487735e917c" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:52:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquired lock "refresh_cache-1c4a953b-67c9-4c69-950a-7487735e917c" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:52:55 user nova-compute[231753]: DEBUG nova.network.neutron [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:52:55 user nova-compute[231753]: DEBUG nova.compute.manager [req-1dc2f399-db13-4d68-8c6d-a8eba6367d73 req-77db3c35-82a7-4499-a060-bc58b1d2354b service nova] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Received event network-changed-da91541f-4471-455f-adf7-cfa9eb63de88 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:52:55 user nova-compute[231753]: DEBUG nova.compute.manager [req-1dc2f399-db13-4d68-8c6d-a8eba6367d73 req-77db3c35-82a7-4499-a060-bc58b1d2354b service nova] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Refreshing instance network info cache due to event network-changed-da91541f-4471-455f-adf7-cfa9eb63de88. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:52:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-1dc2f399-db13-4d68-8c6d-a8eba6367d73 req-77db3c35-82a7-4499-a060-bc58b1d2354b service nova] Acquiring lock "refresh_cache-1c4a953b-67c9-4c69-950a-7487735e917c" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:52:55 user nova-compute[231753]: DEBUG nova.network.neutron [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:52:55 user nova-compute[231753]: DEBUG nova.network.neutron [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Successfully created port: b6be4498-da79-4335-9f95-6a191a4ce127 {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:52:55 user nova-compute[231753]: DEBUG nova.network.neutron [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Updating instance_info_cache with network_info: [{"id": "da91541f-4471-455f-adf7-cfa9eb63de88", "address": "fa:16:3e:3d:fe:a2", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda91541f-44", "ovs_interfaceid": "da91541f-4471-455f-adf7-cfa9eb63de88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:52:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Releasing lock "refresh_cache-1c4a953b-67c9-4c69-950a-7487735e917c" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:52:55 user nova-compute[231753]: DEBUG nova.compute.manager [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Instance network_info: |[{"id": "da91541f-4471-455f-adf7-cfa9eb63de88", "address": "fa:16:3e:3d:fe:a2", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda91541f-44", "ovs_interfaceid": "da91541f-4471-455f-adf7-cfa9eb63de88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:52:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-1dc2f399-db13-4d68-8c6d-a8eba6367d73 req-77db3c35-82a7-4499-a060-bc58b1d2354b service nova] Acquired lock "refresh_cache-1c4a953b-67c9-4c69-950a-7487735e917c" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:52:55 user nova-compute[231753]: DEBUG nova.network.neutron [req-1dc2f399-db13-4d68-8c6d-a8eba6367d73 req-77db3c35-82a7-4499-a060-bc58b1d2354b service nova] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Refreshing network info cache for port da91541f-4471-455f-adf7-cfa9eb63de88 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:52:56 user nova-compute[231753]: DEBUG nova.network.neutron [req-1dc2f399-db13-4d68-8c6d-a8eba6367d73 req-77db3c35-82a7-4499-a060-bc58b1d2354b service nova] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Updated VIF entry in instance network info cache for port da91541f-4471-455f-adf7-cfa9eb63de88. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:52:56 user nova-compute[231753]: DEBUG nova.network.neutron [req-1dc2f399-db13-4d68-8c6d-a8eba6367d73 req-77db3c35-82a7-4499-a060-bc58b1d2354b service nova] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Updating instance_info_cache with network_info: [{"id": "da91541f-4471-455f-adf7-cfa9eb63de88", "address": "fa:16:3e:3d:fe:a2", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda91541f-44", "ovs_interfaceid": "da91541f-4471-455f-adf7-cfa9eb63de88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:52:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-1dc2f399-db13-4d68-8c6d-a8eba6367d73 req-77db3c35-82a7-4499-a060-bc58b1d2354b service nova] Releasing lock "refresh_cache-1c4a953b-67c9-4c69-950a-7487735e917c" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:52:56 user nova-compute[231753]: DEBUG nova.network.neutron [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Successfully updated port: b6be4498-da79-4335-9f95-6a191a4ce127 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:52:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Acquiring lock "refresh_cache-a3f9ad53-db31-404a-8442-37cf53f11cbc" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:52:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Acquired lock "refresh_cache-a3f9ad53-db31-404a-8442-37cf53f11cbc" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:52:56 user nova-compute[231753]: DEBUG nova.network.neutron [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:52:56 user nova-compute[231753]: DEBUG nova.compute.manager [req-a5424eb1-b1de-405f-b150-76edd8891c90 req-41b998bc-c1d7-4558-88ea-cf971c4971e1 service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Received event network-changed-b6be4498-da79-4335-9f95-6a191a4ce127 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:52:56 user nova-compute[231753]: DEBUG nova.compute.manager [req-a5424eb1-b1de-405f-b150-76edd8891c90 req-41b998bc-c1d7-4558-88ea-cf971c4971e1 service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Refreshing instance network info cache due to event network-changed-b6be4498-da79-4335-9f95-6a191a4ce127. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:52:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a5424eb1-b1de-405f-b150-76edd8891c90 req-41b998bc-c1d7-4558-88ea-cf971c4971e1 service nova] Acquiring lock "refresh_cache-a3f9ad53-db31-404a-8442-37cf53f11cbc" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:52:56 user nova-compute[231753]: DEBUG nova.network.neutron [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:52:56 user nova-compute[231753]: DEBUG nova.network.neutron [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Updating instance_info_cache with network_info: [{"id": "b6be4498-da79-4335-9f95-6a191a4ce127", "address": "fa:16:3e:c2:b5:20", "network": {"id": "e36e72a2-fbed-483c-827c-436fa6786390", "bridge": "br-int", "label": "tempest-TestShelveInstance-2100930356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b552c0991c456eb101472ca6777f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6be4498-da", "ovs_interfaceid": "b6be4498-da79-4335-9f95-6a191a4ce127", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:52:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Releasing lock "refresh_cache-a3f9ad53-db31-404a-8442-37cf53f11cbc" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:52:56 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Instance network_info: |[{"id": "b6be4498-da79-4335-9f95-6a191a4ce127", "address": "fa:16:3e:c2:b5:20", "network": {"id": "e36e72a2-fbed-483c-827c-436fa6786390", "bridge": "br-int", "label": "tempest-TestShelveInstance-2100930356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b552c0991c456eb101472ca6777f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6be4498-da", "ovs_interfaceid": "b6be4498-da79-4335-9f95-6a191a4ce127", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:52:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a5424eb1-b1de-405f-b150-76edd8891c90 req-41b998bc-c1d7-4558-88ea-cf971c4971e1 service nova] Acquired lock "refresh_cache-a3f9ad53-db31-404a-8442-37cf53f11cbc" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:52:56 user nova-compute[231753]: DEBUG nova.network.neutron [req-a5424eb1-b1de-405f-b150-76edd8891c90 req-41b998bc-c1d7-4558-88ea-cf971c4971e1 service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Refreshing network info cache for port b6be4498-da79-4335-9f95-6a191a4ce127 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:52:57 user nova-compute[231753]: DEBUG nova.network.neutron [req-a5424eb1-b1de-405f-b150-76edd8891c90 req-41b998bc-c1d7-4558-88ea-cf971c4971e1 service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Updated VIF entry in instance network info cache for port b6be4498-da79-4335-9f95-6a191a4ce127. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:52:57 user nova-compute[231753]: DEBUG nova.network.neutron [req-a5424eb1-b1de-405f-b150-76edd8891c90 req-41b998bc-c1d7-4558-88ea-cf971c4971e1 service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Updating instance_info_cache with network_info: [{"id": "b6be4498-da79-4335-9f95-6a191a4ce127", "address": "fa:16:3e:c2:b5:20", "network": {"id": "e36e72a2-fbed-483c-827c-436fa6786390", "bridge": "br-int", "label": "tempest-TestShelveInstance-2100930356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b552c0991c456eb101472ca6777f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6be4498-da", "ovs_interfaceid": "b6be4498-da79-4335-9f95-6a191a4ce127", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:52:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a5424eb1-b1de-405f-b150-76edd8891c90 req-41b998bc-c1d7-4558-88ea-cf971c4971e1 service nova] Releasing lock "refresh_cache-a3f9ad53-db31-404a-8442-37cf53f11cbc" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:52:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-26134801-2322-4501-8116-2e79fa1a524d tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "8ea52d41-7ec3-44d7-8421-133000ee887b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:52:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-26134801-2322-4501-8116-2e79fa1a524d tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "8ea52d41-7ec3-44d7-8421-133000ee887b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:52:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-26134801-2322-4501-8116-2e79fa1a524d tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "8ea52d41-7ec3-44d7-8421-133000ee887b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:52:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-26134801-2322-4501-8116-2e79fa1a524d tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "8ea52d41-7ec3-44d7-8421-133000ee887b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:52:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-26134801-2322-4501-8116-2e79fa1a524d tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "8ea52d41-7ec3-44d7-8421-133000ee887b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:52:58 user nova-compute[231753]: INFO nova.compute.manager [None req-26134801-2322-4501-8116-2e79fa1a524d tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Terminating instance
Jul 29 13:52:58 user nova-compute[231753]: DEBUG nova.compute.manager [None req-26134801-2322-4501-8116-2e79fa1a524d tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:52:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:59 user nova-compute[231753]: DEBUG nova.compute.manager [req-56a06112-bdee-4629-982f-77941b666dee req-6012646c-26ca-4bf1-9ab4-4fcaa14bc098 service nova] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Received event network-vif-unplugged-4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:52:59 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-56a06112-bdee-4629-982f-77941b666dee req-6012646c-26ca-4bf1-9ab4-4fcaa14bc098 service nova] Acquiring lock "8ea52d41-7ec3-44d7-8421-133000ee887b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:52:59 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-56a06112-bdee-4629-982f-77941b666dee req-6012646c-26ca-4bf1-9ab4-4fcaa14bc098 service nova] Lock "8ea52d41-7ec3-44d7-8421-133000ee887b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:52:59 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-56a06112-bdee-4629-982f-77941b666dee req-6012646c-26ca-4bf1-9ab4-4fcaa14bc098 service nova] Lock "8ea52d41-7ec3-44d7-8421-133000ee887b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:52:59 user nova-compute[231753]: DEBUG nova.compute.manager [req-56a06112-bdee-4629-982f-77941b666dee req-6012646c-26ca-4bf1-9ab4-4fcaa14bc098 service nova] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] No waiting events found dispatching network-vif-unplugged-4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:52:59 user nova-compute[231753]: DEBUG nova.compute.manager [req-56a06112-bdee-4629-982f-77941b666dee req-6012646c-26ca-4bf1-9ab4-4fcaa14bc098 service nova] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Received event network-vif-unplugged-4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:52:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:59 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Instance destroyed successfully.
Jul 29 13:52:59 user nova-compute[231753]: DEBUG nova.objects.instance [None req-26134801-2322-4501-8116-2e79fa1a524d tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lazy-loading 'resources' on Instance uuid 8ea52d41-7ec3-44d7-8421-133000ee887b {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:52:59 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-26134801-2322-4501-8116-2e79fa1a524d tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:36:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1662901966',display_name='tempest-ServerRescueNegativeTestJSON-server-1662901966',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-1662901966',id=15,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:38:38Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7aa6e9e70b4a49cb994440e868203c99',ramdisk_id='',reservation_id='r-bdwxrtct',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-700305152',owner_user_name='tempest-ServerRescueNegativeTestJSON-700305152-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:38:39Z,user_data=None,user_id='01b32889cd7442399a8bceaff3d05662',uuid=8ea52d41-7ec3-44d7-8421-133000ee887b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='rescued') vif={"id": "4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b", "address": "fa:16:3e:33:76:ce", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed7b5c5-f0", "ovs_interfaceid": "4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:52:59 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-26134801-2322-4501-8116-2e79fa1a524d tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Converting VIF {"id": "4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b", "address": "fa:16:3e:33:76:ce", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4ed7b5c5-f0", "ovs_interfaceid": "4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:52:59 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-26134801-2322-4501-8116-2e79fa1a524d tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:33:76:ce,bridge_name='br-int',has_traffic_filtering=True,id=4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b,network=Network(e1a83272-2e22-47dc-95ae-2ab9861c5925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed7b5c5-f0') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:52:59 user nova-compute[231753]: DEBUG os_vif [None req-26134801-2322-4501-8116-2e79fa1a524d tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:76:ce,bridge_name='br-int',has_traffic_filtering=True,id=4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b,network=Network(e1a83272-2e22-47dc-95ae-2ab9861c5925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed7b5c5-f0') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:52:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4ed7b5c5-f0, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:52:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:52:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:52:59 user nova-compute[231753]: INFO os_vif [None req-26134801-2322-4501-8116-2e79fa1a524d tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:33:76:ce,bridge_name='br-int',has_traffic_filtering=True,id=4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b,network=Network(e1a83272-2e22-47dc-95ae-2ab9861c5925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4ed7b5c5-f0')
Jul 29 13:52:59 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-26134801-2322-4501-8116-2e79fa1a524d tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Deleting instance files /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b_del
Jul 29 13:52:59 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-26134801-2322-4501-8116-2e79fa1a524d tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Deletion of /opt/stack/data/nova/instances/8ea52d41-7ec3-44d7-8421-133000ee887b_del complete
Jul 29 13:52:59 user nova-compute[231753]: INFO nova.compute.manager [None req-26134801-2322-4501-8116-2e79fa1a524d tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Took 0.97 seconds to destroy the instance on the hypervisor.
Jul 29 13:52:59 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-26134801-2322-4501-8116-2e79fa1a524d tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:52:59 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:52:59 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:53:00 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:53:00 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Took 0.52 seconds to deallocate network for instance.
Jul 29 13:53:00 user nova-compute[231753]: DEBUG nova.compute.manager [req-82b79cc6-6a07-4b82-9344-2b4652c2087f req-ee485246-43a9-49a8-abb9-687a709b5aae service nova] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Received event network-vif-deleted-4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:53:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-26134801-2322-4501-8116-2e79fa1a524d tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:53:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-26134801-2322-4501-8116-2e79fa1a524d tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:53:00 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-26134801-2322-4501-8116-2e79fa1a524d tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:53:00 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-26134801-2322-4501-8116-2e79fa1a524d tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:53:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-26134801-2322-4501-8116-2e79fa1a524d tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.365s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:53:00 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-26134801-2322-4501-8116-2e79fa1a524d tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Deleted allocations for instance 8ea52d41-7ec3-44d7-8421-133000ee887b
Jul 29 13:53:00 user nova-compute[231753]: DEBUG nova.compute.manager [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:53:00 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:53:00 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Creating image(s)
Jul 29 13:53:00 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Did not create local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 29 13:53:00 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Ensure instance console log exists: /opt/stack/data/nova/instances/1c4a953b-67c9-4c69-950a-7487735e917c/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:53:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:53:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:53:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:53:00 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Start _get_guest_xml network_info=[{"id": "da91541f-4471-455f-adf7-cfa9eb63de88", "address": "fa:16:3e:3d:fe:a2", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda91541f-44", "ovs_interfaceid": "da91541f-4471-455f-adf7-cfa9eb63de88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mcHrOkjh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '1c4a953b-67c9-4c69-950a-7487735e917c', 'attached_at': '', 'detached_at': '', 'volume_id': 'a4fd52a0-187e-4105-9637-1cd908377699', 'serial': 'a4fd52a0-187e-4105-9637-1cd908377699'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'attachment_id': 'b9718c7c-d61b-4c3f-869b-29065461e9ca', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:53:00 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:53:01 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:53:01 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mcHrOkjh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:53:01 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:53:01 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:53:01 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:53:01 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:53:01 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-26134801-2322-4501-8116-2e79fa1a524d tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "8ea52d41-7ec3-44d7-8421-133000ee887b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.195s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a8e2775-0611-47d3-8d2c-05dc77b1867c]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:53:01 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[17d2ed83-1d58-46cc-8000-76b1cc6ac6bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699] added
Jul 29 13:53:01 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a95f232-be2d-4b56-821c-d479361a8b9c]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb415be0-1e61-42c1-882f-594953a1a1f2]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mcHrOkjh {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v mcHrOkjh" returned: 0 in 0.028s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3db67dfe-d57a-4a08-9d3b-a9f5653e770c]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'mcHrOkjh'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6541b8-142d-44e5-a03e-8b32590d8930]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f01d75-4b93-4b1d-a0e2-410ce64063bc]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:53:01 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:53:01 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:53:01 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:53:01 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG nova.compute.manager [req-34e1cf55-f2b3-4264-9eaa-9c1ced230cfc req-08818ad8-c011-400d-9e41-b3590ec7c675 service nova] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Received event network-vif-plugged-4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-34e1cf55-f2b3-4264-9eaa-9c1ced230cfc req-08818ad8-c011-400d-9e41-b3590ec7c675 service nova] Acquiring lock "8ea52d41-7ec3-44d7-8421-133000ee887b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-34e1cf55-f2b3-4264-9eaa-9c1ced230cfc req-08818ad8-c011-400d-9e41-b3590ec7c675 service nova] Lock "8ea52d41-7ec3-44d7-8421-133000ee887b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-34e1cf55-f2b3-4264-9eaa-9c1ced230cfc req-08818ad8-c011-400d-9e41-b3590ec7c675 service nova] Lock "8ea52d41-7ec3-44d7-8421-133000ee887b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG nova.compute.manager [req-34e1cf55-f2b3-4264-9eaa-9c1ced230cfc req-08818ad8-c011-400d-9e41-b3590ec7c675 service nova] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] No waiting events found dispatching network-vif-plugged-4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:53:01 user nova-compute[231753]: WARNING nova.compute.manager [req-34e1cf55-f2b3-4264-9eaa-9c1ced230cfc req-08818ad8-c011-400d-9e41-b3590ec7c675 service nova] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Received unexpected event network-vif-plugged-4ed7b5c5-f0e9-4f41-9015-8f9e7a22643b for instance with vm_state deleted and task_state None.
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 -p 172.16.0.220:3260 --login" returned: 0 in 0.058s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fdc5ec8-a095-41a5-b824-1b48044e5801]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699, portal: 172.16.0.220,3260]
Jul 29 13:53:01 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699, portal: 172.16.0.220,3260] successful.
Jul 29 13:53:01 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca1731a7-fc90-4371-92e6-bf05a39662c1]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[571f6afb-a5a8-4cd7-b7a0-79b8e62e5a07]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:53:01 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:53:01 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:53:01 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:53:01 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:53:01 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:53:01 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.314s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] HCTL ('34', '-', '-', 0) found on session 43 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9c9d60-a0db-4b26-8352-90257e4ba255]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Searching for a device in session 43 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:53:01 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mcHrOkjh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:53:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.350s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:53:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '23436393863633834', 'path': '/dev/sdc'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:53:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23436393863633834', 'path': '/dev/sdc'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:53:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:52:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1545635091',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1545635091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1545635091',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYEyA/OCWVQKmYyb6Rhc6uucXQytbp/n4pNNQWQCFx6a6MxgYxsIgln3h+2tWrNEsj4k7xfNIjDNCY9pTqAVFiI3NzGPRdC+4iQbM3P/nk+/101jOiENF3D7vU4FM+hqw==',key_name='tempest-keypair-1776646106',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f45c92d3fe964066b9be87489b2c9f7e',ramdisk_id='',reservation_id='r-6n810j1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-434673895',owner_user_name='tempest-TestVolumeBootPattern-434673895-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:52:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d94a7ea0c19845b886e12c1689cf30a8',uuid=1c4a953b-67c9-4c69-950a-7487735e917c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da91541f-4471-455f-adf7-cfa9eb63de88", "address": "fa:16:3e:3d:fe:a2", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda91541f-44", "ovs_interfaceid": "da91541f-4471-455f-adf7-cfa9eb63de88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:53:02 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Converting VIF {"id": "da91541f-4471-455f-adf7-cfa9eb63de88", "address": "fa:16:3e:3d:fe:a2", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda91541f-44", "ovs_interfaceid": "da91541f-4471-455f-adf7-cfa9eb63de88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:53:02 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:fe:a2,bridge_name='br-int',has_traffic_filtering=True,id=da91541f-4471-455f-adf7-cfa9eb63de88,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda91541f-44') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:53:02 user nova-compute[231753]: DEBUG nova.objects.instance [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lazy-loading 'pci_devices' on Instance uuid 1c4a953b-67c9-4c69-950a-7487735e917c {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:53:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:53:02 user nova-compute[231753]:   <uuid>1c4a953b-67c9-4c69-950a-7487735e917c</uuid>
Jul 29 13:53:02 user nova-compute[231753]:   <name>instance-00000027</name>
Jul 29 13:53:02 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:53:02 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:53:02 user nova-compute[231753]:   <metadata>
Jul 29 13:53:02 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:53:02 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:53:02 user nova-compute[231753]:       <nova:name>tempest-TestVolumeBootPattern-volume-backed-server-1545635091</nova:name>
Jul 29 13:53:02 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:53:01</nova:creationTime>
Jul 29 13:53:02 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:53:02 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:53:02 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:53:02 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:53:02 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:53:02 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:53:02 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:53:02 user nova-compute[231753]:       <nova:owner>
Jul 29 13:53:02 user nova-compute[231753]:         <nova:user uuid="d94a7ea0c19845b886e12c1689cf30a8">tempest-TestVolumeBootPattern-434673895-project-member</nova:user>
Jul 29 13:53:02 user nova-compute[231753]:         <nova:project uuid="f45c92d3fe964066b9be87489b2c9f7e">tempest-TestVolumeBootPattern-434673895</nova:project>
Jul 29 13:53:02 user nova-compute[231753]:       </nova:owner>
Jul 29 13:53:02 user nova-compute[231753]:       <nova:ports>
Jul 29 13:53:02 user nova-compute[231753]:         <nova:port uuid="da91541f-4471-455f-adf7-cfa9eb63de88">
Jul 29 13:53:02 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.6" ipVersion="4"/>
Jul 29 13:53:02 user nova-compute[231753]:         </nova:port>
Jul 29 13:53:02 user nova-compute[231753]:       </nova:ports>
Jul 29 13:53:02 user nova-compute[231753]:     </nova:instance>
Jul 29 13:53:02 user nova-compute[231753]:   </metadata>
Jul 29 13:53:02 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:53:02 user nova-compute[231753]:     <system>
Jul 29 13:53:02 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:53:02 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:53:02 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:53:02 user nova-compute[231753]:       <entry name="serial">1c4a953b-67c9-4c69-950a-7487735e917c</entry>
Jul 29 13:53:02 user nova-compute[231753]:       <entry name="uuid">1c4a953b-67c9-4c69-950a-7487735e917c</entry>
Jul 29 13:53:02 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:53:02 user nova-compute[231753]:     </system>
Jul 29 13:53:02 user nova-compute[231753]:   </sysinfo>
Jul 29 13:53:02 user nova-compute[231753]:   <os>
Jul 29 13:53:02 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:53:02 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:53:02 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:53:02 user nova-compute[231753]:   </os>
Jul 29 13:53:02 user nova-compute[231753]:   <features>
Jul 29 13:53:02 user nova-compute[231753]:     <acpi/>
Jul 29 13:53:02 user nova-compute[231753]:     <apic/>
Jul 29 13:53:02 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:53:02 user nova-compute[231753]:   </features>
Jul 29 13:53:02 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:53:02 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:53:02 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:53:02 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:53:02 user nova-compute[231753]:   </clock>
Jul 29 13:53:02 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:53:02 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:53:02 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:53:02 user nova-compute[231753]:   </cpu>
Jul 29 13:53:02 user nova-compute[231753]:   <devices>
Jul 29 13:53:02 user nova-compute[231753]:     <disk type="block" device="disk">
Jul 29 13:53:02 user nova-compute[231753]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:53:02 user nova-compute[231753]:       <source dev="/dev/sdc"/>
Jul 29 13:53:02 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:53:02 user nova-compute[231753]:       <serial>a4fd52a0-187e-4105-9637-1cd908377699</serial>
Jul 29 13:53:02 user nova-compute[231753]:     </disk>
Jul 29 13:53:02 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:53:02 user nova-compute[231753]:       <mac address="fa:16:3e:3d:fe:a2"/>
Jul 29 13:53:02 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:53:02 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:53:02 user nova-compute[231753]:       <target dev="tapda91541f-44"/>
Jul 29 13:53:02 user nova-compute[231753]:     </interface>
Jul 29 13:53:02 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:53:02 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/1c4a953b-67c9-4c69-950a-7487735e917c/console.log" append="off"/>
Jul 29 13:53:02 user nova-compute[231753]:     </serial>
Jul 29 13:53:02 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:53:02 user nova-compute[231753]:     <video>
Jul 29 13:53:02 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:53:02 user nova-compute[231753]:     </video>
Jul 29 13:53:02 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:53:02 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:53:02 user nova-compute[231753]:     </rng>
Jul 29 13:53:02 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:53:02 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:53:02 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:53:02 user nova-compute[231753]:     </memballoon>
Jul 29 13:53:02 user nova-compute[231753]:   </devices>
Jul 29 13:53:02 user nova-compute[231753]: </domain>
Jul 29 13:53:02 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:53:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:52:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1545635091',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1545635091',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1545635091',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYEyA/OCWVQKmYyb6Rhc6uucXQytbp/n4pNNQWQCFx6a6MxgYxsIgln3h+2tWrNEsj4k7xfNIjDNCY9pTqAVFiI3NzGPRdC+4iQbM3P/nk+/101jOiENF3D7vU4FM+hqw==',key_name='tempest-keypair-1776646106',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f45c92d3fe964066b9be87489b2c9f7e',ramdisk_id='',reservation_id='r-6n810j1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-434673895',owner_user_name='tempest-TestVolumeBootPattern-434673895-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:52:53Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d94a7ea0c19845b886e12c1689cf30a8',uuid=1c4a953b-67c9-4c69-950a-7487735e917c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "da91541f-4471-455f-adf7-cfa9eb63de88", "address": "fa:16:3e:3d:fe:a2", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda91541f-44", "ovs_interfaceid": "da91541f-4471-455f-adf7-cfa9eb63de88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:53:02 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Converting VIF {"id": "da91541f-4471-455f-adf7-cfa9eb63de88", "address": "fa:16:3e:3d:fe:a2", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda91541f-44", "ovs_interfaceid": "da91541f-4471-455f-adf7-cfa9eb63de88", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:53:02 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3d:fe:a2,bridge_name='br-int',has_traffic_filtering=True,id=da91541f-4471-455f-adf7-cfa9eb63de88,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda91541f-44') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:53:02 user nova-compute[231753]: DEBUG os_vif [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:fe:a2,bridge_name='br-int',has_traffic_filtering=True,id=da91541f-4471-455f-adf7-cfa9eb63de88,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda91541f-44') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:53:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:53:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:53:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapda91541f-44, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:53:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapda91541f-44, col_values=(('external_ids', {'iface-id': 'da91541f-4471-455f-adf7-cfa9eb63de88', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3d:fe:a2', 'vm-uuid': '1c4a953b-67c9-4c69-950a-7487735e917c'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:53:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:53:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:02 user nova-compute[231753]: INFO os_vif [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3d:fe:a2,bridge_name='br-int',has_traffic_filtering=True,id=da91541f-4471-455f-adf7-cfa9eb63de88,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda91541f-44')
Jul 29 13:53:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:53:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] No VIF found with MAC fa:16:3e:3d:fe:a2, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:53:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:04 user nova-compute[231753]: DEBUG nova.compute.manager [req-798ac4b2-34d8-4dc1-a47e-682693b074d8 req-0977d158-fa6a-44c6-84e4-4e93c94538b4 service nova] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Received event network-vif-plugged-da91541f-4471-455f-adf7-cfa9eb63de88 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:53:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-798ac4b2-34d8-4dc1-a47e-682693b074d8 req-0977d158-fa6a-44c6-84e4-4e93c94538b4 service nova] Acquiring lock "1c4a953b-67c9-4c69-950a-7487735e917c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:53:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-798ac4b2-34d8-4dc1-a47e-682693b074d8 req-0977d158-fa6a-44c6-84e4-4e93c94538b4 service nova] Lock "1c4a953b-67c9-4c69-950a-7487735e917c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:53:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-798ac4b2-34d8-4dc1-a47e-682693b074d8 req-0977d158-fa6a-44c6-84e4-4e93c94538b4 service nova] Lock "1c4a953b-67c9-4c69-950a-7487735e917c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:53:04 user nova-compute[231753]: DEBUG nova.compute.manager [req-798ac4b2-34d8-4dc1-a47e-682693b074d8 req-0977d158-fa6a-44c6-84e4-4e93c94538b4 service nova] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] No waiting events found dispatching network-vif-plugged-da91541f-4471-455f-adf7-cfa9eb63de88 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:53:04 user nova-compute[231753]: WARNING nova.compute.manager [req-798ac4b2-34d8-4dc1-a47e-682693b074d8 req-0977d158-fa6a-44c6-84e4-4e93c94538b4 service nova] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Received unexpected event network-vif-plugged-da91541f-4471-455f-adf7-cfa9eb63de88 for instance with vm_state building and task_state spawning.
Jul 29 13:53:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638786.0044186, 1c4a953b-67c9-4c69-950a-7487735e917c => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:53:06 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] VM Resumed (Lifecycle Event)
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.compute.manager [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:53:06 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Instance spawned successfully.
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:53:06 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638786.0054822, 1c4a953b-67c9-4c69-950a-7487735e917c => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:53:06 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] VM Started (Lifecycle Event)
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:53:06 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Creating image(s)
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Did not create local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Ensure instance console log exists: /opt/stack/data/nova/instances/a3f9ad53-db31-404a-8442-37cf53f11cbc/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Start _get_guest_xml network_info=[{"id": "b6be4498-da79-4335-9f95-6a191a4ce127", "address": "fa:16:3e:c2:b5:20", "network": {"id": "e36e72a2-fbed-483c-827c-436fa6786390", "bridge": "br-int", "label": "tempest-TestShelveInstance-2100930356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b552c0991c456eb101472ca6777f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6be4498-da", "ovs_interfaceid": "b6be4498-da79-4335-9f95-6a191a4ce127", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZYvkJSh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a3f9ad53-db31-404a-8442-37cf53f11cbc', 'attached_at': '', 'detached_at': '', 'volume_id': '3be506b8-85e1-474c-8c6b-6f8ef82b95bf', 'serial': '3be506b8-85e1-474c-8c6b-6f8ef82b95bf'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'attachment_id': '4e4c9c8f-967d-4ead-9c5e-6b0a8a5f7773', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:53:06 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:53:06 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:53:06 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZYvkJSh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:53:06 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:53:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:53:06 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:53:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:53:06 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:53:06 user nova-compute[231753]: INFO nova.compute.manager [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Took 5.17 seconds to spawn the instance on the hypervisor.
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.compute.manager [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260" returned: 21 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[95473eb7-eeb6-48ed-84b5-04e9abbb745a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:53:06 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.compute.manager [req-6c070c98-c249-47e7-b0ef-d1ce3655adab req-069322af-daf7-4932-be32-231b9ad653bc service nova] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Received event network-vif-plugged-da91541f-4471-455f-adf7-cfa9eb63de88 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6c070c98-c249-47e7-b0ef-d1ce3655adab req-069322af-daf7-4932-be32-231b9ad653bc service nova] Acquiring lock "1c4a953b-67c9-4c69-950a-7487735e917c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6c070c98-c249-47e7-b0ef-d1ce3655adab req-069322af-daf7-4932-be32-231b9ad653bc service nova] Lock "1c4a953b-67c9-4c69-950a-7487735e917c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6c070c98-c249-47e7-b0ef-d1ce3655adab req-069322af-daf7-4932-be32-231b9ad653bc service nova] Lock "1c4a953b-67c9-4c69-950a-7487735e917c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG nova.compute.manager [req-6c070c98-c249-47e7-b0ef-d1ce3655adab req-069322af-daf7-4932-be32-231b9ad653bc service nova] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] No waiting events found dispatching network-vif-plugged-da91541f-4471-455f-adf7-cfa9eb63de88 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:53:06 user nova-compute[231753]: WARNING nova.compute.manager [req-6c070c98-c249-47e7-b0ef-d1ce3655adab req-069322af-daf7-4932-be32-231b9ad653bc service nova] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Received unexpected event network-vif-plugged-da91541f-4471-455f-adf7-cfa9eb63de88 for instance with vm_state building and task_state spawning.
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d95f9804-46e5-484d-813e-cc1607e8a9ca]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf] added
Jul 29 13:53:06 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[01958cff-3b81-4164-8e25-3de53ff96b8f]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9856e83a-7c5f-4cb2-993a-01dd148d11fd]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BZYvkJSh {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BZYvkJSh" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dc904b1-3ecb-4b13-b512-8557c6d6cb7d]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BZYvkJSh'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:06 user nova-compute[231753]: INFO nova.compute.manager [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Took 13.93 seconds to build instance.
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[288ae74d-29a0-41e6-996e-169be6c8430b]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6d71e691-3139-418e-b2a7-0f32aaa74fa4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "1c4a953b-67c9-4c69-950a-7487735e917c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 14.033s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[56e87e41-cb23-4593-8c7c-a563c9146775]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:53:06 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:53:06 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:53:06 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:53:06 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:53:06 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:53:06 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7becf6d-9029-4a3b-9ee8-e391daebb86b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf, portal: 172.16.0.220,3260]
Jul 29 13:53:06 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf, portal: 172.16.0.220,3260] successful.
Jul 29 13:53:06 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c64563-92cf-4d7e-8240-506f896db3da]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e26f621-5af0-44d1-86de-1bc1d2477f27]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:53:06 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:53:06 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:53:06 user nova-compute[231753]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)
Jul 29 13:53:06 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:53:06 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:53:06 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:53:06 user nova-compute[231753]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)
Jul 29 13:53:06 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] HCTL ('36', '-', '-', 0) found on session 44 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[233f63a1-9dd4-47ce-8dec-26aa64db2c1b]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Searching for a device in session 44 and hctl ['36', '*', '*', 0] yield: sde {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:53:06 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZYvkJSh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:53:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.337s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:53:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] <== connect_volume: return (1338ms) {'type': 'block', 'scsi_wwn': '26263613832393537', 'path': '/dev/sde'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:53:07 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263613832393537', 'path': '/dev/sde'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:53:07 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:52:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2135603216',display_name='tempest-TestShelveInstance-server-2135603216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2135603216',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUKilSQcjDTu+cgwtmk8BQ6EjoQq0ApEPABTW7D4u0KoVMoLIZVjeebdmok5ki73AVOSz5g4howD++ogO973qWj4XNZQyc+wqIw+w41ZPmWJLZZo3ziBpQVpEeJBldBeA==',key_name='tempest-TestShelveInstance-537474645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06b552c0991c456eb101472ca6777f19',ramdisk_id='',reservation_id='r-g6l31lk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-108803446',owner_user_name='tempest-TestShelveInstance-108803446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:52:55Z,user_data=None,user_id='3d35af1d300041a2b0fd8039d1a4b623',uuid=a3f9ad53-db31-404a-8442-37cf53f11cbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6be4498-da79-4335-9f95-6a191a4ce127", "address": "fa:16:3e:c2:b5:20", "network": {"id": "e36e72a2-fbed-483c-827c-436fa6786390", "bridge": "br-int", "label": "tempest-TestShelveInstance-2100930356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b552c0991c456eb101472ca6777f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6be4498-da", "ovs_interfaceid": "b6be4498-da79-4335-9f95-6a191a4ce127", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:53:07 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Converting VIF {"id": "b6be4498-da79-4335-9f95-6a191a4ce127", "address": "fa:16:3e:c2:b5:20", "network": {"id": "e36e72a2-fbed-483c-827c-436fa6786390", "bridge": "br-int", "label": "tempest-TestShelveInstance-2100930356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b552c0991c456eb101472ca6777f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6be4498-da", "ovs_interfaceid": "b6be4498-da79-4335-9f95-6a191a4ce127", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:53:07 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:b5:20,bridge_name='br-int',has_traffic_filtering=True,id=b6be4498-da79-4335-9f95-6a191a4ce127,network=Network(e36e72a2-fbed-483c-827c-436fa6786390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6be4498-da') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:53:07 user nova-compute[231753]: DEBUG nova.objects.instance [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lazy-loading 'pci_devices' on Instance uuid a3f9ad53-db31-404a-8442-37cf53f11cbc {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:53:07 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:53:07 user nova-compute[231753]:   <uuid>a3f9ad53-db31-404a-8442-37cf53f11cbc</uuid>
Jul 29 13:53:07 user nova-compute[231753]:   <name>instance-00000028</name>
Jul 29 13:53:07 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:53:07 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:53:07 user nova-compute[231753]:   <metadata>
Jul 29 13:53:07 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:53:07 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:53:07 user nova-compute[231753]:       <nova:name>tempest-TestShelveInstance-server-2135603216</nova:name>
Jul 29 13:53:07 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:53:06</nova:creationTime>
Jul 29 13:53:07 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:53:07 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:53:07 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:53:07 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:53:07 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:53:07 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:53:07 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:53:07 user nova-compute[231753]:       <nova:owner>
Jul 29 13:53:07 user nova-compute[231753]:         <nova:user uuid="3d35af1d300041a2b0fd8039d1a4b623">tempest-TestShelveInstance-108803446-project-member</nova:user>
Jul 29 13:53:07 user nova-compute[231753]:         <nova:project uuid="06b552c0991c456eb101472ca6777f19">tempest-TestShelveInstance-108803446</nova:project>
Jul 29 13:53:07 user nova-compute[231753]:       </nova:owner>
Jul 29 13:53:07 user nova-compute[231753]:       <nova:ports>
Jul 29 13:53:07 user nova-compute[231753]:         <nova:port uuid="b6be4498-da79-4335-9f95-6a191a4ce127">
Jul 29 13:53:07 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 29 13:53:07 user nova-compute[231753]:         </nova:port>
Jul 29 13:53:07 user nova-compute[231753]:       </nova:ports>
Jul 29 13:53:07 user nova-compute[231753]:     </nova:instance>
Jul 29 13:53:07 user nova-compute[231753]:   </metadata>
Jul 29 13:53:07 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:53:07 user nova-compute[231753]:     <system>
Jul 29 13:53:07 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:53:07 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:53:07 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:53:07 user nova-compute[231753]:       <entry name="serial">a3f9ad53-db31-404a-8442-37cf53f11cbc</entry>
Jul 29 13:53:07 user nova-compute[231753]:       <entry name="uuid">a3f9ad53-db31-404a-8442-37cf53f11cbc</entry>
Jul 29 13:53:07 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:53:07 user nova-compute[231753]:     </system>
Jul 29 13:53:07 user nova-compute[231753]:   </sysinfo>
Jul 29 13:53:07 user nova-compute[231753]:   <os>
Jul 29 13:53:07 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:53:07 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:53:07 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:53:07 user nova-compute[231753]:   </os>
Jul 29 13:53:07 user nova-compute[231753]:   <features>
Jul 29 13:53:07 user nova-compute[231753]:     <acpi/>
Jul 29 13:53:07 user nova-compute[231753]:     <apic/>
Jul 29 13:53:07 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:53:07 user nova-compute[231753]:   </features>
Jul 29 13:53:07 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:53:07 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:53:07 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:53:07 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:53:07 user nova-compute[231753]:   </clock>
Jul 29 13:53:07 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:53:07 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:53:07 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:53:07 user nova-compute[231753]:   </cpu>
Jul 29 13:53:07 user nova-compute[231753]:   <devices>
Jul 29 13:53:07 user nova-compute[231753]:     <disk type="block" device="disk">
Jul 29 13:53:07 user nova-compute[231753]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:53:07 user nova-compute[231753]:       <source dev="/dev/sde"/>
Jul 29 13:53:07 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:53:07 user nova-compute[231753]:       <serial>3be506b8-85e1-474c-8c6b-6f8ef82b95bf</serial>
Jul 29 13:53:07 user nova-compute[231753]:     </disk>
Jul 29 13:53:07 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:53:07 user nova-compute[231753]:       <mac address="fa:16:3e:c2:b5:20"/>
Jul 29 13:53:07 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:53:07 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:53:07 user nova-compute[231753]:       <target dev="tapb6be4498-da"/>
Jul 29 13:53:07 user nova-compute[231753]:     </interface>
Jul 29 13:53:07 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:53:07 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/a3f9ad53-db31-404a-8442-37cf53f11cbc/console.log" append="off"/>
Jul 29 13:53:07 user nova-compute[231753]:     </serial>
Jul 29 13:53:07 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:53:07 user nova-compute[231753]:     <video>
Jul 29 13:53:07 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:53:07 user nova-compute[231753]:     </video>
Jul 29 13:53:07 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:53:07 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:53:07 user nova-compute[231753]:     </rng>
Jul 29 13:53:07 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:53:07 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:53:07 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:53:07 user nova-compute[231753]:     </memballoon>
Jul 29 13:53:07 user nova-compute[231753]:   </devices>
Jul 29 13:53:07 user nova-compute[231753]: </domain>
Jul 29 13:53:07 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:53:07 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:52:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2135603216',display_name='tempest-TestShelveInstance-server-2135603216',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2135603216',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUKilSQcjDTu+cgwtmk8BQ6EjoQq0ApEPABTW7D4u0KoVMoLIZVjeebdmok5ki73AVOSz5g4howD++ogO973qWj4XNZQyc+wqIw+w41ZPmWJLZZo3ziBpQVpEeJBldBeA==',key_name='tempest-TestShelveInstance-537474645',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='06b552c0991c456eb101472ca6777f19',ramdisk_id='',reservation_id='r-g6l31lk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestShelveInstance-108803446',owner_user_name='tempest-TestShelveInstance-108803446-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:52:55Z,user_data=None,user_id='3d35af1d300041a2b0fd8039d1a4b623',uuid=a3f9ad53-db31-404a-8442-37cf53f11cbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6be4498-da79-4335-9f95-6a191a4ce127", "address": "fa:16:3e:c2:b5:20", "network": {"id": "e36e72a2-fbed-483c-827c-436fa6786390", "bridge": "br-int", "label": "tempest-TestShelveInstance-2100930356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b552c0991c456eb101472ca6777f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6be4498-da", "ovs_interfaceid": "b6be4498-da79-4335-9f95-6a191a4ce127", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:53:07 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Converting VIF {"id": "b6be4498-da79-4335-9f95-6a191a4ce127", "address": "fa:16:3e:c2:b5:20", "network": {"id": "e36e72a2-fbed-483c-827c-436fa6786390", "bridge": "br-int", "label": "tempest-TestShelveInstance-2100930356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b552c0991c456eb101472ca6777f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6be4498-da", "ovs_interfaceid": "b6be4498-da79-4335-9f95-6a191a4ce127", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:53:07 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:b5:20,bridge_name='br-int',has_traffic_filtering=True,id=b6be4498-da79-4335-9f95-6a191a4ce127,network=Network(e36e72a2-fbed-483c-827c-436fa6786390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6be4498-da') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:53:07 user nova-compute[231753]: DEBUG os_vif [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:b5:20,bridge_name='br-int',has_traffic_filtering=True,id=b6be4498-da79-4335-9f95-6a191a4ce127,network=Network(e36e72a2-fbed-483c-827c-436fa6786390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6be4498-da') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:53:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:53:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:53:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6be4498-da, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:53:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb6be4498-da, col_values=(('external_ids', {'iface-id': 'b6be4498-da79-4335-9f95-6a191a4ce127', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:b5:20', 'vm-uuid': 'a3f9ad53-db31-404a-8442-37cf53f11cbc'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:53:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:53:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:07 user nova-compute[231753]: INFO os_vif [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:b5:20,bridge_name='br-int',has_traffic_filtering=True,id=b6be4498-da79-4335-9f95-6a191a4ce127,network=Network(e36e72a2-fbed-483c-827c-436fa6786390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6be4498-da')
Jul 29 13:53:07 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:53:07 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] No VIF found with MAC fa:16:3e:c2:b5:20, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:53:08 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:08 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:09 user nova-compute[231753]: DEBUG nova.compute.manager [req-7e2799d6-59f4-4818-b5ed-854b8c56d73a req-0369d950-75cb-4ce4-b4ed-9f17596ab8b2 service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Received event network-vif-plugged-b6be4498-da79-4335-9f95-6a191a4ce127 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:53:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7e2799d6-59f4-4818-b5ed-854b8c56d73a req-0369d950-75cb-4ce4-b4ed-9f17596ab8b2 service nova] Acquiring lock "a3f9ad53-db31-404a-8442-37cf53f11cbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:53:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7e2799d6-59f4-4818-b5ed-854b8c56d73a req-0369d950-75cb-4ce4-b4ed-9f17596ab8b2 service nova] Lock "a3f9ad53-db31-404a-8442-37cf53f11cbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:53:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-7e2799d6-59f4-4818-b5ed-854b8c56d73a req-0369d950-75cb-4ce4-b4ed-9f17596ab8b2 service nova] Lock "a3f9ad53-db31-404a-8442-37cf53f11cbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:53:09 user nova-compute[231753]: DEBUG nova.compute.manager [req-7e2799d6-59f4-4818-b5ed-854b8c56d73a req-0369d950-75cb-4ce4-b4ed-9f17596ab8b2 service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] No waiting events found dispatching network-vif-plugged-b6be4498-da79-4335-9f95-6a191a4ce127 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:53:09 user nova-compute[231753]: WARNING nova.compute.manager [req-7e2799d6-59f4-4818-b5ed-854b8c56d73a req-0369d950-75cb-4ce4-b4ed-9f17596ab8b2 service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Received unexpected event network-vif-plugged-b6be4498-da79-4335-9f95-6a191a4ce127 for instance with vm_state building and task_state spawning.
Jul 29 13:53:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:11 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638791.212, a3f9ad53-db31-404a-8442-37cf53f11cbc => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:53:11 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] VM Resumed (Lifecycle Event)
Jul 29 13:53:11 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:53:11 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:53:11 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Instance spawned successfully.
Jul 29 13:53:11 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:53:11 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:53:11 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:53:11 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:53:11 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:53:11 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:53:11 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:53:11 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:53:11 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:53:11 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:53:11 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638791.2160606, a3f9ad53-db31-404a-8442-37cf53f11cbc => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:53:11 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] VM Started (Lifecycle Event)
Jul 29 13:53:11 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:53:11 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:53:11 user nova-compute[231753]: DEBUG nova.compute.manager [req-a57454b3-494c-41b6-8229-c5269ceede07 req-473a5958-b913-4e72-a00b-7c8bf81ab895 service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Received event network-vif-plugged-b6be4498-da79-4335-9f95-6a191a4ce127 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:53:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a57454b3-494c-41b6-8229-c5269ceede07 req-473a5958-b913-4e72-a00b-7c8bf81ab895 service nova] Acquiring lock "a3f9ad53-db31-404a-8442-37cf53f11cbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:53:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a57454b3-494c-41b6-8229-c5269ceede07 req-473a5958-b913-4e72-a00b-7c8bf81ab895 service nova] Lock "a3f9ad53-db31-404a-8442-37cf53f11cbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:53:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a57454b3-494c-41b6-8229-c5269ceede07 req-473a5958-b913-4e72-a00b-7c8bf81ab895 service nova] Lock "a3f9ad53-db31-404a-8442-37cf53f11cbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:53:11 user nova-compute[231753]: DEBUG nova.compute.manager [req-a57454b3-494c-41b6-8229-c5269ceede07 req-473a5958-b913-4e72-a00b-7c8bf81ab895 service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] No waiting events found dispatching network-vif-plugged-b6be4498-da79-4335-9f95-6a191a4ce127 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:53:11 user nova-compute[231753]: WARNING nova.compute.manager [req-a57454b3-494c-41b6-8229-c5269ceede07 req-473a5958-b913-4e72-a00b-7c8bf81ab895 service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Received unexpected event network-vif-plugged-b6be4498-da79-4335-9f95-6a191a4ce127 for instance with vm_state building and task_state spawning.
Jul 29 13:53:11 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:53:11 user nova-compute[231753]: INFO nova.compute.manager [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Took 5.24 seconds to spawn the instance on the hypervisor.
Jul 29 13:53:11 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:53:11 user nova-compute[231753]: INFO nova.compute.manager [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Took 17.34 seconds to build instance.
Jul 29 13:53:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ac7dcbb6-7ca4-487f-8ff9-b3aa6a483147 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lock "a3f9ad53-db31-404a-8442-37cf53f11cbc" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 17.448s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:53:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "97e71bc1-78c8-4cec-a935-878dd08ff941" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:53:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "97e71bc1-78c8-4cec-a935-878dd08ff941" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:53:11 user nova-compute[231753]: DEBUG nova.objects.instance [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lazy-loading 'flavor' on Instance uuid 97e71bc1-78c8-4cec-a935-878dd08ff941 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:53:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "97e71bc1-78c8-4cec-a935-878dd08ff941" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.049s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:53:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "97e71bc1-78c8-4cec-a935-878dd08ff941" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:53:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "97e71bc1-78c8-4cec-a935-878dd08ff941" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:53:12 user nova-compute[231753]: INFO nova.compute.manager [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Attaching volume e29e73e8-aad2-4b4d-903d-761c32b8b271 to /dev/vdb
Jul 29 13:53:12 user nova-compute[231753]: DEBUG os_brick.utils [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:53:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:12 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6635709-fc60-4c21-b54f-d3cf5d554767]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:12 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f58727d7-c3fd-4671-afcc-a3d10d0c9e8b]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:12 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6cdf6ae-224f-44ab-bbe8-e154598bd93e]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:12 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[261f89cc-6149-4174-866e-0bdcab6f35c5]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:53:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:53:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:53:12 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:53:12 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ada4f8cd-01ba-49f9-a99a-00afb11ca896]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:53:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:53:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:53:12 user nova-compute[231753]: DEBUG os_brick.utils [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] <== get_connector_properties: return (139ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:53:12 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Updating existing volume attachment record: 41ab95b0-be8e-4238-aef1-b59bb31e9fc6 {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:53:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:14 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690638779.7274153, 8ea52d41-7ec3-44d7-8421-133000ee887b => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:53:14 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] VM Stopped (Lifecycle Event)
Jul 29 13:53:14 user nova-compute[231753]: DEBUG nova.compute.manager [None req-2e9b1075-aff0-486b-a74a-2c20030fa9a9 None None] [instance: 8ea52d41-7ec3-44d7-8421-133000ee887b] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:53:15 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:53:15 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:53:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:53:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:53:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:53:15 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 13:53:15 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:53:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965/disk.rescue --force-share --output=json" returned: 0 in 0.143s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965/disk.rescue --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965/disk.rescue --force-share --output=json" returned: 0 in 0.139s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:53:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:53:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json" returned: 0 in 0.199s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e153c4d-75b5-4507-aac7-21620479209b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e153c4d-75b5-4507-aac7-21620479209b/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e153c4d-75b5-4507-aac7-21620479209b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e153c4d-75b5-4507-aac7-21620479209b/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e71bc1-78c8-4cec-a935-878dd08ff941/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e71bc1-78c8-4cec-a935-878dd08ff941/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e71bc1-78c8-4cec-a935-878dd08ff941/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e71bc1-78c8-4cec-a935-878dd08ff941/disk --force-share --output=json" returned: 0 in 0.153s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:53:17 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:18 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:53:18 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:53:18 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=7614MB free_disk=24.90114974975586GB free_vcpus=3 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 13:53:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:53:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:53:18 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 7e2615c1-b03e-4076-bcd9-3585fb11b8ac actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:53:18 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance cf326e80-7293-4764-9411-ed05a5aeba23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:53:18 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b99a72ba-73e2-4be7-b52b-7797351daa5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:53:18 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b6be450b-ebe7-4385-b162-2d072237aa97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:53:18 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:53:18 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 97e71bc1-78c8-4cec-a935-878dd08ff941 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:53:18 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8e153c4d-75b5-4507-aac7-21620479209b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:53:18 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 1c4a953b-67c9-4c69-950a-7487735e917c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:53:18 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance a3f9ad53-db31-404a-8442-37cf53f11cbc actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:53:18 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 9 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 13:53:18 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=5120MB phys_disk=40GB used_disk=5GB total_vcpus=12 used_vcpus=9 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 13:53:18 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:53:18 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:53:18 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 13:53:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.414s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'przmwxba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:53:20 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:53:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:53:20 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:53:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.006s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:53:20 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:53:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0785267-92c0-4297-ab19-ebf3aca150ad]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:53:20 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ee5268-557c-4068-ad30-9fb34b2b2e47]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271] added
Jul 29 13:53:20 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ce73e1-3e26-416d-893b-66dd5fa08961]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[316511ff-db1f-4ecd-9ea3-cd4870fa55c9]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v przmwxba {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v przmwxba" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a1964d8-01ec-4beb-9e2e-85b44844e92c]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'przmwxba'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60fb68f-da7a-4f6d-b4f8-23093cae2da8]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbfc9efb-baad-4953-afe6-cdcb255631de]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:53:20 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:53:20 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:53:20 user nova-compute[231753]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)
Jul 29 13:53:20 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:53:20 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:53:20 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:53:20 user nova-compute[231753]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)
Jul 29 13:53:20 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 -p 172.16.0.220:3260 --login" returned: 0 in 0.074s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e941023d-58d3-4cc2-a91a-57dbefa54b4d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271, portal: 172.16.0.220,3260]
Jul 29 13:53:20 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271, portal: 172.16.0.220,3260] successful.
Jul 29 13:53:20 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[21a95534-bf14-47ed-bd60-29a8a1545544]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[acff8e1d-7bc0-4feb-aa71-d3de0d4f96a1]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:53:20 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:53:20 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:53:20 user nova-compute[231753]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)
Jul 29 13:53:20 user nova-compute[231753]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 (non-flash)
Jul 29 13:53:20 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:53:20 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:53:20 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:53:20 user nova-compute[231753]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)
Jul 29 13:53:20 user nova-compute[231753]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 (non-flash)
Jul 29 13:53:20 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.307s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] HCTL ('37', '-', '-', 0) found on session 45 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Scanning host 37 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host37/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host37/scan" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[11c46883-6a64-40b1-9bae-4801d6620891]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Searching for a device in session 45 and hctl ['37', '*', '*', 0] yield: sdf {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:53:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Connected to sdf using {'target_iqn': 'iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'przmwxba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:53:21 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.357s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:53:21 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] <== connect_volume: return (1359ms) {'type': 'block', 'scsi_wwn': '23334653434646337', 'path': '/dev/sdf'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:53:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334653434646337', 'path': '/dev/sdf'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:53:21 user nova-compute[231753]: DEBUG nova.objects.instance [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lazy-loading 'flavor' on Instance uuid 97e71bc1-78c8-4cec-a935-878dd08ff941 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:53:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 13:53:21 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:53:21 user nova-compute[231753]:   <source dev="/dev/sdf"/>
Jul 29 13:53:21 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:53:21 user nova-compute[231753]:   <serial>e29e73e8-aad2-4b4d-903d-761c32b8b271</serial>
Jul 29 13:53:21 user nova-compute[231753]: </disk>
Jul 29 13:53:21 user nova-compute[231753]:  {{(pid=231753) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 13:53:21 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:53:21 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 13:53:21 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Rebuilding the list of instances to heal {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 13:53:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "refresh_cache-7e2615c1-b03e-4076-bcd9-3585fb11b8ac" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:53:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquired lock "refresh_cache-7e2615c1-b03e-4076-bcd9-3585fb11b8ac" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:53:21 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Forcefully refreshing network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 13:53:21 user nova-compute[231753]: DEBUG nova.objects.instance [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lazy-loading 'info_cache' on Instance uuid 7e2615c1-b03e-4076-bcd9-3585fb11b8ac {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:53:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:53:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] No BDM found with device name vdb, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:53:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] No VIF found with MAC fa:16:3e:30:50:53, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:53:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-1b09c6f5-f022-47bc-8bfd-0fefab8321ab tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "97e71bc1-78c8-4cec-a935-878dd08ff941" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.980s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:53:22 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Updating instance_info_cache with network_info: [{"id": "8c8e51fe-0d15-4a27-8215-dc512b6816f5", "address": "fa:16:3e:3e:10:27", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e51fe-0d", "ovs_interfaceid": "8c8e51fe-0d15-4a27-8215-dc512b6816f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:53:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Releasing lock "refresh_cache-7e2615c1-b03e-4076-bcd9-3585fb11b8ac" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:53:22 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Updated the network info_cache for instance {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 13:53:22 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:53:22 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:53:22 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:53:22 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:53:22 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 13:53:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:53:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=231753) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 13:53:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 13:53:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 13:53:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:23 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:53:23 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:53:23 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:53:23 user nova-compute[231753]: INFO nova.compute.manager [None req-fc412e94-41d8-4984-bcd9-209c2f868275 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Unrescuing
Jul 29 13:53:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-fc412e94-41d8-4984-bcd9-209c2f868275 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "refresh_cache-ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:53:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-fc412e94-41d8-4984-bcd9-209c2f868275 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquired lock "refresh_cache-ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:53:23 user nova-compute[231753]: DEBUG nova.network.neutron [None req-fc412e94-41d8-4984-bcd9-209c2f868275 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:53:24 user nova-compute[231753]: DEBUG nova.network.neutron [None req-fc412e94-41d8-4984-bcd9-209c2f868275 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Updating instance_info_cache with network_info: [{"id": "dba460c1-334b-4686-b6a3-7d85632d294d", "address": "fa:16:3e:15:f4:85", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba460c1-33", "ovs_interfaceid": "dba460c1-334b-4686-b6a3-7d85632d294d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:53:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-fc412e94-41d8-4984-bcd9-209c2f868275 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Releasing lock "refresh_cache-ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:53:24 user nova-compute[231753]: DEBUG nova.objects.instance [None req-fc412e94-41d8-4984-bcd9-209c2f868275 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lazy-loading 'flavor' on Instance uuid ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:53:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:24 user nova-compute[231753]: DEBUG nova.compute.manager [req-4988851c-0c4f-4543-9d02-f9cde39f9ebb req-691a41aa-c498-4fe0-ab1e-e3828a87d8a0 service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Received event network-vif-unplugged-dba460c1-334b-4686-b6a3-7d85632d294d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:53:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4988851c-0c4f-4543-9d02-f9cde39f9ebb req-691a41aa-c498-4fe0-ab1e-e3828a87d8a0 service nova] Acquiring lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:53:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4988851c-0c4f-4543-9d02-f9cde39f9ebb req-691a41aa-c498-4fe0-ab1e-e3828a87d8a0 service nova] Lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:53:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4988851c-0c4f-4543-9d02-f9cde39f9ebb req-691a41aa-c498-4fe0-ab1e-e3828a87d8a0 service nova] Lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:53:24 user nova-compute[231753]: DEBUG nova.compute.manager [req-4988851c-0c4f-4543-9d02-f9cde39f9ebb req-691a41aa-c498-4fe0-ab1e-e3828a87d8a0 service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] No waiting events found dispatching network-vif-unplugged-dba460c1-334b-4686-b6a3-7d85632d294d {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:53:24 user nova-compute[231753]: WARNING nova.compute.manager [req-4988851c-0c4f-4543-9d02-f9cde39f9ebb req-691a41aa-c498-4fe0-ab1e-e3828a87d8a0 service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Received unexpected event network-vif-unplugged-dba460c1-334b-4686-b6a3-7d85632d294d for instance with vm_state rescued and task_state unrescuing.
Jul 29 13:53:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:25 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Instance destroyed successfully.
Jul 29 13:53:25 user nova-compute[231753]: DEBUG nova.compute.manager [req-b2a717d9-0c82-46e9-a24a-3f08243af7bf req-5d82fb69-9521-4970-a67b-a5ce3a236c11 service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Received event network-changed-75a46a16-882f-4bf9-96bf-a6874ecfbcc1 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:53:25 user nova-compute[231753]: DEBUG nova.compute.manager [req-b2a717d9-0c82-46e9-a24a-3f08243af7bf req-5d82fb69-9521-4970-a67b-a5ce3a236c11 service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Refreshing instance network info cache due to event network-changed-75a46a16-882f-4bf9-96bf-a6874ecfbcc1. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:53:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b2a717d9-0c82-46e9-a24a-3f08243af7bf req-5d82fb69-9521-4970-a67b-a5ce3a236c11 service nova] Acquiring lock "refresh_cache-97e71bc1-78c8-4cec-a935-878dd08ff941" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:53:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b2a717d9-0c82-46e9-a24a-3f08243af7bf req-5d82fb69-9521-4970-a67b-a5ce3a236c11 service nova] Acquired lock "refresh_cache-97e71bc1-78c8-4cec-a935-878dd08ff941" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:53:25 user nova-compute[231753]: DEBUG nova.network.neutron [req-b2a717d9-0c82-46e9-a24a-3f08243af7bf req-5d82fb69-9521-4970-a67b-a5ce3a236c11 service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Refreshing network info cache for port 75a46a16-882f-4bf9-96bf-a6874ecfbcc1 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:53:26 user nova-compute[231753]: DEBUG nova.network.neutron [req-b2a717d9-0c82-46e9-a24a-3f08243af7bf req-5d82fb69-9521-4970-a67b-a5ce3a236c11 service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Updated VIF entry in instance network info cache for port 75a46a16-882f-4bf9-96bf-a6874ecfbcc1. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:53:26 user nova-compute[231753]: DEBUG nova.network.neutron [req-b2a717d9-0c82-46e9-a24a-3f08243af7bf req-5d82fb69-9521-4970-a67b-a5ce3a236c11 service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Updating instance_info_cache with network_info: [{"id": "75a46a16-882f-4bf9-96bf-a6874ecfbcc1", "address": "fa:16:3e:30:50:53", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a46a16-88", "ovs_interfaceid": "75a46a16-882f-4bf9-96bf-a6874ecfbcc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:53:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b2a717d9-0c82-46e9-a24a-3f08243af7bf req-5d82fb69-9521-4970-a67b-a5ce3a236c11 service nova] Releasing lock "refresh_cache-97e71bc1-78c8-4cec-a935-878dd08ff941" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:53:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:26 user nova-compute[231753]: DEBUG nova.compute.manager [req-e6186f38-8f82-452b-bb5c-9e89ef4f198a req-02091607-b2a7-4c88-aac5-a3529ec0cf4b service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Received event network-vif-plugged-dba460c1-334b-4686-b6a3-7d85632d294d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:53:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e6186f38-8f82-452b-bb5c-9e89ef4f198a req-02091607-b2a7-4c88-aac5-a3529ec0cf4b service nova] Acquiring lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:53:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e6186f38-8f82-452b-bb5c-9e89ef4f198a req-02091607-b2a7-4c88-aac5-a3529ec0cf4b service nova] Lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.003s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:53:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e6186f38-8f82-452b-bb5c-9e89ef4f198a req-02091607-b2a7-4c88-aac5-a3529ec0cf4b service nova] Lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:53:26 user nova-compute[231753]: DEBUG nova.compute.manager [req-e6186f38-8f82-452b-bb5c-9e89ef4f198a req-02091607-b2a7-4c88-aac5-a3529ec0cf4b service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] No waiting events found dispatching network-vif-plugged-dba460c1-334b-4686-b6a3-7d85632d294d {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:53:26 user nova-compute[231753]: WARNING nova.compute.manager [req-e6186f38-8f82-452b-bb5c-9e89ef4f198a req-02091607-b2a7-4c88-aac5-a3529ec0cf4b service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Received unexpected event network-vif-plugged-dba460c1-334b-4686-b6a3-7d85632d294d for instance with vm_state rescued and task_state unrescuing.
Jul 29 13:53:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:28 user nova-compute[231753]: DEBUG nova.compute.manager [req-852aa007-18ab-45b0-b4b9-42ec2c18a652 req-e28ea713-efeb-4182-9667-f120135649fc service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Received event network-changed-75a46a16-882f-4bf9-96bf-a6874ecfbcc1 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:53:28 user nova-compute[231753]: DEBUG nova.compute.manager [req-852aa007-18ab-45b0-b4b9-42ec2c18a652 req-e28ea713-efeb-4182-9667-f120135649fc service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Refreshing instance network info cache due to event network-changed-75a46a16-882f-4bf9-96bf-a6874ecfbcc1. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:53:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-852aa007-18ab-45b0-b4b9-42ec2c18a652 req-e28ea713-efeb-4182-9667-f120135649fc service nova] Acquiring lock "refresh_cache-97e71bc1-78c8-4cec-a935-878dd08ff941" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:53:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-852aa007-18ab-45b0-b4b9-42ec2c18a652 req-e28ea713-efeb-4182-9667-f120135649fc service nova] Acquired lock "refresh_cache-97e71bc1-78c8-4cec-a935-878dd08ff941" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:53:28 user nova-compute[231753]: DEBUG nova.network.neutron [req-852aa007-18ab-45b0-b4b9-42ec2c18a652 req-e28ea713-efeb-4182-9667-f120135649fc service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Refreshing network info cache for port 75a46a16-882f-4bf9-96bf-a6874ecfbcc1 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:53:29 user nova-compute[231753]: DEBUG nova.compute.manager [req-62c8f229-2e05-45a5-b480-eed79bd475e5 req-af5ecb51-f953-4f8b-bfeb-36ef609becec service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Received event network-vif-plugged-dba460c1-334b-4686-b6a3-7d85632d294d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:53:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-62c8f229-2e05-45a5-b480-eed79bd475e5 req-af5ecb51-f953-4f8b-bfeb-36ef609becec service nova] Acquiring lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:53:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-62c8f229-2e05-45a5-b480-eed79bd475e5 req-af5ecb51-f953-4f8b-bfeb-36ef609becec service nova] Lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:53:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-62c8f229-2e05-45a5-b480-eed79bd475e5 req-af5ecb51-f953-4f8b-bfeb-36ef609becec service nova] Lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:53:29 user nova-compute[231753]: DEBUG nova.compute.manager [req-62c8f229-2e05-45a5-b480-eed79bd475e5 req-af5ecb51-f953-4f8b-bfeb-36ef609becec service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] No waiting events found dispatching network-vif-plugged-dba460c1-334b-4686-b6a3-7d85632d294d {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:53:29 user nova-compute[231753]: WARNING nova.compute.manager [req-62c8f229-2e05-45a5-b480-eed79bd475e5 req-af5ecb51-f953-4f8b-bfeb-36ef609becec service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Received unexpected event network-vif-plugged-dba460c1-334b-4686-b6a3-7d85632d294d for instance with vm_state rescued and task_state unrescuing.
Jul 29 13:53:29 user nova-compute[231753]: DEBUG nova.compute.manager [req-62c8f229-2e05-45a5-b480-eed79bd475e5 req-af5ecb51-f953-4f8b-bfeb-36ef609becec service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Received event network-vif-plugged-dba460c1-334b-4686-b6a3-7d85632d294d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:53:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-62c8f229-2e05-45a5-b480-eed79bd475e5 req-af5ecb51-f953-4f8b-bfeb-36ef609becec service nova] Acquiring lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:53:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-62c8f229-2e05-45a5-b480-eed79bd475e5 req-af5ecb51-f953-4f8b-bfeb-36ef609becec service nova] Lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:53:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-62c8f229-2e05-45a5-b480-eed79bd475e5 req-af5ecb51-f953-4f8b-bfeb-36ef609becec service nova] Lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:53:29 user nova-compute[231753]: DEBUG nova.compute.manager [req-62c8f229-2e05-45a5-b480-eed79bd475e5 req-af5ecb51-f953-4f8b-bfeb-36ef609becec service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] No waiting events found dispatching network-vif-plugged-dba460c1-334b-4686-b6a3-7d85632d294d {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:53:29 user nova-compute[231753]: WARNING nova.compute.manager [req-62c8f229-2e05-45a5-b480-eed79bd475e5 req-af5ecb51-f953-4f8b-bfeb-36ef609becec service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Received unexpected event network-vif-plugged-dba460c1-334b-4686-b6a3-7d85632d294d for instance with vm_state rescued and task_state unrescuing.
Jul 29 13:53:29 user nova-compute[231753]: DEBUG nova.network.neutron [req-852aa007-18ab-45b0-b4b9-42ec2c18a652 req-e28ea713-efeb-4182-9667-f120135649fc service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Updated VIF entry in instance network info cache for port 75a46a16-882f-4bf9-96bf-a6874ecfbcc1. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:53:29 user nova-compute[231753]: DEBUG nova.network.neutron [req-852aa007-18ab-45b0-b4b9-42ec2c18a652 req-e28ea713-efeb-4182-9667-f120135649fc service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Updating instance_info_cache with network_info: [{"id": "75a46a16-882f-4bf9-96bf-a6874ecfbcc1", "address": "fa:16:3e:30:50:53", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a46a16-88", "ovs_interfaceid": "75a46a16-882f-4bf9-96bf-a6874ecfbcc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:53:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Removed pending event for ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965 due to event {{(pid=231753) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 29 13:53:29 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638809.02358, ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:53:29 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] VM Resumed (Lifecycle Event)
Jul 29 13:53:29 user nova-compute[231753]: DEBUG nova.compute.manager [None req-fc412e94-41d8-4984-bcd9-209c2f868275 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:53:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-852aa007-18ab-45b0-b4b9-42ec2c18a652 req-e28ea713-efeb-4182-9667-f120135649fc service nova] Releasing lock "refresh_cache-97e71bc1-78c8-4cec-a935-878dd08ff941" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:53:29 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:53:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e1cf2bf1-210a-40c6-85ab-b8328b8ae6ae tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "97e71bc1-78c8-4cec-a935-878dd08ff941" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:53:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e1cf2bf1-210a-40c6-85ab-b8328b8ae6ae tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "97e71bc1-78c8-4cec-a935-878dd08ff941" acquired by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:53:29 user nova-compute[231753]: INFO nova.compute.manager [None req-e1cf2bf1-210a-40c6-85ab-b8328b8ae6ae tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Rebooting instance
Jul 29 13:53:29 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:53:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e1cf2bf1-210a-40c6-85ab-b8328b8ae6ae tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "refresh_cache-97e71bc1-78c8-4cec-a935-878dd08ff941" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:53:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e1cf2bf1-210a-40c6-85ab-b8328b8ae6ae tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquired lock "refresh_cache-97e71bc1-78c8-4cec-a935-878dd08ff941" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:53:29 user nova-compute[231753]: DEBUG nova.network.neutron [None req-e1cf2bf1-210a-40c6-85ab-b8328b8ae6ae tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:53:29 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] During sync_power_state the instance has a pending task (unrescuing). Skip.
Jul 29 13:53:29 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638809.0264275, ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:53:29 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] VM Started (Lifecycle Event)
Jul 29 13:53:29 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:53:29 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:53:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:29 user nova-compute[231753]: DEBUG nova.network.neutron [None req-e1cf2bf1-210a-40c6-85ab-b8328b8ae6ae tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Updating instance_info_cache with network_info: [{"id": "75a46a16-882f-4bf9-96bf-a6874ecfbcc1", "address": "fa:16:3e:30:50:53", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a46a16-88", "ovs_interfaceid": "75a46a16-882f-4bf9-96bf-a6874ecfbcc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:53:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e1cf2bf1-210a-40c6-85ab-b8328b8ae6ae tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Releasing lock "refresh_cache-97e71bc1-78c8-4cec-a935-878dd08ff941" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:53:29 user nova-compute[231753]: DEBUG nova.compute.manager [None req-e1cf2bf1-210a-40c6-85ab-b8328b8ae6ae tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:53:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:32 user nova-compute[231753]: DEBUG nova.compute.manager [req-c6690ec8-0f76-4763-8af9-84495975b512 req-a48f977d-bacc-496b-a853-a886e08f0463 service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Received event network-vif-unplugged-75a46a16-882f-4bf9-96bf-a6874ecfbcc1 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:53:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c6690ec8-0f76-4763-8af9-84495975b512 req-a48f977d-bacc-496b-a853-a886e08f0463 service nova] Acquiring lock "97e71bc1-78c8-4cec-a935-878dd08ff941-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:53:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c6690ec8-0f76-4763-8af9-84495975b512 req-a48f977d-bacc-496b-a853-a886e08f0463 service nova] Lock "97e71bc1-78c8-4cec-a935-878dd08ff941-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:53:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c6690ec8-0f76-4763-8af9-84495975b512 req-a48f977d-bacc-496b-a853-a886e08f0463 service nova] Lock "97e71bc1-78c8-4cec-a935-878dd08ff941-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:53:32 user nova-compute[231753]: DEBUG nova.compute.manager [req-c6690ec8-0f76-4763-8af9-84495975b512 req-a48f977d-bacc-496b-a853-a886e08f0463 service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] No waiting events found dispatching network-vif-unplugged-75a46a16-882f-4bf9-96bf-a6874ecfbcc1 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:53:32 user nova-compute[231753]: WARNING nova.compute.manager [req-c6690ec8-0f76-4763-8af9-84495975b512 req-a48f977d-bacc-496b-a853-a886e08f0463 service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Received unexpected event network-vif-unplugged-75a46a16-882f-4bf9-96bf-a6874ecfbcc1 for instance with vm_state active and task_state reboot_started.
Jul 29 13:53:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:32 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-e1cf2bf1-210a-40c6-85ab-b8328b8ae6ae tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Instance shutdown successfully.
Jul 29 13:53:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:34 user nova-compute[231753]: DEBUG nova.compute.manager [req-ff882969-fe35-4042-9549-595463c5707d req-254f8374-3a1c-43de-8297-fc04fdbbbb3f service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Received event network-vif-plugged-75a46a16-882f-4bf9-96bf-a6874ecfbcc1 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:53:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ff882969-fe35-4042-9549-595463c5707d req-254f8374-3a1c-43de-8297-fc04fdbbbb3f service nova] Acquiring lock "97e71bc1-78c8-4cec-a935-878dd08ff941-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:53:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ff882969-fe35-4042-9549-595463c5707d req-254f8374-3a1c-43de-8297-fc04fdbbbb3f service nova] Lock "97e71bc1-78c8-4cec-a935-878dd08ff941-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:53:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ff882969-fe35-4042-9549-595463c5707d req-254f8374-3a1c-43de-8297-fc04fdbbbb3f service nova] Lock "97e71bc1-78c8-4cec-a935-878dd08ff941-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:53:34 user nova-compute[231753]: DEBUG nova.compute.manager [req-ff882969-fe35-4042-9549-595463c5707d req-254f8374-3a1c-43de-8297-fc04fdbbbb3f service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] No waiting events found dispatching network-vif-plugged-75a46a16-882f-4bf9-96bf-a6874ecfbcc1 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:53:34 user nova-compute[231753]: WARNING nova.compute.manager [req-ff882969-fe35-4042-9549-595463c5707d req-254f8374-3a1c-43de-8297-fc04fdbbbb3f service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Received unexpected event network-vif-plugged-75a46a16-882f-4bf9-96bf-a6874ecfbcc1 for instance with vm_state active and task_state reboot_started.
Jul 29 13:53:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:35 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:35 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:35 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:36 user nova-compute[231753]: DEBUG nova.compute.manager [req-bb06291d-e4ce-47b9-a3b7-3158139b03a5 req-c921ed02-d438-4833-a5d9-906fc04ef6ad service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Received event network-vif-plugged-75a46a16-882f-4bf9-96bf-a6874ecfbcc1 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:53:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bb06291d-e4ce-47b9-a3b7-3158139b03a5 req-c921ed02-d438-4833-a5d9-906fc04ef6ad service nova] Acquiring lock "97e71bc1-78c8-4cec-a935-878dd08ff941-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:53:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bb06291d-e4ce-47b9-a3b7-3158139b03a5 req-c921ed02-d438-4833-a5d9-906fc04ef6ad service nova] Lock "97e71bc1-78c8-4cec-a935-878dd08ff941-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:53:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bb06291d-e4ce-47b9-a3b7-3158139b03a5 req-c921ed02-d438-4833-a5d9-906fc04ef6ad service nova] Lock "97e71bc1-78c8-4cec-a935-878dd08ff941-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:53:36 user nova-compute[231753]: DEBUG nova.compute.manager [req-bb06291d-e4ce-47b9-a3b7-3158139b03a5 req-c921ed02-d438-4833-a5d9-906fc04ef6ad service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] No waiting events found dispatching network-vif-plugged-75a46a16-882f-4bf9-96bf-a6874ecfbcc1 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:53:36 user nova-compute[231753]: WARNING nova.compute.manager [req-bb06291d-e4ce-47b9-a3b7-3158139b03a5 req-c921ed02-d438-4833-a5d9-906fc04ef6ad service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Received unexpected event network-vif-plugged-75a46a16-882f-4bf9-96bf-a6874ecfbcc1 for instance with vm_state active and task_state reboot_started.
Jul 29 13:53:36 user nova-compute[231753]: DEBUG nova.compute.manager [req-bb06291d-e4ce-47b9-a3b7-3158139b03a5 req-c921ed02-d438-4833-a5d9-906fc04ef6ad service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Received event network-vif-plugged-75a46a16-882f-4bf9-96bf-a6874ecfbcc1 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:53:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bb06291d-e4ce-47b9-a3b7-3158139b03a5 req-c921ed02-d438-4833-a5d9-906fc04ef6ad service nova] Acquiring lock "97e71bc1-78c8-4cec-a935-878dd08ff941-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:53:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bb06291d-e4ce-47b9-a3b7-3158139b03a5 req-c921ed02-d438-4833-a5d9-906fc04ef6ad service nova] Lock "97e71bc1-78c8-4cec-a935-878dd08ff941-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:53:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bb06291d-e4ce-47b9-a3b7-3158139b03a5 req-c921ed02-d438-4833-a5d9-906fc04ef6ad service nova] Lock "97e71bc1-78c8-4cec-a935-878dd08ff941-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:53:36 user nova-compute[231753]: DEBUG nova.compute.manager [req-bb06291d-e4ce-47b9-a3b7-3158139b03a5 req-c921ed02-d438-4833-a5d9-906fc04ef6ad service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] No waiting events found dispatching network-vif-plugged-75a46a16-882f-4bf9-96bf-a6874ecfbcc1 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:53:36 user nova-compute[231753]: WARNING nova.compute.manager [req-bb06291d-e4ce-47b9-a3b7-3158139b03a5 req-c921ed02-d438-4833-a5d9-906fc04ef6ad service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Received unexpected event network-vif-plugged-75a46a16-882f-4bf9-96bf-a6874ecfbcc1 for instance with vm_state active and task_state reboot_started.
Jul 29 13:53:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Removed pending event for 97e71bc1-78c8-4cec-a935-878dd08ff941 due to event {{(pid=231753) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:438}}
Jul 29 13:53:36 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638816.726623, 97e71bc1-78c8-4cec-a935-878dd08ff941 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:53:36 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] VM Resumed (Lifecycle Event)
Jul 29 13:53:36 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Instance running successfully.
Jul 29 13:53:36 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-e1cf2bf1-210a-40c6-85ab-b8328b8ae6ae tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Instance soft rebooted successfully.
Jul 29 13:53:36 user nova-compute[231753]: DEBUG nova.compute.manager [None req-e1cf2bf1-210a-40c6-85ab-b8328b8ae6ae tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:53:36 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:53:36 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:53:36 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] During sync_power_state the instance has a pending task (reboot_started). Skip.
Jul 29 13:53:36 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638816.7324457, 97e71bc1-78c8-4cec-a935-878dd08ff941 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:53:36 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] VM Started (Lifecycle Event)
Jul 29 13:53:36 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:53:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e1cf2bf1-210a-40c6-85ab-b8328b8ae6ae tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "97e71bc1-78c8-4cec-a935-878dd08ff941" "released" by "nova.compute.manager.ComputeManager.reboot_instance.<locals>.do_reboot_instance" :: held 7.753s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:53:36 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: reboot_started, current DB power_state: 1, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:53:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:41 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:46 user nova-compute[231753]: DEBUG nova.compute.manager [req-babc40d1-5096-4d1e-b616-ed4cff2e574b req-379cab4a-1380-43af-bb8e-831bc9d74da0 service nova] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Received event network-changed-259c966b-ba73-42ca-9f38-7cba6bdc671c {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:53:46 user nova-compute[231753]: DEBUG nova.compute.manager [req-babc40d1-5096-4d1e-b616-ed4cff2e574b req-379cab4a-1380-43af-bb8e-831bc9d74da0 service nova] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Refreshing instance network info cache due to event network-changed-259c966b-ba73-42ca-9f38-7cba6bdc671c. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:53:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-babc40d1-5096-4d1e-b616-ed4cff2e574b req-379cab4a-1380-43af-bb8e-831bc9d74da0 service nova] Acquiring lock "refresh_cache-8e153c4d-75b5-4507-aac7-21620479209b" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:53:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-babc40d1-5096-4d1e-b616-ed4cff2e574b req-379cab4a-1380-43af-bb8e-831bc9d74da0 service nova] Acquired lock "refresh_cache-8e153c4d-75b5-4507-aac7-21620479209b" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:53:46 user nova-compute[231753]: DEBUG nova.network.neutron [req-babc40d1-5096-4d1e-b616-ed4cff2e574b req-379cab4a-1380-43af-bb8e-831bc9d74da0 service nova] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Refreshing network info cache for port 259c966b-ba73-42ca-9f38-7cba6bdc671c {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:53:46 user nova-compute[231753]: DEBUG nova.network.neutron [req-babc40d1-5096-4d1e-b616-ed4cff2e574b req-379cab4a-1380-43af-bb8e-831bc9d74da0 service nova] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Updated VIF entry in instance network info cache for port 259c966b-ba73-42ca-9f38-7cba6bdc671c. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:53:46 user nova-compute[231753]: DEBUG nova.network.neutron [req-babc40d1-5096-4d1e-b616-ed4cff2e574b req-379cab4a-1380-43af-bb8e-831bc9d74da0 service nova] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Updating instance_info_cache with network_info: [{"id": "259c966b-ba73-42ca-9f38-7cba6bdc671c", "address": "fa:16:3e:4f:c8:e7", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259c966b-ba", "ovs_interfaceid": "259c966b-ba73-42ca-9f38-7cba6bdc671c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:53:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-babc40d1-5096-4d1e-b616-ed4cff2e574b req-379cab4a-1380-43af-bb8e-831bc9d74da0 service nova] Releasing lock "refresh_cache-8e153c4d-75b5-4507-aac7-21620479209b" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:53:47 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-51a55bf9-d973-417a-b655-696355f05749 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:53:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-51a55bf9-d973-417a-b655-696355f05749 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:53:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-51a55bf9-d973-417a-b655-696355f05749 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:53:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-51a55bf9-d973-417a-b655-696355f05749 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:53:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-51a55bf9-d973-417a-b655-696355f05749 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:53:49 user nova-compute[231753]: INFO nova.compute.manager [None req-51a55bf9-d973-417a-b655-696355f05749 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Terminating instance
Jul 29 13:53:49 user nova-compute[231753]: DEBUG nova.compute.manager [None req-51a55bf9-d973-417a-b655-696355f05749 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:53:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:49 user nova-compute[231753]: DEBUG nova.compute.manager [req-79d2ab4b-a02d-45a8-bcda-3b63a192a2ad req-38a13f56-7a8d-40f8-8ac9-6bbeba50ed5e service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Received event network-vif-unplugged-8c8e51fe-0d15-4a27-8215-dc512b6816f5 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:53:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-79d2ab4b-a02d-45a8-bcda-3b63a192a2ad req-38a13f56-7a8d-40f8-8ac9-6bbeba50ed5e service nova] Acquiring lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:53:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-79d2ab4b-a02d-45a8-bcda-3b63a192a2ad req-38a13f56-7a8d-40f8-8ac9-6bbeba50ed5e service nova] Lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:53:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-79d2ab4b-a02d-45a8-bcda-3b63a192a2ad req-38a13f56-7a8d-40f8-8ac9-6bbeba50ed5e service nova] Lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:53:49 user nova-compute[231753]: DEBUG nova.compute.manager [req-79d2ab4b-a02d-45a8-bcda-3b63a192a2ad req-38a13f56-7a8d-40f8-8ac9-6bbeba50ed5e service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] No waiting events found dispatching network-vif-unplugged-8c8e51fe-0d15-4a27-8215-dc512b6816f5 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:53:49 user nova-compute[231753]: DEBUG nova.compute.manager [req-79d2ab4b-a02d-45a8-bcda-3b63a192a2ad req-38a13f56-7a8d-40f8-8ac9-6bbeba50ed5e service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Received event network-vif-unplugged-8c8e51fe-0d15-4a27-8215-dc512b6816f5 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:53:50 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Instance destroyed successfully.
Jul 29 13:53:50 user nova-compute[231753]: DEBUG nova.objects.instance [None req-51a55bf9-d973-417a-b655-696355f05749 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lazy-loading 'resources' on Instance uuid 7e2615c1-b03e-4076-bcd9-3585fb11b8ac {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-51a55bf9-d973-417a-b655-696355f05749 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:36:40Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-350579303',display_name='tempest-ServerRescueNegativeTestJSON-server-350579303',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverrescuenegativetestjson-server-350579303',id=14,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:41:32Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='7aa6e9e70b4a49cb994440e868203c99',ramdisk_id='',reservation_id='r-3aiftumj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-700305152',owner_user_name='tempest-ServerRescueNegativeTestJSON-700305152-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:43:24Z,user_data=None,user_id='01b32889cd7442399a8bceaff3d05662',uuid=7e2615c1-b03e-4076-bcd9-3585fb11b8ac,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8c8e51fe-0d15-4a27-8215-dc512b6816f5", "address": "fa:16:3e:3e:10:27", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e51fe-0d", "ovs_interfaceid": "8c8e51fe-0d15-4a27-8215-dc512b6816f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-51a55bf9-d973-417a-b655-696355f05749 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Converting VIF {"id": "8c8e51fe-0d15-4a27-8215-dc512b6816f5", "address": "fa:16:3e:3e:10:27", "network": {"id": "e1a83272-2e22-47dc-95ae-2ab9861c5925", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1194226487-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "7aa6e9e70b4a49cb994440e868203c99", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap8c8e51fe-0d", "ovs_interfaceid": "8c8e51fe-0d15-4a27-8215-dc512b6816f5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-51a55bf9-d973-417a-b655-696355f05749 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3e:10:27,bridge_name='br-int',has_traffic_filtering=True,id=8c8e51fe-0d15-4a27-8215-dc512b6816f5,network=Network(e1a83272-2e22-47dc-95ae-2ab9861c5925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8e51fe-0d') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG os_vif [None req-51a55bf9-d973-417a-b655-696355f05749 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:10:27,bridge_name='br-int',has_traffic_filtering=True,id=8c8e51fe-0d15-4a27-8215-dc512b6816f5,network=Network(e1a83272-2e22-47dc-95ae-2ab9861c5925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8e51fe-0d') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8c8e51fe-0d, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "8e153c4d-75b5-4507-aac7-21620479209b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "8e153c4d-75b5-4507-aac7-21620479209b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:53:50 user nova-compute[231753]: INFO os_vif [None req-51a55bf9-d973-417a-b655-696355f05749 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3e:10:27,bridge_name='br-int',has_traffic_filtering=True,id=8c8e51fe-0d15-4a27-8215-dc512b6816f5,network=Network(e1a83272-2e22-47dc-95ae-2ab9861c5925),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8c8e51fe-0d')
Jul 29 13:53:50 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-51a55bf9-d973-417a-b655-696355f05749 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Deleting instance files /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac_del
Jul 29 13:53:50 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-51a55bf9-d973-417a-b655-696355f05749 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Deletion of /opt/stack/data/nova/instances/7e2615c1-b03e-4076-bcd9-3585fb11b8ac_del complete
Jul 29 13:53:50 user nova-compute[231753]: DEBUG nova.objects.instance [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lazy-loading 'flavor' on Instance uuid 8e153c4d-75b5-4507-aac7-21620479209b {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "8e153c4d-75b5-4507-aac7-21620479209b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.092s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:53:50 user nova-compute[231753]: INFO nova.compute.manager [None req-51a55bf9-d973-417a-b655-696355f05749 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Took 0.77 seconds to destroy the instance on the hypervisor.
Jul 29 13:53:50 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-51a55bf9-d973-417a-b655-696355f05749 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "8e153c4d-75b5-4507-aac7-21620479209b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "8e153c4d-75b5-4507-aac7-21620479209b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:53:50 user nova-compute[231753]: INFO nova.compute.manager [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Attaching volume 3078906c-e963-4c76-8e49-e74935cf163a to /dev/vdb
Jul 29 13:53:50 user nova-compute[231753]: DEBUG os_brick.utils [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e767b963-da33-4dd7-8ccb-2656ec40b2c8]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c97e8a54-1e1e-4077-ab4e-7adb5e23c766]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d0d862-5351-4c74-9dd2-c56d7563f125]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c5961c-fee3-4f0e-9bd2-7f1b8ca8699a]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:53:50 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:53:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d530b6e3-d965-44b0-a5c3-9dab7618cea0]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG os_brick.utils [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Updating existing volume attachment record: 7d8c8441-9f16-4516-918d-fc654c032035 {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:53:50 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Took 0.54 seconds to deallocate network for instance.
Jul 29 13:53:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-51a55bf9-d973-417a-b655-696355f05749 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:53:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-51a55bf9-d973-417a-b655-696355f05749 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:53:51 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-51a55bf9-d973-417a-b655-696355f05749 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:53:51 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-51a55bf9-d973-417a-b655-696355f05749 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:53:51 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-51a55bf9-d973-417a-b655-696355f05749 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.385s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:53:51 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-51a55bf9-d973-417a-b655-696355f05749 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Deleted allocations for instance 7e2615c1-b03e-4076-bcd9-3585fb11b8ac
Jul 29 13:53:51 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-51a55bf9-d973-417a-b655-696355f05749 tempest-ServerRescueNegativeTestJSON-700305152 tempest-ServerRescueNegativeTestJSON-700305152-project-member] Lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.914s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:53:51 user nova-compute[231753]: DEBUG nova.compute.manager [req-8bc95bec-088f-489b-a589-3cfc036527cf req-c9e08cc6-48b6-4911-afaa-498e89f29450 service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Received event network-vif-plugged-8c8e51fe-0d15-4a27-8215-dc512b6816f5 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:53:51 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8bc95bec-088f-489b-a589-3cfc036527cf req-c9e08cc6-48b6-4911-afaa-498e89f29450 service nova] Acquiring lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:53:51 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8bc95bec-088f-489b-a589-3cfc036527cf req-c9e08cc6-48b6-4911-afaa-498e89f29450 service nova] Lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:53:51 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8bc95bec-088f-489b-a589-3cfc036527cf req-c9e08cc6-48b6-4911-afaa-498e89f29450 service nova] Lock "7e2615c1-b03e-4076-bcd9-3585fb11b8ac-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:53:51 user nova-compute[231753]: DEBUG nova.compute.manager [req-8bc95bec-088f-489b-a589-3cfc036527cf req-c9e08cc6-48b6-4911-afaa-498e89f29450 service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] No waiting events found dispatching network-vif-plugged-8c8e51fe-0d15-4a27-8215-dc512b6816f5 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:53:51 user nova-compute[231753]: WARNING nova.compute.manager [req-8bc95bec-088f-489b-a589-3cfc036527cf req-c9e08cc6-48b6-4911-afaa-498e89f29450 service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Received unexpected event network-vif-plugged-8c8e51fe-0d15-4a27-8215-dc512b6816f5 for instance with vm_state deleted and task_state None.
Jul 29 13:53:51 user nova-compute[231753]: DEBUG nova.compute.manager [req-8bc95bec-088f-489b-a589-3cfc036527cf req-c9e08cc6-48b6-4911-afaa-498e89f29450 service nova] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Received event network-vif-deleted-8c8e51fe-0d15-4a27-8215-dc512b6816f5 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:53:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:55 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LViBXbqK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:53:58 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:53:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:53:58 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:53:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:53:58 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:53:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c89843fe-9ef6-42a3-85d2-39f144a60ffe]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:53:58 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4dac9db-16b2-4880-8baa-d9e36fd7cc2b]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a] added
Jul 29 13:53:58 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7009dbc2-1490-4226-b4c2-6d06dc42a14e]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd9e9ad-bb6e-43e2-af78-b28650faae9a]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LViBXbqK {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LViBXbqK" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b8ba34-cdcb-4bb0-9b7e-c5c0060af80b]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LViBXbqK'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[84495090-a7ea-4388-95e6-8a2a470893a6]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad58c4b-9817-4713-95d0-97ed0b7c7d51]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:53:58 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:53:58 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:53:58 user nova-compute[231753]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)
Jul 29 13:53:58 user nova-compute[231753]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 (non-flash)
Jul 29 13:53:58 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:53:58 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:53:58 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:53:58 user nova-compute[231753]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)
Jul 29 13:53:58 user nova-compute[231753]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 (non-flash)
Jul 29 13:53:58 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a -p 172.16.0.220:3260 --login" returned: 0 in 0.072s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[acb50eda-7aed-444b-bac8-d29a62a694cb]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a, portal: 172.16.0.220,3260]
Jul 29 13:53:58 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a, portal: 172.16.0.220,3260] successful.
Jul 29 13:53:58 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[def0741e-ac4a-489c-aaa3-01f5cc27e984]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[89b57c0a-0d63-4a9a-b0a4-6c438f59752d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:53:58 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:53:58 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:53:58 user nova-compute[231753]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)
Jul 29 13:53:58 user nova-compute[231753]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 (non-flash)
Jul 29 13:53:58 user nova-compute[231753]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a (non-flash)
Jul 29 13:53:58 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:53:58 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:53:58 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:53:58 user nova-compute[231753]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)
Jul 29 13:53:58 user nova-compute[231753]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 (non-flash)
Jul 29 13:53:58 user nova-compute[231753]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a (non-flash)
Jul 29 13:53:58 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.325s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] HCTL ('38', '-', '-', 0) found on session 46 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Scanning host 38 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host38/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host38/scan" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[85bc2ba1-3ecb-48bd-839e-98de2d370b51]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Searching for a device in session 46 and hctl ['38', '*', '*', 0] yield: sdg {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:53:58 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Connected to sdg using {'target_iqn': 'iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LViBXbqK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:53:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:53:59 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:53:59 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] <== connect_volume: return (1374ms) {'type': 'block', 'scsi_wwn': '26338393865313537', 'path': '/dev/sdg'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:53:59 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26338393865313537', 'path': '/dev/sdg'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:53:59 user nova-compute[231753]: DEBUG nova.objects.instance [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lazy-loading 'flavor' on Instance uuid 8e153c4d-75b5-4507-aac7-21620479209b {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:53:59 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 13:53:59 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:53:59 user nova-compute[231753]:   <source dev="/dev/sdg"/>
Jul 29 13:53:59 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:53:59 user nova-compute[231753]:   <serial>3078906c-e963-4c76-8e49-e74935cf163a</serial>
Jul 29 13:53:59 user nova-compute[231753]: </disk>
Jul 29 13:53:59 user nova-compute[231753]:  {{(pid=231753) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 13:54:00 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:54:00 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:54:00 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] No BDM found with device name vdb, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:54:00 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] No VIF found with MAC fa:16:3e:4f:c8:e7, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:54:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c2104f46-3673-41d7-b116-22ae73728a93 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "8e153c4d-75b5-4507-aac7-21620479209b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.939s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:54:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:54:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "8e153c4d-75b5-4507-aac7-21620479209b" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:54:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "8e153c4d-75b5-4507-aac7-21620479209b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:54:04 user nova-compute[231753]: DEBUG nova.objects.instance [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lazy-loading 'flavor' on Instance uuid 8e153c4d-75b5-4507-aac7-21620479209b {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:54:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "8e153c4d-75b5-4507-aac7-21620479209b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.059s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:54:05 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690638830.0770946, 7e2615c1-b03e-4076-bcd9-3585fb11b8ac => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:54:05 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] VM Stopped (Lifecycle Event)
Jul 29 13:54:05 user nova-compute[231753]: DEBUG nova.compute.manager [None req-c6da5dad-6ac3-444d-9eda-57405e652133 None None] [instance: 7e2615c1-b03e-4076-bcd9-3585fb11b8ac] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:54:05 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:54:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "8e153c4d-75b5-4507-aac7-21620479209b" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:54:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "8e153c4d-75b5-4507-aac7-21620479209b" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:54:05 user nova-compute[231753]: INFO nova.compute.manager [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Attaching volume 0946e095-4f9b-4a32-8295-a2db87abd304 to /dev/vdc
Jul 29 13:54:05 user nova-compute[231753]: DEBUG os_brick.utils [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:54:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:05 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[259eb5d0-f437-4182-b0f7-47994fdda18b]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:05 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[40e55098-18f4-4756-b77c-57b15c5bfc57]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:05 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[28b51128-8aca-47b5-beb1-54a55e21d0c8]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:05 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f25a3a3-41a3-4ca0-a05f-900841e7c849]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:54:05 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:54:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:05 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:54:05 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:54:05 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9a37aa3-9936-488f-a4af-0ab0c72a9037]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:05 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:54:05 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:54:05 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:54:05 user nova-compute[231753]: DEBUG os_brick.utils [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] <== get_connector_properties: return (125ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:54:05 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Updating existing volume attachment record: 14f398bb-c4fd-49fd-a9a8-cc1864b2df5f {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:54:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:54:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:54:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUnrRuFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:54:12 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:54:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:54:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:54:12 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:54:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:54:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:54:12 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:54:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304 -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:12 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc1d2e6-6310-437c-b4e3-42b534e7fe3a]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:54:12 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:54:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304 -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:12 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4446bf7e-0f8e-46f0-b79f-393fe36b4bf1]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304] added
Jul 29 13:54:12 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:54:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:12 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5317dbd2-f829-4c94-9eeb-ff1d3c70bafc]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:54:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:12 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac1fcc26-ee82-472a-8cbb-68cb4e213d91]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:54:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LUnrRuFX {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v LUnrRuFX" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:12 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b80b827-3477-40d5-b17a-b512e98a4b14]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'LUnrRuFX'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:54:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:12 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce19d83b-feca-4673-afae-7856f6aee237]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:12 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:54:12 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.034s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:13 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1552ba8-fcd9-4ed2-8af1-e23d6b43f97b]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:54:13 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:54:13 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:54:13 user nova-compute[231753]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)
Jul 29 13:54:13 user nova-compute[231753]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 (non-flash)
Jul 29 13:54:13 user nova-compute[231753]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a (non-flash)
Jul 29 13:54:13 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:54:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:54:13 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:54:13 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:54:13 user nova-compute[231753]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)
Jul 29 13:54:13 user nova-compute[231753]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 (non-flash)
Jul 29 13:54:13 user nova-compute[231753]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a (non-flash)
Jul 29 13:54:13 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:54:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304 -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304 -p 172.16.0.220:3260 --login" returned: 0 in 0.080s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:13 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7032d3d-8f4d-4999-b18f-072ba98f2852]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304, portal: 172.16.0.220,3260]
Jul 29 13:54:13 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304, portal: 172.16.0.220,3260] successful.
Jul 29 13:54:13 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:54:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.028s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:13 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9acf6a3b-01b5-48cb-b02d-87d4caf55ecd]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:54:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.032s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:13 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f677befb-ebf3-45f9-b3cc-386bbdd856b4]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:54:13 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:54:13 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:54:13 user nova-compute[231753]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)
Jul 29 13:54:13 user nova-compute[231753]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 (non-flash)
Jul 29 13:54:13 user nova-compute[231753]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a (non-flash)
Jul 29 13:54:13 user nova-compute[231753]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304 (non-flash)
Jul 29 13:54:13 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:54:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:54:13 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:54:13 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:54:13 user nova-compute[231753]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)
Jul 29 13:54:13 user nova-compute[231753]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 (non-flash)
Jul 29 13:54:13 user nova-compute[231753]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a (non-flash)
Jul 29 13:54:13 user nova-compute[231753]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304 (non-flash)
Jul 29 13:54:13 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:54:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.336s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:54:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:54:13 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] HCTL ('39', '-', '-', 0) found on session 47 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:54:13 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Scanning host 39 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:54:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host39/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host39/scan" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:13 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebef7f63-e220-4070-9f3f-46150f2a171c]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:13 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Searching for a device in session 47 and hctl ['39', '*', '*', 0] yield: sdh {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:54:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Connected to sdh using {'target_iqn': 'iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUnrRuFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:54:14 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.378s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:54:14 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] <== connect_volume: return (1380ms) {'type': 'block', 'scsi_wwn': '23332353134316661', 'path': '/dev/sdh'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:54:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23332353134316661', 'path': '/dev/sdh'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:54:14 user nova-compute[231753]: DEBUG nova.objects.instance [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lazy-loading 'flavor' on Instance uuid 8e153c4d-75b5-4507-aac7-21620479209b {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:54:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 13:54:14 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:54:14 user nova-compute[231753]:   <source dev="/dev/sdh"/>
Jul 29 13:54:14 user nova-compute[231753]:   <target dev="vdc" bus="virtio"/>
Jul 29 13:54:14 user nova-compute[231753]:   <serial>0946e095-4f9b-4a32-8295-a2db87abd304</serial>
Jul 29 13:54:14 user nova-compute[231753]: </disk>
Jul 29 13:54:14 user nova-compute[231753]:  {{(pid=231753) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 13:54:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:54:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] No BDM found with device name vdb, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:54:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] No BDM found with device name vdc, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:54:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] No VIF found with MAC fa:16:3e:4f:c8:e7, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:54:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-3b2271d3-f5f5-4992-a1d1-13e5bffa09b0 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "8e153c4d-75b5-4507-aac7-21620479209b" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.642s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:54:15 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:54:16 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:54:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-08e25916-3d61-4182-b8f9-4c0cc994afc8 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "8e153c4d-75b5-4507-aac7-21620479209b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:54:16 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-08e25916-3d61-4182-b8f9-4c0cc994afc8 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "8e153c4d-75b5-4507-aac7-21620479209b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:54:16 user nova-compute[231753]: INFO nova.compute.manager [None req-08e25916-3d61-4182-b8f9-4c0cc994afc8 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Detaching volume 3078906c-e963-4c76-8e49-e74935cf163a
Jul 29 13:54:16 user nova-compute[231753]: INFO nova.virt.block_device [None req-08e25916-3d61-4182-b8f9-4c0cc994afc8 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Attempting to driver detach volume 3078906c-e963-4c76-8e49-e74935cf163a from mountpoint /dev/vdb
Jul 29 13:54:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-08e25916-3d61-4182-b8f9-4c0cc994afc8 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Attempting to detach device vdb from instance 8e153c4d-75b5-4507-aac7-21620479209b from the persistent domain config. {{(pid=231753) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 13:54:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-08e25916-3d61-4182-b8f9-4c0cc994afc8 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:54:16 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:54:16 user nova-compute[231753]:   <source dev="/dev/sdg"/>
Jul 29 13:54:16 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:54:16 user nova-compute[231753]:   <serial>3078906c-e963-4c76-8e49-e74935cf163a</serial>
Jul 29 13:54:16 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 13:54:16 user nova-compute[231753]: </disk>
Jul 29 13:54:16 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:54:16 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-08e25916-3d61-4182-b8f9-4c0cc994afc8 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Successfully detached device vdb from instance 8e153c4d-75b5-4507-aac7-21620479209b from the persistent domain config.
Jul 29 13:54:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-08e25916-3d61-4182-b8f9-4c0cc994afc8 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8e153c4d-75b5-4507-aac7-21620479209b from the live domain config. {{(pid=231753) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 13:54:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-08e25916-3d61-4182-b8f9-4c0cc994afc8 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:54:16 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:54:16 user nova-compute[231753]:   <source dev="/dev/sdg"/>
Jul 29 13:54:16 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:54:16 user nova-compute[231753]:   <serial>3078906c-e963-4c76-8e49-e74935cf163a</serial>
Jul 29 13:54:16 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 13:54:16 user nova-compute[231753]: </disk>
Jul 29 13:54:16 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:54:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Received event <DeviceRemovedEvent: 1690638856.97972, 8e153c4d-75b5-4507-aac7-21620479209b => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=231753) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 13:54:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-08e25916-3d61-4182-b8f9-4c0cc994afc8 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8e153c4d-75b5-4507-aac7-21620479209b {{(pid=231753) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 13:54:16 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-08e25916-3d61-4182-b8f9-4c0cc994afc8 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Successfully detached device vdb from instance 8e153c4d-75b5-4507-aac7-21620479209b from the live domain config.
Jul 29 13:54:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08e25916-3d61-4182-b8f9-4c0cc994afc8 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:54:16 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e25916-3d61-4182-b8f9-4c0cc994afc8 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LViBXbqK', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdg'}, None), 'kwargs': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:54:16 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-08e25916-3d61-4182-b8f9-4c0cc994afc8 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:54:16 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-08e25916-3d61-4182-b8f9-4c0cc994afc8 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:54:16 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-08e25916-3d61-4182-b8f9-4c0cc994afc8 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:54:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf1d13a3-8403-4ab4-a83a-b49bd1267dd5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e25916-3d61-4182-b8f9-4c0cc994afc8 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:54:17 user nova-compute[231753]: No targets found.
Jul 29 13:54:17 user nova-compute[231753]: iSNS:
Jul 29 13:54:17 user nova-compute[231753]: No targets found.
Jul 29 13:54:17 user nova-compute[231753]: STATIC:
Jul 29 13:54:17 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea
Jul 29 13:54:17 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:54:17 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:54:17 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf
Jul 29 13:54:17 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:54:17 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:54:17 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699
Jul 29 13:54:17 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:54:17 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:54:17 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a
Jul 29 13:54:17 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:54:17 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:54:17 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304
Jul 29 13:54:17 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:54:17 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:54:17 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a
Jul 29 13:54:17 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:54:17 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:54:17 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271
Jul 29 13:54:17 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:54:17 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:54:17 user nova-compute[231753]: FIRMWARE:
Jul 29 13:54:17 user nova-compute[231753]: No targets found.
Jul 29 13:54:17 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e25916-3d61-4182-b8f9-4c0cc994afc8 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:54:17 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:54:17 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e25916-3d61-4182-b8f9-4c0cc994afc8 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cfa61e2-e0fc-4442-8fdf-9558794afdfc]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb57f068-e49d-4fcd-a3a0-e38814eca2e0]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 (non-flash)\ntcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e25916-3d61-4182-b8f9-4c0cc994afc8 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:54:17 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:54:17 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:54:17 user nova-compute[231753]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)
Jul 29 13:54:17 user nova-compute[231753]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 (non-flash)
Jul 29 13:54:17 user nova-compute[231753]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a (non-flash)
Jul 29 13:54:17 user nova-compute[231753]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304 (non-flash)
Jul 29 13:54:17 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e25916-3d61-4182-b8f9-4c0cc994afc8 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:54:17 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:54:17 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:54:17 user nova-compute[231753]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)
Jul 29 13:54:17 user nova-compute[231753]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 (non-flash)
Jul 29 13:54:17 user nova-compute[231753]: tcp: [46] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a (non-flash)
Jul 29 13:54:17 user nova-compute[231753]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304 (non-flash)
Jul 29 13:54:17 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e25916-3d61-4182-b8f9-4c0cc994afc8 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c803ac8b0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a'): ({'sdg'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-08e25916-3d61-4182-b8f9-4c0cc994afc8 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Removing single pathed devices sdg {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9ea534f-6a73-4f05-951d-41424cc06218]: (4, ('path checker states:\nup                  7\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdg {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdg" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[67cf5ffb-d096-404e-84f8-ae1d8c71abaf]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-08e25916-3d61-4182-b8f9-4c0cc994afc8 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Flushing IO for device /dev/sdg {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdg {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdg" returned: 0 in 0.013s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c7404d8-1d66-4e2f-a11c-7337bde65767]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-08e25916-3d61-4182-b8f9-4c0cc994afc8 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdg/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdg/device/delete" returned: 0 in 0.034s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5ac9d58-05dd-4f98-89f9-dbb50eae8160]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-08e25916-3d61-4182-b8f9-4c0cc994afc8 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Checking to see if SCSI volumes sdg have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-08e25916-3d61-4182-b8f9-4c0cc994afc8 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] SCSI volumes sdg have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e25916-3d61-4182-b8f9-4c0cc994afc8 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb4a34cb-b3e7-473d-b98f-b2e6828edf86]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e25916-3d61-4182-b8f9-4c0cc994afc8 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a -p 172.16.0.220:3260 --logout" returned: 0 in 0.072s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb5d1029-6164-4a82-922e-e20c9dca0ebb]: (4, ('Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a, portal: 172.16.0.220,3260]\nLogout of [sid: 46, target: iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e25916-3d61-4182-b8f9-4c0cc994afc8 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 46, target: iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a, portal: 172.16.0.220,3260]
Jul 29 13:54:17 user nova-compute[231753]: Logout of [sid: 46, target: iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a, portal: 172.16.0.220,3260] successful.
Jul 29 13:54:17 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3078906c-e963-4c76-8e49-e74935cf163a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.032s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4030fdcf-e119-4fd2-8d3a-ccf57cfb33f6]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e25916-3d61-4182-b8f9-4c0cc994afc8 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-08e25916-3d61-4182-b8f9-4c0cc994afc8 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-08e25916-3d61-4182-b8f9-4c0cc994afc8 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] <== disconnect_volume: return (336ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-08e25916-3d61-4182-b8f9-4c0cc994afc8 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:17 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:18 user nova-compute[231753]: DEBUG nova.objects.instance [None req-08e25916-3d61-4182-b8f9-4c0cc994afc8 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lazy-loading 'flavor' on Instance uuid 8e153c4d-75b5-4507-aac7-21620479209b {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:54:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json" returned: 0 in 0.174s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e153c4d-75b5-4507-aac7-21620479209b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-08e25916-3d61-4182-b8f9-4c0cc994afc8 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "8e153c4d-75b5-4507-aac7-21620479209b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.784s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:54:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e153c4d-75b5-4507-aac7-21620479209b/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e153c4d-75b5-4507-aac7-21620479209b/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e153c4d-75b5-4507-aac7-21620479209b/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:18 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdh (vdc) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:54:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e71bc1-78c8-4cec-a935-878dd08ff941/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e71bc1-78c8-4cec-a935-878dd08ff941/disk --force-share --output=json" returned: 0 in 0.148s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e71bc1-78c8-4cec-a935-878dd08ff941/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e71bc1-78c8-4cec-a935-878dd08ff941/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:18 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:54:18 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:54:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:54:19 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:54:19 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:54:19 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=7542MB free_disk=24.91705322265625GB free_vcpus=4 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 13:54:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:54:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:54:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-44464968-15ee-4ed5-ace7-733201cdf2c1 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "8e153c4d-75b5-4507-aac7-21620479209b" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:54:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-44464968-15ee-4ed5-ace7-733201cdf2c1 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "8e153c4d-75b5-4507-aac7-21620479209b" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:54:19 user nova-compute[231753]: INFO nova.compute.manager [None req-44464968-15ee-4ed5-ace7-733201cdf2c1 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Detaching volume 0946e095-4f9b-4a32-8295-a2db87abd304
Jul 29 13:54:19 user nova-compute[231753]: INFO nova.virt.block_device [None req-44464968-15ee-4ed5-ace7-733201cdf2c1 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Attempting to driver detach volume 0946e095-4f9b-4a32-8295-a2db87abd304 from mountpoint /dev/vdc
Jul 29 13:54:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-44464968-15ee-4ed5-ace7-733201cdf2c1 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Attempting to detach device vdc from instance 8e153c4d-75b5-4507-aac7-21620479209b from the persistent domain config. {{(pid=231753) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 13:54:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-44464968-15ee-4ed5-ace7-733201cdf2c1 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:54:19 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:54:19 user nova-compute[231753]:   <source dev="/dev/sdh"/>
Jul 29 13:54:19 user nova-compute[231753]:   <target dev="vdc" bus="virtio"/>
Jul 29 13:54:19 user nova-compute[231753]:   <serial>0946e095-4f9b-4a32-8295-a2db87abd304</serial>
Jul 29 13:54:19 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 29 13:54:19 user nova-compute[231753]: </disk>
Jul 29 13:54:19 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:54:19 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance cf326e80-7293-4764-9411-ed05a5aeba23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:54:19 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b99a72ba-73e2-4be7-b52b-7797351daa5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:54:19 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b6be450b-ebe7-4385-b162-2d072237aa97 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:54:19 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:54:19 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 97e71bc1-78c8-4cec-a935-878dd08ff941 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:54:19 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8e153c4d-75b5-4507-aac7-21620479209b actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:54:19 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 1c4a953b-67c9-4c69-950a-7487735e917c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:54:19 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance a3f9ad53-db31-404a-8442-37cf53f11cbc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:54:19 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 8 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 13:54:19 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=4608MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=8 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 13:54:19 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-44464968-15ee-4ed5-ace7-733201cdf2c1 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Successfully detached device vdc from instance 8e153c4d-75b5-4507-aac7-21620479209b from the persistent domain config.
Jul 29 13:54:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-44464968-15ee-4ed5-ace7-733201cdf2c1 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] (1/8): Attempting to detach device vdc with device alias virtio-disk2 from instance 8e153c4d-75b5-4507-aac7-21620479209b from the live domain config. {{(pid=231753) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 13:54:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-44464968-15ee-4ed5-ace7-733201cdf2c1 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:54:19 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:54:19 user nova-compute[231753]:   <source dev="/dev/sdh"/>
Jul 29 13:54:19 user nova-compute[231753]:   <target dev="vdc" bus="virtio"/>
Jul 29 13:54:19 user nova-compute[231753]:   <serial>0946e095-4f9b-4a32-8295-a2db87abd304</serial>
Jul 29 13:54:19 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x08" function="0x0"/>
Jul 29 13:54:19 user nova-compute[231753]: </disk>
Jul 29 13:54:19 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:54:19 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:54:19 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:54:19 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 13:54:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.538s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Received event <DeviceRemovedEvent: 1690638860.022952, 8e153c4d-75b5-4507-aac7-21620479209b => virtio-disk2> from libvirt while the driver is waiting for it; dispatched. {{(pid=231753) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-44464968-15ee-4ed5-ace7-733201cdf2c1 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Start waiting for the detach event from libvirt for device vdc with device alias virtio-disk2 for instance 8e153c4d-75b5-4507-aac7-21620479209b {{(pid=231753) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 13:54:20 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-44464968-15ee-4ed5-ace7-733201cdf2c1 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Successfully detached device vdc from instance 8e153c4d-75b5-4507-aac7-21620479209b from the live domain config.
Jul 29 13:54:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44464968-15ee-4ed5-ace7-733201cdf2c1 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-44464968-15ee-4ed5-ace7-733201cdf2c1 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'LUnrRuFX', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdh'}, None), 'kwargs': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:54:20 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-44464968-15ee-4ed5-ace7-733201cdf2c1 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:54:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-44464968-15ee-4ed5-ace7-733201cdf2c1 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-44464968-15ee-4ed5-ace7-733201cdf2c1 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb01dc22-492f-4587-ab45-e63a207bd9a6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-44464968-15ee-4ed5-ace7-733201cdf2c1 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:54:20 user nova-compute[231753]: No targets found.
Jul 29 13:54:20 user nova-compute[231753]: iSNS:
Jul 29 13:54:20 user nova-compute[231753]: No targets found.
Jul 29 13:54:20 user nova-compute[231753]: STATIC:
Jul 29 13:54:20 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea
Jul 29 13:54:20 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:54:20 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:54:20 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf
Jul 29 13:54:20 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:54:20 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:54:20 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699
Jul 29 13:54:20 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:54:20 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:54:20 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304
Jul 29 13:54:20 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:54:20 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:54:20 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a
Jul 29 13:54:20 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:54:20 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:54:20 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271
Jul 29 13:54:20 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:54:20 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:54:20 user nova-compute[231753]: FIRMWARE:
Jul 29 13:54:20 user nova-compute[231753]: No targets found.
Jul 29 13:54:20 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-44464968-15ee-4ed5-ace7-733201cdf2c1 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:54:20 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:54:20 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-44464968-15ee-4ed5-ace7-733201cdf2c1 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d93c79-88bc-44dd-818d-ecfef733fcf5]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6ed24c5-9c8e-43f9-ad9e-5b0d30868593]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 (non-flash)\ntcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-44464968-15ee-4ed5-ace7-733201cdf2c1 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:54:20 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:54:20 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:54:20 user nova-compute[231753]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)
Jul 29 13:54:20 user nova-compute[231753]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 (non-flash)
Jul 29 13:54:20 user nova-compute[231753]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304 (non-flash)
Jul 29 13:54:20 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-44464968-15ee-4ed5-ace7-733201cdf2c1 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:54:20 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:54:20 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:54:20 user nova-compute[231753]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)
Jul 29 13:54:20 user nova-compute[231753]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 (non-flash)
Jul 29 13:54:20 user nova-compute[231753]: tcp: [47] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304 (non-flash)
Jul 29 13:54:20 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-44464968-15ee-4ed5-ace7-733201cdf2c1 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ca69a5630>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304'): ({'sdh'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-44464968-15ee-4ed5-ace7-733201cdf2c1 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Removing single pathed devices sdh {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fb90de-1a03-4f27-9d35-cb1f4cd111e2]: (4, ('path checker states:\nup                  6\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdh {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdh" returned: 0 in 0.105s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee128d4c-f372-4efd-8a93-bb1e91fe0c3e]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-44464968-15ee-4ed5-ace7-733201cdf2c1 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Flushing IO for device /dev/sdh {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdh {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdh" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[41d25c56-bc2b-43c8-a79b-32500c74f248]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-44464968-15ee-4ed5-ace7-733201cdf2c1 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdh/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdh/device/delete" returned: 0 in 0.041s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[709a54e6-8072-4c0b-882a-0899e73e1afb]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-44464968-15ee-4ed5-ace7-733201cdf2c1 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Checking to see if SCSI volumes sdh have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-44464968-15ee-4ed5-ace7-733201cdf2c1 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] SCSI volumes sdh have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-44464968-15ee-4ed5-ace7-733201cdf2c1 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7d12204-ded0-4a2e-8c1f-e3fe80cc94b4]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-44464968-15ee-4ed5-ace7-733201cdf2c1 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304 -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "refresh_cache-cf326e80-7293-4764-9411-ed05a5aeba23" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquired lock "refresh_cache-cf326e80-7293-4764-9411-ed05a5aeba23" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Forcefully refreshing network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304 -p 172.16.0.220:3260 --logout" returned: 0 in 0.075s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[78af32dd-6941-4271-8283-220315b3454f]: (4, ('Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304, portal: 172.16.0.220,3260]\nLogout of [sid: 47, target: iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-44464968-15ee-4ed5-ace7-733201cdf2c1 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 47, target: iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304, portal: 172.16.0.220,3260]
Jul 29 13:54:20 user nova-compute[231753]: Logout of [sid: 47, target: iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304, portal: 172.16.0.220,3260] successful.
Jul 29 13:54:20 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304 -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:0946e095-4f9b-4a32-8295-a2db87abd304 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.030s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f151c15-b78b-4c2c-843e-ee97b44960f7]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-44464968-15ee-4ed5-ace7-733201cdf2c1 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-44464968-15ee-4ed5-ace7-733201cdf2c1 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.448s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-44464968-15ee-4ed5-ace7-733201cdf2c1 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] <== disconnect_volume: return (450ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:54:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-44464968-15ee-4ed5-ace7-733201cdf2c1 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:54:21 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Updating instance_info_cache with network_info: [{"id": "fbd63de1-966b-4791-8c72-6a5e2d26a7e2", "address": "fa:16:3e:09:75:c0", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd63de1-96", "ovs_interfaceid": "fbd63de1-966b-4791-8c72-6a5e2d26a7e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:54:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Releasing lock "refresh_cache-cf326e80-7293-4764-9411-ed05a5aeba23" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:54:21 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Updated the network info_cache for instance {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 13:54:21 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:54:21 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:54:21 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Cleaning up deleted instances with incomplete migration  {{(pid=231753) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 29 13:54:21 user nova-compute[231753]: DEBUG nova.objects.instance [None req-44464968-15ee-4ed5-ace7-733201cdf2c1 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lazy-loading 'flavor' on Instance uuid 8e153c4d-75b5-4507-aac7-21620479209b {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:54:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-44464968-15ee-4ed5-ace7-733201cdf2c1 tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "8e153c4d-75b5-4507-aac7-21620479209b" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.040s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:54:21 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:54:21 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 13:54:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6e7de9f1-af19-4757-8f6a-3929c050c66c tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "8e153c4d-75b5-4507-aac7-21620479209b" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:54:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6e7de9f1-af19-4757-8f6a-3929c050c66c tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "8e153c4d-75b5-4507-aac7-21620479209b" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:54:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6e7de9f1-af19-4757-8f6a-3929c050c66c tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "8e153c4d-75b5-4507-aac7-21620479209b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:54:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6e7de9f1-af19-4757-8f6a-3929c050c66c tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "8e153c4d-75b5-4507-aac7-21620479209b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:54:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6e7de9f1-af19-4757-8f6a-3929c050c66c tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "8e153c4d-75b5-4507-aac7-21620479209b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:54:22 user nova-compute[231753]: INFO nova.compute.manager [None req-6e7de9f1-af19-4757-8f6a-3929c050c66c tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Terminating instance
Jul 29 13:54:22 user nova-compute[231753]: DEBUG nova.compute.manager [None req-6e7de9f1-af19-4757-8f6a-3929c050c66c tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:54:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:54:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:54:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:54:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:54:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:54:22 user nova-compute[231753]: DEBUG nova.compute.manager [req-5a6a9475-845f-436f-b4f6-156e3e177f0c req-9d39c357-cf68-4a16-b196-01962dc3b0c6 service nova] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Received event network-vif-unplugged-259c966b-ba73-42ca-9f38-7cba6bdc671c {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:54:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5a6a9475-845f-436f-b4f6-156e3e177f0c req-9d39c357-cf68-4a16-b196-01962dc3b0c6 service nova] Acquiring lock "8e153c4d-75b5-4507-aac7-21620479209b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:54:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5a6a9475-845f-436f-b4f6-156e3e177f0c req-9d39c357-cf68-4a16-b196-01962dc3b0c6 service nova] Lock "8e153c4d-75b5-4507-aac7-21620479209b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:54:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5a6a9475-845f-436f-b4f6-156e3e177f0c req-9d39c357-cf68-4a16-b196-01962dc3b0c6 service nova] Lock "8e153c4d-75b5-4507-aac7-21620479209b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:54:22 user nova-compute[231753]: DEBUG nova.compute.manager [req-5a6a9475-845f-436f-b4f6-156e3e177f0c req-9d39c357-cf68-4a16-b196-01962dc3b0c6 service nova] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] No waiting events found dispatching network-vif-unplugged-259c966b-ba73-42ca-9f38-7cba6bdc671c {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:54:22 user nova-compute[231753]: DEBUG nova.compute.manager [req-5a6a9475-845f-436f-b4f6-156e3e177f0c req-9d39c357-cf68-4a16-b196-01962dc3b0c6 service nova] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Received event network-vif-unplugged-259c966b-ba73-42ca-9f38-7cba6bdc671c for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:54:23 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Instance destroyed successfully.
Jul 29 13:54:23 user nova-compute[231753]: DEBUG nova.objects.instance [None req-6e7de9f1-af19-4757-8f6a-3929c050c66c tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lazy-loading 'resources' on Instance uuid 8e153c4d-75b5-4507-aac7-21620479209b {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:54:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-6e7de9f1-af19-4757-8f6a-3929c050c66c tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:51:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-AttachVolumeTestJSON-server-896554044',display_name='tempest-AttachVolumeTestJSON-server-896554044',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-attachvolumetestjson-server-896554044',id=38,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB9IE6nSuVWJK41sX7BdajBXy6W41BPt0CXAIFZk19avwqF3lPYOXRAfcl7i6fRXc7WNirxpNsvUDclGK9D6D0AErb6WR3iw7Hlx2F2qbX/SyYE9P7wDuj1Uh1NXox7aFQ==',key_name='tempest-keypair-525173827',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:52:01Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4a8801c6bc4b46ef9b407426c5eb07e0',ramdisk_id='',reservation_id='r-f1jvzamr',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeTestJSON-695592502',owner_user_name='tempest-AttachVolumeTestJSON-695592502-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:52:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='df1ccafc63e0418e9889541bb8ecd3d2',uuid=8e153c4d-75b5-4507-aac7-21620479209b,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "259c966b-ba73-42ca-9f38-7cba6bdc671c", "address": "fa:16:3e:4f:c8:e7", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259c966b-ba", "ovs_interfaceid": "259c966b-ba73-42ca-9f38-7cba6bdc671c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:54:23 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-6e7de9f1-af19-4757-8f6a-3929c050c66c tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Converting VIF {"id": "259c966b-ba73-42ca-9f38-7cba6bdc671c", "address": "fa:16:3e:4f:c8:e7", "network": {"id": "dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9", "bridge": "br-int", "label": "tempest-AttachVolumeTestJSON-279781522-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.124", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4a8801c6bc4b46ef9b407426c5eb07e0", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap259c966b-ba", "ovs_interfaceid": "259c966b-ba73-42ca-9f38-7cba6bdc671c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:54:23 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-6e7de9f1-af19-4757-8f6a-3929c050c66c tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4f:c8:e7,bridge_name='br-int',has_traffic_filtering=True,id=259c966b-ba73-42ca-9f38-7cba6bdc671c,network=Network(dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap259c966b-ba') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:54:23 user nova-compute[231753]: DEBUG os_vif [None req-6e7de9f1-af19-4757-8f6a-3929c050c66c tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:c8:e7,bridge_name='br-int',has_traffic_filtering=True,id=259c966b-ba73-42ca-9f38-7cba6bdc671c,network=Network(dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap259c966b-ba') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:54:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:54:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap259c966b-ba, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:54:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:54:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:54:23 user nova-compute[231753]: INFO os_vif [None req-6e7de9f1-af19-4757-8f6a-3929c050c66c tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4f:c8:e7,bridge_name='br-int',has_traffic_filtering=True,id=259c966b-ba73-42ca-9f38-7cba6bdc671c,network=Network(dfcb0ba2-4225-4b9b-b5c9-c9620eb08fc9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap259c966b-ba')
Jul 29 13:54:23 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-6e7de9f1-af19-4757-8f6a-3929c050c66c tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Deleting instance files /opt/stack/data/nova/instances/8e153c4d-75b5-4507-aac7-21620479209b_del
Jul 29 13:54:23 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-6e7de9f1-af19-4757-8f6a-3929c050c66c tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Deletion of /opt/stack/data/nova/instances/8e153c4d-75b5-4507-aac7-21620479209b_del complete
Jul 29 13:54:23 user nova-compute[231753]: INFO nova.compute.manager [None req-6e7de9f1-af19-4757-8f6a-3929c050c66c tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 29 13:54:23 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-6e7de9f1-af19-4757-8f6a-3929c050c66c tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:54:23 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:54:23 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:54:24 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:54:24 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:54:24 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:54:24 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:54:24 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Took 0.95 seconds to deallocate network for instance.
Jul 29 13:54:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6e7de9f1-af19-4757-8f6a-3929c050c66c tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:54:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6e7de9f1-af19-4757-8f6a-3929c050c66c tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:54:24 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-6e7de9f1-af19-4757-8f6a-3929c050c66c tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Refreshing inventories for resource provider 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 29 13:54:24 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-6e7de9f1-af19-4757-8f6a-3929c050c66c tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Updating ProviderTree inventory for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 29 13:54:24 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-6e7de9f1-af19-4757-8f6a-3929c050c66c tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Updating inventory in ProviderTree for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 29 13:54:24 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-6e7de9f1-af19-4757-8f6a-3929c050c66c tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Refreshing aggregate associations for resource provider 222db5c7-e17f-4307-968d-4284bf5c19f4, aggregates: None {{(pid=231753) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 29 13:54:24 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-6e7de9f1-af19-4757-8f6a-3929c050c66c tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Refreshing trait associations for resource provider 222db5c7-e17f-4307-968d-4284bf5c19f4, traits: HW_CPU_X86_SSSE3,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_VIRTIO {{(pid=231753) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 29 13:54:24 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-6e7de9f1-af19-4757-8f6a-3929c050c66c tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:54:24 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-6e7de9f1-af19-4757-8f6a-3929c050c66c tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:54:25 user nova-compute[231753]: DEBUG nova.compute.manager [req-bb65658f-bb64-435b-8c22-a8ece4e96cf0 req-a0c7daa6-ada6-427f-8616-ce93a1a865c1 service nova] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Received event network-vif-plugged-259c966b-ba73-42ca-9f38-7cba6bdc671c {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:54:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bb65658f-bb64-435b-8c22-a8ece4e96cf0 req-a0c7daa6-ada6-427f-8616-ce93a1a865c1 service nova] Acquiring lock "8e153c4d-75b5-4507-aac7-21620479209b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:54:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bb65658f-bb64-435b-8c22-a8ece4e96cf0 req-a0c7daa6-ada6-427f-8616-ce93a1a865c1 service nova] Lock "8e153c4d-75b5-4507-aac7-21620479209b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:54:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bb65658f-bb64-435b-8c22-a8ece4e96cf0 req-a0c7daa6-ada6-427f-8616-ce93a1a865c1 service nova] Lock "8e153c4d-75b5-4507-aac7-21620479209b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:54:25 user nova-compute[231753]: DEBUG nova.compute.manager [req-bb65658f-bb64-435b-8c22-a8ece4e96cf0 req-a0c7daa6-ada6-427f-8616-ce93a1a865c1 service nova] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] No waiting events found dispatching network-vif-plugged-259c966b-ba73-42ca-9f38-7cba6bdc671c {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:54:25 user nova-compute[231753]: WARNING nova.compute.manager [req-bb65658f-bb64-435b-8c22-a8ece4e96cf0 req-a0c7daa6-ada6-427f-8616-ce93a1a865c1 service nova] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Received unexpected event network-vif-plugged-259c966b-ba73-42ca-9f38-7cba6bdc671c for instance with vm_state deleted and task_state None.
Jul 29 13:54:25 user nova-compute[231753]: DEBUG nova.compute.manager [req-bb65658f-bb64-435b-8c22-a8ece4e96cf0 req-a0c7daa6-ada6-427f-8616-ce93a1a865c1 service nova] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Received event network-vif-deleted-259c966b-ba73-42ca-9f38-7cba6bdc671c {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:54:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6e7de9f1-af19-4757-8f6a-3929c050c66c tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.584s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:54:25 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-6e7de9f1-af19-4757-8f6a-3929c050c66c tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Deleted allocations for instance 8e153c4d-75b5-4507-aac7-21620479209b
Jul 29 13:54:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-6e7de9f1-af19-4757-8f6a-3929c050c66c tempest-AttachVolumeTestJSON-695592502 tempest-AttachVolumeTestJSON-695592502-project-member] Lock "8e153c4d-75b5-4507-aac7-21620479209b" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.596s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:54:25 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:54:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:54:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:54:30 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:54:30 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Cleaning up deleted instances {{(pid=231753) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 29 13:54:30 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] There are 0 instances to clean {{(pid=231753) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 29 13:54:30 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:54:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:54:38 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690638863.3196845, 8e153c4d-75b5-4507-aac7-21620479209b => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:54:38 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] VM Stopped (Lifecycle Event)
Jul 29 13:54:38 user nova-compute[231753]: DEBUG nova.compute.manager [None req-1def5d5c-12cc-4e26-b5e3-6a39b669c127 None None] [instance: 8e153c4d-75b5-4507-aac7-21620479209b] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:54:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:54:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:54:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:54:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:54:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-4b76d724-ebe0-4ca4-a6ed-6b56d7e63076 req-52593caf-9e97-4813-abec-2d9aaac5782a service nova] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Received event network-changed-da91541f-4471-455f-adf7-cfa9eb63de88 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:54:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-4b76d724-ebe0-4ca4-a6ed-6b56d7e63076 req-52593caf-9e97-4813-abec-2d9aaac5782a service nova] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Refreshing instance network info cache due to event network-changed-da91541f-4471-455f-adf7-cfa9eb63de88. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:54:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4b76d724-ebe0-4ca4-a6ed-6b56d7e63076 req-52593caf-9e97-4813-abec-2d9aaac5782a service nova] Acquiring lock "refresh_cache-1c4a953b-67c9-4c69-950a-7487735e917c" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:54:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4b76d724-ebe0-4ca4-a6ed-6b56d7e63076 req-52593caf-9e97-4813-abec-2d9aaac5782a service nova] Acquired lock "refresh_cache-1c4a953b-67c9-4c69-950a-7487735e917c" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:54:44 user nova-compute[231753]: DEBUG nova.network.neutron [req-4b76d724-ebe0-4ca4-a6ed-6b56d7e63076 req-52593caf-9e97-4813-abec-2d9aaac5782a service nova] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Refreshing network info cache for port da91541f-4471-455f-adf7-cfa9eb63de88 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:54:44 user nova-compute[231753]: DEBUG nova.network.neutron [req-4b76d724-ebe0-4ca4-a6ed-6b56d7e63076 req-52593caf-9e97-4813-abec-2d9aaac5782a service nova] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Updated VIF entry in instance network info cache for port da91541f-4471-455f-adf7-cfa9eb63de88. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:54:44 user nova-compute[231753]: DEBUG nova.network.neutron [req-4b76d724-ebe0-4ca4-a6ed-6b56d7e63076 req-52593caf-9e97-4813-abec-2d9aaac5782a service nova] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Updating instance_info_cache with network_info: [{"id": "da91541f-4471-455f-adf7-cfa9eb63de88", "address": "fa:16:3e:3d:fe:a2", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda91541f-44", "ovs_interfaceid": "da91541f-4471-455f-adf7-cfa9eb63de88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:54:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4b76d724-ebe0-4ca4-a6ed-6b56d7e63076 req-52593caf-9e97-4813-abec-2d9aaac5782a service nova] Releasing lock "refresh_cache-1c4a953b-67c9-4c69-950a-7487735e917c" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:54:47 user nova-compute[231753]: DEBUG nova.compute.manager [req-300c2ef1-90ee-430d-9dd9-d03bd84043c5 req-b9bcaea3-da18-41e0-a5f9-b9e19cea4219 service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Received event network-changed-b6be4498-da79-4335-9f95-6a191a4ce127 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:54:47 user nova-compute[231753]: DEBUG nova.compute.manager [req-300c2ef1-90ee-430d-9dd9-d03bd84043c5 req-b9bcaea3-da18-41e0-a5f9-b9e19cea4219 service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Refreshing instance network info cache due to event network-changed-b6be4498-da79-4335-9f95-6a191a4ce127. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:54:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-300c2ef1-90ee-430d-9dd9-d03bd84043c5 req-b9bcaea3-da18-41e0-a5f9-b9e19cea4219 service nova] Acquiring lock "refresh_cache-a3f9ad53-db31-404a-8442-37cf53f11cbc" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:54:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-300c2ef1-90ee-430d-9dd9-d03bd84043c5 req-b9bcaea3-da18-41e0-a5f9-b9e19cea4219 service nova] Acquired lock "refresh_cache-a3f9ad53-db31-404a-8442-37cf53f11cbc" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:54:47 user nova-compute[231753]: DEBUG nova.network.neutron [req-300c2ef1-90ee-430d-9dd9-d03bd84043c5 req-b9bcaea3-da18-41e0-a5f9-b9e19cea4219 service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Refreshing network info cache for port b6be4498-da79-4335-9f95-6a191a4ce127 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:54:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Acquiring lock "a3f9ad53-db31-404a-8442-37cf53f11cbc" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:54:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lock "a3f9ad53-db31-404a-8442-37cf53f11cbc" acquired by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:54:47 user nova-compute[231753]: INFO nova.compute.manager [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Shelve offloading
Jul 29 13:54:47 user nova-compute[231753]: DEBUG nova.network.neutron [req-300c2ef1-90ee-430d-9dd9-d03bd84043c5 req-b9bcaea3-da18-41e0-a5f9-b9e19cea4219 service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Updated VIF entry in instance network info cache for port b6be4498-da79-4335-9f95-6a191a4ce127. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:54:47 user nova-compute[231753]: DEBUG nova.network.neutron [req-300c2ef1-90ee-430d-9dd9-d03bd84043c5 req-b9bcaea3-da18-41e0-a5f9-b9e19cea4219 service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Updating instance_info_cache with network_info: [{"id": "b6be4498-da79-4335-9f95-6a191a4ce127", "address": "fa:16:3e:c2:b5:20", "network": {"id": "e36e72a2-fbed-483c-827c-436fa6786390", "bridge": "br-int", "label": "tempest-TestShelveInstance-2100930356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b552c0991c456eb101472ca6777f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6be4498-da", "ovs_interfaceid": "b6be4498-da79-4335-9f95-6a191a4ce127", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:54:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-300c2ef1-90ee-430d-9dd9-d03bd84043c5 req-b9bcaea3-da18-41e0-a5f9-b9e19cea4219 service nova] Releasing lock "refresh_cache-a3f9ad53-db31-404a-8442-37cf53f11cbc" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:54:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:54:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:54:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:54:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:54:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:54:48 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Instance destroyed successfully.
Jul 29 13:54:48 user nova-compute[231753]: DEBUG nova.compute.manager [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:54:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Acquiring lock "refresh_cache-a3f9ad53-db31-404a-8442-37cf53f11cbc" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:54:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Acquired lock "refresh_cache-a3f9ad53-db31-404a-8442-37cf53f11cbc" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:54:48 user nova-compute[231753]: DEBUG nova.network.neutron [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:54:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:54:49 user nova-compute[231753]: DEBUG nova.compute.manager [req-cd28e681-c0fc-43bc-9c71-5c9378a88b18 req-6be32410-063f-45aa-9f4c-0e8d381a1537 service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Received event network-vif-unplugged-b6be4498-da79-4335-9f95-6a191a4ce127 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:54:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-cd28e681-c0fc-43bc-9c71-5c9378a88b18 req-6be32410-063f-45aa-9f4c-0e8d381a1537 service nova] Acquiring lock "a3f9ad53-db31-404a-8442-37cf53f11cbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:54:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-cd28e681-c0fc-43bc-9c71-5c9378a88b18 req-6be32410-063f-45aa-9f4c-0e8d381a1537 service nova] Lock "a3f9ad53-db31-404a-8442-37cf53f11cbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:54:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-cd28e681-c0fc-43bc-9c71-5c9378a88b18 req-6be32410-063f-45aa-9f4c-0e8d381a1537 service nova] Lock "a3f9ad53-db31-404a-8442-37cf53f11cbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:54:49 user nova-compute[231753]: DEBUG nova.compute.manager [req-cd28e681-c0fc-43bc-9c71-5c9378a88b18 req-6be32410-063f-45aa-9f4c-0e8d381a1537 service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] No waiting events found dispatching network-vif-unplugged-b6be4498-da79-4335-9f95-6a191a4ce127 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:54:49 user nova-compute[231753]: WARNING nova.compute.manager [req-cd28e681-c0fc-43bc-9c71-5c9378a88b18 req-6be32410-063f-45aa-9f4c-0e8d381a1537 service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Received unexpected event network-vif-unplugged-b6be4498-da79-4335-9f95-6a191a4ce127 for instance with vm_state active and task_state shelving.
Jul 29 13:54:49 user nova-compute[231753]: DEBUG nova.compute.manager [req-cd28e681-c0fc-43bc-9c71-5c9378a88b18 req-6be32410-063f-45aa-9f4c-0e8d381a1537 service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Received event network-vif-plugged-b6be4498-da79-4335-9f95-6a191a4ce127 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:54:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-cd28e681-c0fc-43bc-9c71-5c9378a88b18 req-6be32410-063f-45aa-9f4c-0e8d381a1537 service nova] Acquiring lock "a3f9ad53-db31-404a-8442-37cf53f11cbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:54:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-cd28e681-c0fc-43bc-9c71-5c9378a88b18 req-6be32410-063f-45aa-9f4c-0e8d381a1537 service nova] Lock "a3f9ad53-db31-404a-8442-37cf53f11cbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:54:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-cd28e681-c0fc-43bc-9c71-5c9378a88b18 req-6be32410-063f-45aa-9f4c-0e8d381a1537 service nova] Lock "a3f9ad53-db31-404a-8442-37cf53f11cbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:54:49 user nova-compute[231753]: DEBUG nova.compute.manager [req-cd28e681-c0fc-43bc-9c71-5c9378a88b18 req-6be32410-063f-45aa-9f4c-0e8d381a1537 service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] No waiting events found dispatching network-vif-plugged-b6be4498-da79-4335-9f95-6a191a4ce127 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:54:49 user nova-compute[231753]: WARNING nova.compute.manager [req-cd28e681-c0fc-43bc-9c71-5c9378a88b18 req-6be32410-063f-45aa-9f4c-0e8d381a1537 service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Received unexpected event network-vif-plugged-b6be4498-da79-4335-9f95-6a191a4ce127 for instance with vm_state active and task_state shelving.
Jul 29 13:54:49 user nova-compute[231753]: DEBUG nova.network.neutron [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Updating instance_info_cache with network_info: [{"id": "b6be4498-da79-4335-9f95-6a191a4ce127", "address": "fa:16:3e:c2:b5:20", "network": {"id": "e36e72a2-fbed-483c-827c-436fa6786390", "bridge": "br-int", "label": "tempest-TestShelveInstance-2100930356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b552c0991c456eb101472ca6777f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6be4498-da", "ovs_interfaceid": "b6be4498-da79-4335-9f95-6a191a4ce127", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:54:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Releasing lock "refresh_cache-a3f9ad53-db31-404a-8442-37cf53f11cbc" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:54:50 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Instance destroyed successfully.
Jul 29 13:54:50 user nova-compute[231753]: DEBUG nova.objects.instance [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lazy-loading 'resources' on Instance uuid a3f9ad53-db31-404a-8442-37cf53f11cbc {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:52:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2135603216',display_name='tempest-TestShelveInstance-server-2135603216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2135603216',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUKilSQcjDTu+cgwtmk8BQ6EjoQq0ApEPABTW7D4u0KoVMoLIZVjeebdmok5ki73AVOSz5g4howD++ogO973qWj4XNZQyc+wqIw+w41ZPmWJLZZo3ziBpQVpEeJBldBeA==',key_name='tempest-TestShelveInstance-537474645',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:53:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=<?>,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06b552c0991c456eb101472ca6777f19',ramdisk_id='',reservation_id='r-g6l31lk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-108803446',owner_user_name='tempest-TestShelveInstance-108803446-project-member'},tags=<?>,task_state='shelving',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:53:11Z,user_data=None,user_id='3d35af1d300041a2b0fd8039d1a4b623',uuid=a3f9ad53-db31-404a-8442-37cf53f11cbc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6be4498-da79-4335-9f95-6a191a4ce127", "address": "fa:16:3e:c2:b5:20", "network": {"id": "e36e72a2-fbed-483c-827c-436fa6786390", "bridge": "br-int", "label": "tempest-TestShelveInstance-2100930356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b552c0991c456eb101472ca6777f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6be4498-da", "ovs_interfaceid": "b6be4498-da79-4335-9f95-6a191a4ce127", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Converting VIF {"id": "b6be4498-da79-4335-9f95-6a191a4ce127", "address": "fa:16:3e:c2:b5:20", "network": {"id": "e36e72a2-fbed-483c-827c-436fa6786390", "bridge": "br-int", "label": "tempest-TestShelveInstance-2100930356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b552c0991c456eb101472ca6777f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6be4498-da", "ovs_interfaceid": "b6be4498-da79-4335-9f95-6a191a4ce127", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:b5:20,bridge_name='br-int',has_traffic_filtering=True,id=b6be4498-da79-4335-9f95-6a191a4ce127,network=Network(e36e72a2-fbed-483c-827c-436fa6786390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6be4498-da') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG os_vif [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:b5:20,bridge_name='br-int',has_traffic_filtering=True,id=b6be4498-da79-4335-9f95-6a191a4ce127,network=Network(e36e72a2-fbed-483c-827c-436fa6786390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6be4498-da') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6be4498-da, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:54:50 user nova-compute[231753]: INFO os_vif [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:b5:20,bridge_name='br-int',has_traffic_filtering=True,id=b6be4498-da79-4335-9f95-6a191a4ce127,network=Network(e36e72a2-fbed-483c-827c-436fa6786390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6be4498-da')
Jul 29 13:54:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZYvkJSh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:54:50 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:54:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG nova.compute.manager [req-6fe66749-69e2-43de-b99a-2055b4343fb4 req-06d002c1-ee78-49a1-9616-f4b0f321467f service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Received event network-changed-b6be4498-da79-4335-9f95-6a191a4ce127 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG nova.compute.manager [req-6fe66749-69e2-43de-b99a-2055b4343fb4 req-06d002c1-ee78-49a1-9616-f4b0f321467f service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Refreshing instance network info cache due to event network-changed-b6be4498-da79-4335-9f95-6a191a4ce127. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6fe66749-69e2-43de-b99a-2055b4343fb4 req-06d002c1-ee78-49a1-9616-f4b0f321467f service nova] Acquiring lock "refresh_cache-a3f9ad53-db31-404a-8442-37cf53f11cbc" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6fe66749-69e2-43de-b99a-2055b4343fb4 req-06d002c1-ee78-49a1-9616-f4b0f321467f service nova] Acquired lock "refresh_cache-a3f9ad53-db31-404a-8442-37cf53f11cbc" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG nova.network.neutron [req-6fe66749-69e2-43de-b99a-2055b4343fb4 req-06d002c1-ee78-49a1-9616-f4b0f321467f service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Refreshing network info cache for port b6be4498-da79-4335-9f95-6a191a4ce127 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.037s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf88d01d-7947-467e-8c67-857707c815f0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:54:50 user nova-compute[231753]: No targets found.
Jul 29 13:54:50 user nova-compute[231753]: iSNS:
Jul 29 13:54:50 user nova-compute[231753]: No targets found.
Jul 29 13:54:50 user nova-compute[231753]: STATIC:
Jul 29 13:54:50 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea
Jul 29 13:54:50 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:54:50 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:54:50 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf
Jul 29 13:54:50 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:54:50 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:54:50 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699
Jul 29 13:54:50 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:54:50 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:54:50 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a
Jul 29 13:54:50 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:54:50 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:54:50 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271
Jul 29 13:54:50 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:54:50 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:54:50 user nova-compute[231753]: FIRMWARE:
Jul 29 13:54:50 user nova-compute[231753]: No targets found.
Jul 29 13:54:50 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:54:50 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:54:50 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b86c8c5b-9806-40fa-a778-62f6b49731d3]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.030s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec17c235-81f8-436b-a06e-adfcaef9420f]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)\ntcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:54:50 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:54:50 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:54:50 user nova-compute[231753]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)
Jul 29 13:54:50 user nova-compute[231753]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 (non-flash)
Jul 29 13:54:50 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:54:50 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:54:50 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:54:50 user nova-compute[231753]: tcp: [44] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)
Jul 29 13:54:50 user nova-compute[231753]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 (non-flash)
Jul 29 13:54:50 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c803477f0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf'): ({'sde'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Removing single pathed devices sde {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[51f61e47-8d44-48bf-86ac-5b1c76745586]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aa3ce28-548b-4db2-8050-08e503256227]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Flushing IO for device /dev/sde {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[09940bb2-0a8e-4743-b716-a172202dba73]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.049s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[81f15288-8012-402a-abd4-1ee29e1e8b9d]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] SCSI volumes sde have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.027s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4cb7723-6160-48a6-a25e-f45640a90478]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[42a034c6-3925-46c7-9fee-6fcdc6048e88]: (4, ('Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf, portal: 172.16.0.220,3260]\nLogout of [sid: 44, target: iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf, portal: 172.16.0.220,3260]
Jul 29 13:54:50 user nova-compute[231753]: Logout of [sid: 44, target: iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf, portal: 172.16.0.220,3260] successful.
Jul 29 13:54:50 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:54:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.031s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:51 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[be8c0134-351b-47d1-85ee-57218852f209]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:51 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:54:51 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.368s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:54:51 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] <== disconnect_volume: return (369ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:54:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:54:51 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Deleting instance files /opt/stack/data/nova/instances/a3f9ad53-db31-404a-8442-37cf53f11cbc_del
Jul 29 13:54:51 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Deletion of /opt/stack/data/nova/instances/a3f9ad53-db31-404a-8442-37cf53f11cbc_del complete
Jul 29 13:54:51 user nova-compute[231753]: DEBUG nova.network.neutron [req-6fe66749-69e2-43de-b99a-2055b4343fb4 req-06d002c1-ee78-49a1-9616-f4b0f321467f service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Updated VIF entry in instance network info cache for port b6be4498-da79-4335-9f95-6a191a4ce127. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:54:51 user nova-compute[231753]: DEBUG nova.network.neutron [req-6fe66749-69e2-43de-b99a-2055b4343fb4 req-06d002c1-ee78-49a1-9616-f4b0f321467f service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Updating instance_info_cache with network_info: [{"id": "b6be4498-da79-4335-9f95-6a191a4ce127", "address": "fa:16:3e:c2:b5:20", "network": {"id": "e36e72a2-fbed-483c-827c-436fa6786390", "bridge": null, "label": "tempest-TestShelveInstance-2100930356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b552c0991c456eb101472ca6777f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb6be4498-da", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:54:51 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6fe66749-69e2-43de-b99a-2055b4343fb4 req-06d002c1-ee78-49a1-9616-f4b0f321467f service nova] Releasing lock "refresh_cache-a3f9ad53-db31-404a-8442-37cf53f11cbc" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:54:52 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Deleted allocations for instance a3f9ad53-db31-404a-8442-37cf53f11cbc
Jul 29 13:54:52 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:54:52 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:54:52 user nova-compute[231753]: DEBUG nova.objects.instance [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lazy-loading 'numa_topology' on Instance uuid a3f9ad53-db31-404a-8442-37cf53f11cbc {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:54:52 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:54:52 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:54:52 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.270s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:54:52 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-3b2fea71-2d41-428c-967e-870e42856caa tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lock "a3f9ad53-db31-404a-8442-37cf53f11cbc" "released" by "nova.compute.manager.ComputeManager.shelve_offload_instance.<locals>.do_shelve_offload_instance" :: held 4.499s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:54:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "8c62c19f-f13c-4ade-a0ea-a7594c8daa0d" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:54:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "8c62c19f-f13c-4ade-a0ea-a7594c8daa0d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:54:53 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:54:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:54:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:54:53 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:54:53 user nova-compute[231753]: INFO nova.compute.claims [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Claim successful on node user
Jul 29 13:54:53 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:54:53 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:54:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.324s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:54:53 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:54:53 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:54:53 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:54:53 user nova-compute[231753]: DEBUG nova.network.neutron [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:54:53 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:54:54 user nova-compute[231753]: INFO nova.virt.block_device [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Booting with volume snapshot 767a06aa-897a-4961-8fd9-ba6c34cf9999 at /dev/vda
Jul 29 13:54:54 user nova-compute[231753]: DEBUG nova.policy [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd94a7ea0c19845b886e12c1689cf30a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45c92d3fe964066b9be87489b2c9f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:54:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:54:54 user nova-compute[231753]: DEBUG nova.network.neutron [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Successfully created port: 3c17e061-0e8d-4d45-afa6-6179b4f860e2 {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:54:55 user nova-compute[231753]: DEBUG nova.network.neutron [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Successfully updated port: 3c17e061-0e8d-4d45-afa6-6179b4f860e2 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:54:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "refresh_cache-8c62c19f-f13c-4ade-a0ea-a7594c8daa0d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:54:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquired lock "refresh_cache-8c62c19f-f13c-4ade-a0ea-a7594c8daa0d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:54:55 user nova-compute[231753]: DEBUG nova.network.neutron [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:54:55 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:54:55 user nova-compute[231753]: DEBUG nova.compute.manager [req-22592526-6f29-4d2e-bfa3-052588a26538 req-8cd42142-cf6e-43c2-918f-32c72361c926 service nova] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Received event network-changed-3c17e061-0e8d-4d45-afa6-6179b4f860e2 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:54:55 user nova-compute[231753]: DEBUG nova.compute.manager [req-22592526-6f29-4d2e-bfa3-052588a26538 req-8cd42142-cf6e-43c2-918f-32c72361c926 service nova] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Refreshing instance network info cache due to event network-changed-3c17e061-0e8d-4d45-afa6-6179b4f860e2. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:54:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-22592526-6f29-4d2e-bfa3-052588a26538 req-8cd42142-cf6e-43c2-918f-32c72361c926 service nova] Acquiring lock "refresh_cache-8c62c19f-f13c-4ade-a0ea-a7594c8daa0d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:54:55 user nova-compute[231753]: DEBUG nova.network.neutron [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:54:55 user nova-compute[231753]: DEBUG nova.network.neutron [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Updating instance_info_cache with network_info: [{"id": "3c17e061-0e8d-4d45-afa6-6179b4f860e2", "address": "fa:16:3e:2e:56:1e", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c17e061-0e", "ovs_interfaceid": "3c17e061-0e8d-4d45-afa6-6179b4f860e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:54:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Releasing lock "refresh_cache-8c62c19f-f13c-4ade-a0ea-a7594c8daa0d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:54:55 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Instance network_info: |[{"id": "3c17e061-0e8d-4d45-afa6-6179b4f860e2", "address": "fa:16:3e:2e:56:1e", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c17e061-0e", "ovs_interfaceid": "3c17e061-0e8d-4d45-afa6-6179b4f860e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:54:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-22592526-6f29-4d2e-bfa3-052588a26538 req-8cd42142-cf6e-43c2-918f-32c72361c926 service nova] Acquired lock "refresh_cache-8c62c19f-f13c-4ade-a0ea-a7594c8daa0d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:54:55 user nova-compute[231753]: DEBUG nova.network.neutron [req-22592526-6f29-4d2e-bfa3-052588a26538 req-8cd42142-cf6e-43c2-918f-32c72361c926 service nova] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Refreshing network info cache for port 3c17e061-0e8d-4d45-afa6-6179b4f860e2 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:54:56 user nova-compute[231753]: DEBUG nova.network.neutron [req-22592526-6f29-4d2e-bfa3-052588a26538 req-8cd42142-cf6e-43c2-918f-32c72361c926 service nova] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Updated VIF entry in instance network info cache for port 3c17e061-0e8d-4d45-afa6-6179b4f860e2. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:54:56 user nova-compute[231753]: DEBUG nova.network.neutron [req-22592526-6f29-4d2e-bfa3-052588a26538 req-8cd42142-cf6e-43c2-918f-32c72361c926 service nova] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Updating instance_info_cache with network_info: [{"id": "3c17e061-0e8d-4d45-afa6-6179b4f860e2", "address": "fa:16:3e:2e:56:1e", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c17e061-0e", "ovs_interfaceid": "3c17e061-0e8d-4d45-afa6-6179b4f860e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:54:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-22592526-6f29-4d2e-bfa3-052588a26538 req-8cd42142-cf6e-43c2-918f-32c72361c926 service nova] Releasing lock "refresh_cache-8c62c19f-f13c-4ade-a0ea-a7594c8daa0d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:54:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:54:59 user nova-compute[231753]: DEBUG os_brick.utils [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:54:59 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:59 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:59 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc474e6-1da7-4c81-ab4b-a70d38d1bb1a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:59 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:59 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:59 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[17dd0921-bef4-47b5-9a91-2be05743f264]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:59 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:59 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:54:59 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa28b0fd-94b9-4cf4-b0b8-c7753323f551]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:59 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ae72254-c866-44d7-8119-952f2c06cc48]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:59 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:59 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:54:59 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:54:59 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:54:59 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:54:59 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:54:59 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e501a71b-77bc-4b71-802a-812d56c2c3d1]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:54:59 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:54:59 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:54:59 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:54:59 user nova-compute[231753]: DEBUG os_brick.utils [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:54:59 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Updating existing volume attachment record: 1e612e55-b67c-461c-99d9-5acb7d144e15 {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:55:00 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:03 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690638888.7663977, a3f9ad53-db31-404a-8442-37cf53f11cbc => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:55:03 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] VM Stopped (Lifecycle Event)
Jul 29 13:55:03 user nova-compute[231753]: DEBUG nova.compute.manager [None req-08a85ca1-b957-4d78-9034-51fa7d795383 None None] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:55:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:05 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:55:07 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Creating image(s)
Jul 29 13:55:07 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Did not create local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Ensure instance console log exists: /opt/stack/data/nova/instances/8c62c19f-f13c-4ade-a0ea-a7594c8daa0d/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Start _get_guest_xml network_info=[{"id": "3c17e061-0e8d-4d45-afa6-6179b4f860e2", "address": "fa:16:3e:2e:56:1e", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c17e061-0e", "ovs_interfaceid": "3c17e061-0e8d-4d45-afa6-6179b4f860e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-07-29T13:54:46Z,direct_url=<?>,disk_format='qcow2',id=a12c16c2-cd9b-463f-9eb3-5dba5029c430,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1410146799',owner='f45c92d3fe964066b9be87489b2c9f7e',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-07-29T13:54:48Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oHtvyifh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '8c62c19f-f13c-4ade-a0ea-a7594c8daa0d', 'attached_at': '', 'detached_at': '', 'volume_id': '30cd6d38-cf60-4904-a821-0a96b1579abd', 'serial': '30cd6d38-cf60-4904-a821-0a96b1579abd'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'attachment_id': '1e612e55-b67c-461c-99d9-5acb7d144e15', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:55:07 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:55:07 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:55:07 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='d41d8cd98f00b204e9800998ecf8427e',container_format='bare',created_at=2023-07-29T13:54:46Z,direct_url=<?>,disk_format='qcow2',id=a12c16c2-cd9b-463f-9eb3-5dba5029c430,min_disk=1,min_ram=0,name='tempest-TestVolumeBootPatternsnapshot-1410146799',owner='f45c92d3fe964066b9be87489b2c9f7e',properties=ImageMetaProps,protected=<?>,size=0,status='active',tags=<?>,updated_at=2023-07-29T13:54:48Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oHtvyifh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:55:07 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:55:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:55:07 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:55:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:55:07 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:55:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6f7d569-8d49-4174-8a9d-18d2e0043e42]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:55:07 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8152c1ec-6bd4-48e8-95de-8131adc4cba5]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd] added
Jul 29 13:55:07 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[94785be7-e4b4-49bc-8d04-a2ec1998d977]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5133ddd5-b461-42a1-974a-be3065b0cbec]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oHtvyifh {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oHtvyifh" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9344390c-11ed-4983-b1fa-818e883a7ab4]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oHtvyifh'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f07b55-0aa7-476e-aaa3-2d6c03291e4b]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c8145a0-e04c-4138-8367-6bc1455945e6]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:55:07 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:55:07 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:55:07 user nova-compute[231753]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 (non-flash)
Jul 29 13:55:07 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:55:07 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:55:07 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:55:07 user nova-compute[231753]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 (non-flash)
Jul 29 13:55:07 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd -p 172.16.0.220:3260 --login" returned: 0 in 0.065s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[00579d75-2a7a-44ac-a50f-509d3a8444c9]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd, portal: 172.16.0.220,3260]
Jul 29 13:55:07 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd, portal: 172.16.0.220,3260] successful.
Jul 29 13:55:07 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.034s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f4e12f-01c5-482a-92a7-4f972bcc2521]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.028s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a29b991-6581-41a7-8272-32f2e85c10e9]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:55:07 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:55:07 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:55:07 user nova-compute[231753]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 (non-flash)
Jul 29 13:55:07 user nova-compute[231753]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd (non-flash)
Jul 29 13:55:07 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:55:07 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:55:07 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:55:07 user nova-compute[231753]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 (non-flash)
Jul 29 13:55:07 user nova-compute[231753]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd (non-flash)
Jul 29 13:55:07 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.322s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] HCTL ('36', '-', '-', 0) found on session 48 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Scanning host 36 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host36/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host36/scan" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d737be16-976c-4682-9b84-24ef2bd9599f]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Searching for a device in session 48 and hctl ['36', '*', '*', 0] yield: sde {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:55:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Connected to sde using {'target_iqn': 'iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oHtvyifh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:55:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.362s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:55:08 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] <== connect_volume: return (1363ms) {'type': 'block', 'scsi_wwn': '26632663634643039', 'path': '/dev/sde'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:55:08 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26632663634643039', 'path': '/dev/sde'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:55:08 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:54:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1990942375',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1990942375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1990942375',id=41,image_ref='a12c16c2-cd9b-463f-9eb3-5dba5029c430',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBgW+y+cnR8RuTrHj8CQoIXCRYJEgp/2NyW1176CxCOMhcPrkb1EL2IAgNV+HV9LlT5LA5vwN9Mshqgz6lCDmH9KJX9aYQ2yE47IAm6M4/ojV2dXoN0n30bAzEdKQAUtA==',key_name='tempest-keypair-596044462',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f45c92d3fe964066b9be87489b2c9f7e',ramdisk_id='',reservation_id='r-8vo5rp81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-434673895',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-434673895-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-434673895',owner_user_name='tempest-TestVolumeBootPattern-434673895-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:54:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d94a7ea0c19845b886e12c1689cf30a8',uuid=8c62c19f-f13c-4ade-a0ea-a7594c8daa0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c17e061-0e8d-4d45-afa6-6179b4f860e2", "address": "fa:16:3e:2e:56:1e", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c17e061-0e", "ovs_interfaceid": "3c17e061-0e8d-4d45-afa6-6179b4f860e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:55:08 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Converting VIF {"id": "3c17e061-0e8d-4d45-afa6-6179b4f860e2", "address": "fa:16:3e:2e:56:1e", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c17e061-0e", "ovs_interfaceid": "3c17e061-0e8d-4d45-afa6-6179b4f860e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:55:08 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:56:1e,bridge_name='br-int',has_traffic_filtering=True,id=3c17e061-0e8d-4d45-afa6-6179b4f860e2,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c17e061-0e') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:55:08 user nova-compute[231753]: DEBUG nova.objects.instance [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lazy-loading 'pci_devices' on Instance uuid 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:55:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:55:09 user nova-compute[231753]:   <uuid>8c62c19f-f13c-4ade-a0ea-a7594c8daa0d</uuid>
Jul 29 13:55:09 user nova-compute[231753]:   <name>instance-00000029</name>
Jul 29 13:55:09 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:55:09 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:55:09 user nova-compute[231753]:   <metadata>
Jul 29 13:55:09 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:55:09 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:55:09 user nova-compute[231753]:       <nova:name>tempest-TestVolumeBootPattern-image-snapshot-server-1990942375</nova:name>
Jul 29 13:55:09 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:55:07</nova:creationTime>
Jul 29 13:55:09 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:55:09 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:55:09 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:55:09 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:55:09 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:55:09 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:55:09 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:55:09 user nova-compute[231753]:       <nova:owner>
Jul 29 13:55:09 user nova-compute[231753]:         <nova:user uuid="d94a7ea0c19845b886e12c1689cf30a8">tempest-TestVolumeBootPattern-434673895-project-member</nova:user>
Jul 29 13:55:09 user nova-compute[231753]:         <nova:project uuid="f45c92d3fe964066b9be87489b2c9f7e">tempest-TestVolumeBootPattern-434673895</nova:project>
Jul 29 13:55:09 user nova-compute[231753]:       </nova:owner>
Jul 29 13:55:09 user nova-compute[231753]:       <nova:root type="image" uuid="a12c16c2-cd9b-463f-9eb3-5dba5029c430"/>
Jul 29 13:55:09 user nova-compute[231753]:       <nova:ports>
Jul 29 13:55:09 user nova-compute[231753]:         <nova:port uuid="3c17e061-0e8d-4d45-afa6-6179b4f860e2">
Jul 29 13:55:09 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 29 13:55:09 user nova-compute[231753]:         </nova:port>
Jul 29 13:55:09 user nova-compute[231753]:       </nova:ports>
Jul 29 13:55:09 user nova-compute[231753]:     </nova:instance>
Jul 29 13:55:09 user nova-compute[231753]:   </metadata>
Jul 29 13:55:09 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:55:09 user nova-compute[231753]:     <system>
Jul 29 13:55:09 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:55:09 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:55:09 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:55:09 user nova-compute[231753]:       <entry name="serial">8c62c19f-f13c-4ade-a0ea-a7594c8daa0d</entry>
Jul 29 13:55:09 user nova-compute[231753]:       <entry name="uuid">8c62c19f-f13c-4ade-a0ea-a7594c8daa0d</entry>
Jul 29 13:55:09 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:55:09 user nova-compute[231753]:     </system>
Jul 29 13:55:09 user nova-compute[231753]:   </sysinfo>
Jul 29 13:55:09 user nova-compute[231753]:   <os>
Jul 29 13:55:09 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:55:09 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:55:09 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:55:09 user nova-compute[231753]:   </os>
Jul 29 13:55:09 user nova-compute[231753]:   <features>
Jul 29 13:55:09 user nova-compute[231753]:     <acpi/>
Jul 29 13:55:09 user nova-compute[231753]:     <apic/>
Jul 29 13:55:09 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:55:09 user nova-compute[231753]:   </features>
Jul 29 13:55:09 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:55:09 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:55:09 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:55:09 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:55:09 user nova-compute[231753]:   </clock>
Jul 29 13:55:09 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:55:09 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:55:09 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:55:09 user nova-compute[231753]:   </cpu>
Jul 29 13:55:09 user nova-compute[231753]:   <devices>
Jul 29 13:55:09 user nova-compute[231753]:     <disk type="block" device="disk">
Jul 29 13:55:09 user nova-compute[231753]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:55:09 user nova-compute[231753]:       <source dev="/dev/sde"/>
Jul 29 13:55:09 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:55:09 user nova-compute[231753]:       <serial>30cd6d38-cf60-4904-a821-0a96b1579abd</serial>
Jul 29 13:55:09 user nova-compute[231753]:     </disk>
Jul 29 13:55:09 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:55:09 user nova-compute[231753]:       <mac address="fa:16:3e:2e:56:1e"/>
Jul 29 13:55:09 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:55:09 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:55:09 user nova-compute[231753]:       <target dev="tap3c17e061-0e"/>
Jul 29 13:55:09 user nova-compute[231753]:     </interface>
Jul 29 13:55:09 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:55:09 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/8c62c19f-f13c-4ade-a0ea-a7594c8daa0d/console.log" append="off"/>
Jul 29 13:55:09 user nova-compute[231753]:     </serial>
Jul 29 13:55:09 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:55:09 user nova-compute[231753]:     <video>
Jul 29 13:55:09 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:55:09 user nova-compute[231753]:     </video>
Jul 29 13:55:09 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:55:09 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:55:09 user nova-compute[231753]:     </rng>
Jul 29 13:55:09 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:55:09 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:55:09 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:55:09 user nova-compute[231753]:     </memballoon>
Jul 29 13:55:09 user nova-compute[231753]:   </devices>
Jul 29 13:55:09 user nova-compute[231753]: </domain>
Jul 29 13:55:09 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:55:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:54:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1990942375',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1990942375',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1990942375',id=41,image_ref='a12c16c2-cd9b-463f-9eb3-5dba5029c430',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBgW+y+cnR8RuTrHj8CQoIXCRYJEgp/2NyW1176CxCOMhcPrkb1EL2IAgNV+HV9LlT5LA5vwN9Mshqgz6lCDmH9KJX9aYQ2yE47IAm6M4/ojV2dXoN0n30bAzEdKQAUtA==',key_name='tempest-keypair-596044462',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f45c92d3fe964066b9be87489b2c9f7e',ramdisk_id='',reservation_id='r-8vo5rp81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-434673895',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-434673895-project-member',image_root_device_name='/dev/vda',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-434673895',owner_user_name='tempest-TestVolumeBootPattern-434673895-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:54:54Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d94a7ea0c19845b886e12c1689cf30a8',uuid=8c62c19f-f13c-4ade-a0ea-a7594c8daa0d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3c17e061-0e8d-4d45-afa6-6179b4f860e2", "address": "fa:16:3e:2e:56:1e", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c17e061-0e", "ovs_interfaceid": "3c17e061-0e8d-4d45-afa6-6179b4f860e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:55:09 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Converting VIF {"id": "3c17e061-0e8d-4d45-afa6-6179b4f860e2", "address": "fa:16:3e:2e:56:1e", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c17e061-0e", "ovs_interfaceid": "3c17e061-0e8d-4d45-afa6-6179b4f860e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:55:09 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:56:1e,bridge_name='br-int',has_traffic_filtering=True,id=3c17e061-0e8d-4d45-afa6-6179b4f860e2,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c17e061-0e') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:55:09 user nova-compute[231753]: DEBUG os_vif [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:56:1e,bridge_name='br-int',has_traffic_filtering=True,id=3c17e061-0e8d-4d45-afa6-6179b4f860e2,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c17e061-0e') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:55:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:55:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:55:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3c17e061-0e, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:55:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3c17e061-0e, col_values=(('external_ids', {'iface-id': '3c17e061-0e8d-4d45-afa6-6179b4f860e2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:2e:56:1e', 'vm-uuid': '8c62c19f-f13c-4ade-a0ea-a7594c8daa0d'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:55:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:55:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:09 user nova-compute[231753]: INFO os_vif [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:56:1e,bridge_name='br-int',has_traffic_filtering=True,id=3c17e061-0e8d-4d45-afa6-6179b4f860e2,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c17e061-0e')
Jul 29 13:55:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:55:09 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] No VIF found with MAC fa:16:3e:2e:56:1e, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:55:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:10 user nova-compute[231753]: DEBUG nova.compute.manager [req-bc988634-e917-4b27-9df3-81a560dd9066 req-b04c1e76-c544-46ed-9001-6b63ea89733a service nova] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Received event network-vif-plugged-3c17e061-0e8d-4d45-afa6-6179b4f860e2 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:55:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bc988634-e917-4b27-9df3-81a560dd9066 req-b04c1e76-c544-46ed-9001-6b63ea89733a service nova] Acquiring lock "8c62c19f-f13c-4ade-a0ea-a7594c8daa0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:55:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bc988634-e917-4b27-9df3-81a560dd9066 req-b04c1e76-c544-46ed-9001-6b63ea89733a service nova] Lock "8c62c19f-f13c-4ade-a0ea-a7594c8daa0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:55:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bc988634-e917-4b27-9df3-81a560dd9066 req-b04c1e76-c544-46ed-9001-6b63ea89733a service nova] Lock "8c62c19f-f13c-4ade-a0ea-a7594c8daa0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:55:10 user nova-compute[231753]: DEBUG nova.compute.manager [req-bc988634-e917-4b27-9df3-81a560dd9066 req-b04c1e76-c544-46ed-9001-6b63ea89733a service nova] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] No waiting events found dispatching network-vif-plugged-3c17e061-0e8d-4d45-afa6-6179b4f860e2 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:55:10 user nova-compute[231753]: WARNING nova.compute.manager [req-bc988634-e917-4b27-9df3-81a560dd9066 req-b04c1e76-c544-46ed-9001-6b63ea89733a service nova] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Received unexpected event network-vif-plugged-3c17e061-0e8d-4d45-afa6-6179b4f860e2 for instance with vm_state building and task_state spawning.
Jul 29 13:55:12 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638912.5353842, 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:55:12 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] VM Resumed (Lifecycle Event)
Jul 29 13:55:12 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:55:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:55:12 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Instance spawned successfully.
Jul 29 13:55:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:55:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:55:12 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:55:12 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:55:12 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:55:12 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:55:12 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638912.537547, 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:55:12 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] VM Started (Lifecycle Event)
Jul 29 13:55:12 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:55:12 user nova-compute[231753]: INFO nova.compute.manager [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Took 5.07 seconds to spawn the instance on the hypervisor.
Jul 29 13:55:12 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:55:12 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:55:12 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:55:12 user nova-compute[231753]: INFO nova.compute.manager [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Took 19.18 seconds to build instance.
Jul 29 13:55:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ca101d21-7f32-4d32-afd3-0293d84f79ae tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "8c62c19f-f13c-4ade-a0ea-a7594c8daa0d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 19.280s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:55:12 user nova-compute[231753]: DEBUG nova.compute.manager [req-c712de89-c66a-4179-8ba6-3b66b2650e86 req-c1a63da8-5e1b-47d0-afe8-46987a020d98 service nova] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Received event network-vif-plugged-3c17e061-0e8d-4d45-afa6-6179b4f860e2 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:55:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c712de89-c66a-4179-8ba6-3b66b2650e86 req-c1a63da8-5e1b-47d0-afe8-46987a020d98 service nova] Acquiring lock "8c62c19f-f13c-4ade-a0ea-a7594c8daa0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:55:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c712de89-c66a-4179-8ba6-3b66b2650e86 req-c1a63da8-5e1b-47d0-afe8-46987a020d98 service nova] Lock "8c62c19f-f13c-4ade-a0ea-a7594c8daa0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:55:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c712de89-c66a-4179-8ba6-3b66b2650e86 req-c1a63da8-5e1b-47d0-afe8-46987a020d98 service nova] Lock "8c62c19f-f13c-4ade-a0ea-a7594c8daa0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:55:12 user nova-compute[231753]: DEBUG nova.compute.manager [req-c712de89-c66a-4179-8ba6-3b66b2650e86 req-c1a63da8-5e1b-47d0-afe8-46987a020d98 service nova] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] No waiting events found dispatching network-vif-plugged-3c17e061-0e8d-4d45-afa6-6179b4f860e2 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:55:12 user nova-compute[231753]: WARNING nova.compute.manager [req-c712de89-c66a-4179-8ba6-3b66b2650e86 req-c1a63da8-5e1b-47d0-afe8-46987a020d98 service nova] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Received unexpected event network-vif-plugged-3c17e061-0e8d-4d45-afa6-6179b4f860e2 for instance with vm_state active and task_state None.
Jul 29 13:55:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:55:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:55:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:55:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:55:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:55:14 user nova-compute[231753]: INFO nova.compute.manager [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Terminating instance
Jul 29 13:55:14 user nova-compute[231753]: DEBUG nova.compute.manager [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:55:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG nova.compute.manager [req-69986fe7-586c-4c3b-aaf4-979ba85a9174 req-8db99a50-eda6-41b5-9a1f-7b6ac9a6f5d8 service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Received event network-vif-unplugged-dba460c1-334b-4686-b6a3-7d85632d294d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-69986fe7-586c-4c3b-aaf4-979ba85a9174 req-8db99a50-eda6-41b5-9a1f-7b6ac9a6f5d8 service nova] Acquiring lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-69986fe7-586c-4c3b-aaf4-979ba85a9174 req-8db99a50-eda6-41b5-9a1f-7b6ac9a6f5d8 service nova] Lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-69986fe7-586c-4c3b-aaf4-979ba85a9174 req-8db99a50-eda6-41b5-9a1f-7b6ac9a6f5d8 service nova] Lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG nova.compute.manager [req-69986fe7-586c-4c3b-aaf4-979ba85a9174 req-8db99a50-eda6-41b5-9a1f-7b6ac9a6f5d8 service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] No waiting events found dispatching network-vif-unplugged-dba460c1-334b-4686-b6a3-7d85632d294d {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG nova.compute.manager [req-69986fe7-586c-4c3b-aaf4-979ba85a9174 req-8db99a50-eda6-41b5-9a1f-7b6ac9a6f5d8 service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Received event network-vif-unplugged-dba460c1-334b-4686-b6a3-7d85632d294d for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:55:15 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Instance destroyed successfully.
Jul 29 13:55:15 user nova-compute[231753]: DEBUG nova.objects.instance [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lazy-loading 'resources' on Instance uuid ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:49:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1967595438',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1967595438',id=35,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:51:41Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c01165e83a3143ad83f050790f2b63fe',ramdisk_id='',reservation_id='r-tjkg3ouj',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-93506270',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:53:29Z,user_data=None,user_id='618ce2d56c3c4ee8ace871d308ca45fb',uuid=ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dba460c1-334b-4686-b6a3-7d85632d294d", "address": "fa:16:3e:15:f4:85", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba460c1-33", "ovs_interfaceid": "dba460c1-334b-4686-b6a3-7d85632d294d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Converting VIF {"id": "dba460c1-334b-4686-b6a3-7d85632d294d", "address": "fa:16:3e:15:f4:85", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapdba460c1-33", "ovs_interfaceid": "dba460c1-334b-4686-b6a3-7d85632d294d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:15:f4:85,bridge_name='br-int',has_traffic_filtering=True,id=dba460c1-334b-4686-b6a3-7d85632d294d,network=Network(03362fcb-afd6-4b0a-af44-a54a848c59f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdba460c1-33') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG os_vif [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:f4:85,bridge_name='br-int',has_traffic_filtering=True,id=dba460c1-334b-4686-b6a3-7d85632d294d,network=Network(03362fcb-afd6-4b0a-af44-a54a848c59f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdba460c1-33') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdba460c1-33, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:55:15 user nova-compute[231753]: INFO os_vif [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:15:f4:85,bridge_name='br-int',has_traffic_filtering=True,id=dba460c1-334b-4686-b6a3-7d85632d294d,network=Network(03362fcb-afd6-4b0a-af44-a54a848c59f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapdba460c1-33')
Jul 29 13:55:15 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'yRsdFEaM', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:55:15 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:55:15 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[87c59bf5-ab2c-4f9d-aed2-00410b9d03fe]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:55:15 user nova-compute[231753]: No targets found.
Jul 29 13:55:15 user nova-compute[231753]: iSNS:
Jul 29 13:55:15 user nova-compute[231753]: No targets found.
Jul 29 13:55:15 user nova-compute[231753]: STATIC:
Jul 29 13:55:15 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea
Jul 29 13:55:15 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:55:15 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:55:15 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699
Jul 29 13:55:15 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:55:15 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:55:15 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd
Jul 29 13:55:15 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:55:15 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:55:15 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a
Jul 29 13:55:15 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:55:15 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:55:15 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271
Jul 29 13:55:15 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:55:15 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:55:15 user nova-compute[231753]: FIRMWARE:
Jul 29 13:55:15 user nova-compute[231753]: No targets found.
Jul 29 13:55:15 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:55:15 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:55:15 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e972028-bde1-421d-a45d-d15fe997f544]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.031s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[31c67a74-aaca-4bb6-a835-a8aa1c452233]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:55:15 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:55:15 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:55:15 user nova-compute[231753]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 (non-flash)
Jul 29 13:55:15 user nova-compute[231753]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd (non-flash)
Jul 29 13:55:15 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:55:15 user nova-compute[231753]: tcp: [40] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a (non-flash)
Jul 29 13:55:15 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:55:15 user nova-compute[231753]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 (non-flash)
Jul 29 13:55:15 user nova-compute[231753]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd (non-flash)
Jul 29 13:55:15 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c80466f80>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a'): ({'sdb'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Removing single pathed devices sdb {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.029s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91fd397-ad39-43b7-8bae-d06fba475a67]: (4, ('path checker states:\nup                  5\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[adf4eb50-46ad-4175-abd3-14babbcbd243]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Flushing IO for device /dev/sdb {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[61e540f7-43cf-4f77-87bf-921147292a2b]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.059s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9559885c-de27-4d9e-a761-5f152f984c96]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] SCSI volumes sdb have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e7b32ee-f27c-486f-bdb2-fb55f2841aa5]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:55:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a -p 172.16.0.220:3260 --logout" returned: 0 in 0.071s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:16 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[42169861-bbb8-4b28-835d-a96554087be4]: (4, ('Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a, portal: 172.16.0.220,3260]\nLogout of [sid: 40, target: iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:55:16 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a, portal: 172.16.0.220,3260]
Jul 29 13:55:16 user nova-compute[231753]: Logout of [sid: 40, target: iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a, portal: 172.16.0.220,3260] successful.
Jul 29 13:55:16 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:55:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:db901bd6-6e09-4679-be85-f2b92ffb7b6a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.035s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:16 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1d8c6c5-eaa4-4b96-be7b-8e82dba274d6]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:55:16 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:55:16 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.382s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:55:16 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] <== disconnect_volume: return (384ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:55:16 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:55:16 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Deleting instance files /opt/stack/data/nova/instances/ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965_del
Jul 29 13:55:16 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Deletion of /opt/stack/data/nova/instances/ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965_del complete
Jul 29 13:55:16 user nova-compute[231753]: INFO nova.compute.manager [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Took 1.32 seconds to destroy the instance on the hypervisor.
Jul 29 13:55:16 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:55:16 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:55:16 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:55:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:16 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:55:16 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Took 0.85 seconds to deallocate network for instance.
Jul 29 13:55:17 user nova-compute[231753]: DEBUG nova.compute.manager [req-d80b437f-d097-442b-8317-52c29efec0c3 req-6c0c9265-727c-4100-971c-46f43325e1b4 service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Received event network-vif-deleted-dba460c1-334b-4686-b6a3-7d85632d294d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:55:17 user nova-compute[231753]: DEBUG nova.compute.manager [req-4b3bf957-e842-4bd1-9d44-cfae72c1199f req-14281f5c-85c7-4bf2-b302-c5debfe5f8c9 service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Received event network-vif-plugged-dba460c1-334b-4686-b6a3-7d85632d294d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:55:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4b3bf957-e842-4bd1-9d44-cfae72c1199f req-14281f5c-85c7-4bf2-b302-c5debfe5f8c9 service nova] Acquiring lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:55:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4b3bf957-e842-4bd1-9d44-cfae72c1199f req-14281f5c-85c7-4bf2-b302-c5debfe5f8c9 service nova] Lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:55:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4b3bf957-e842-4bd1-9d44-cfae72c1199f req-14281f5c-85c7-4bf2-b302-c5debfe5f8c9 service nova] Lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:55:17 user nova-compute[231753]: DEBUG nova.compute.manager [req-4b3bf957-e842-4bd1-9d44-cfae72c1199f req-14281f5c-85c7-4bf2-b302-c5debfe5f8c9 service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] No waiting events found dispatching network-vif-plugged-dba460c1-334b-4686-b6a3-7d85632d294d {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:55:17 user nova-compute[231753]: WARNING nova.compute.manager [req-4b3bf957-e842-4bd1-9d44-cfae72c1199f req-14281f5c-85c7-4bf2-b302-c5debfe5f8c9 service nova] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Received unexpected event network-vif-plugged-dba460c1-334b-4686-b6a3-7d85632d294d for instance with vm_state active and task_state deleting.
Jul 29 13:55:17 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:55:17 user nova-compute[231753]: INFO nova.compute.manager [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Took 0.88 seconds to detach 1 volumes for instance.
Jul 29 13:55:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:55:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:55:18 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:55:18 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:55:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.274s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:55:18 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Deleted allocations for instance ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965
Jul 29 13:55:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-49004ea4-f236-4d59-82c4-af33e1c80979 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.523s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:55:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:19 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:55:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:55:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:55:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:55:19 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 13:55:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:55:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.166s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:55:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json" returned: 0 in 0.135s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97/disk --force-share --output=json" returned: 0 in 0.169s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Acquiring lock "73f72f78-9abf-4b04-a973-06affde57310" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:55:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Lock "73f72f78-9abf-4b04-a973-06affde57310" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:55:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e71bc1-78c8-4cec-a935-878dd08ff941/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:20 user nova-compute[231753]: DEBUG nova.compute.manager [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:55:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e71bc1-78c8-4cec-a935-878dd08ff941/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e71bc1-78c8-4cec-a935-878dd08ff941/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:55:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:55:20 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:55:20 user nova-compute[231753]: INFO nova.compute.claims [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Claim successful on node user
Jul 29 13:55:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/97e71bc1-78c8-4cec-a935-878dd08ff941/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdf (vdb) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:55:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:55:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:20 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:55:20 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:55:20 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=7970MB free_disk=24.92379379272461GB free_vcpus=6 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 13:55:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.842s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG nova.compute.manager [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.217s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG nova.compute.manager [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG nova.network.neutron [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG nova.compute.manager [req-359c9955-be5a-4b81-a8a8-ea28878b35fc req-5bf8d03d-b2e1-44bf-908b-0c31bc5e2cc7 service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Received event network-changed-75a46a16-882f-4bf9-96bf-a6874ecfbcc1 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG nova.compute.manager [req-359c9955-be5a-4b81-a8a8-ea28878b35fc req-5bf8d03d-b2e1-44bf-908b-0c31bc5e2cc7 service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Refreshing instance network info cache due to event network-changed-75a46a16-882f-4bf9-96bf-a6874ecfbcc1. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-359c9955-be5a-4b81-a8a8-ea28878b35fc req-5bf8d03d-b2e1-44bf-908b-0c31bc5e2cc7 service nova] Acquiring lock "refresh_cache-97e71bc1-78c8-4cec-a935-878dd08ff941" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-359c9955-be5a-4b81-a8a8-ea28878b35fc req-5bf8d03d-b2e1-44bf-908b-0c31bc5e2cc7 service nova] Acquired lock "refresh_cache-97e71bc1-78c8-4cec-a935-878dd08ff941" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG nova.network.neutron [req-359c9955-be5a-4b81-a8a8-ea28878b35fc req-5bf8d03d-b2e1-44bf-908b-0c31bc5e2cc7 service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Refreshing network info cache for port 75a46a16-882f-4bf9-96bf-a6874ecfbcc1 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:55:21 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:55:21 user nova-compute[231753]: DEBUG nova.compute.manager [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance cf326e80-7293-4764-9411-ed05a5aeba23 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b99a72ba-73e2-4be7-b52b-7797351daa5f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b6be450b-ebe7-4385-b162-2d072237aa97 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 97e71bc1-78c8-4cec-a935-878dd08ff941 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 1c4a953b-67c9-4c69-950a-7487735e917c actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 73f72f78-9abf-4b04-a973-06affde57310 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 7 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=4096MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=7 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG nova.policy [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '1bb6c1ec3ad24904bc7004e7c431544a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'bd079349ba1549b2bc93552ecb88c3e1', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG nova.compute.manager [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:55:21 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Creating image(s)
Jul 29 13:55:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Acquiring lock "/opt/stack/data/nova/instances/73f72f78-9abf-4b04-a973-06affde57310/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Lock "/opt/stack/data/nova/instances/73f72f78-9abf-4b04-a973-06affde57310/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Lock "/opt/stack/data/nova/instances/73f72f78-9abf-4b04-a973-06affde57310/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.003s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.592s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.146s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.170s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/73f72f78-9abf-4b04-a973-06affde57310/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/73f72f78-9abf-4b04-a973-06affde57310/disk 1073741824" returned: 0 in 0.059s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.234s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:55:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:22 user nova-compute[231753]: DEBUG nova.network.neutron [req-359c9955-be5a-4b81-a8a8-ea28878b35fc req-5bf8d03d-b2e1-44bf-908b-0c31bc5e2cc7 service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Updated VIF entry in instance network info cache for port 75a46a16-882f-4bf9-96bf-a6874ecfbcc1. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:55:22 user nova-compute[231753]: DEBUG nova.network.neutron [req-359c9955-be5a-4b81-a8a8-ea28878b35fc req-5bf8d03d-b2e1-44bf-908b-0c31bc5e2cc7 service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Updating instance_info_cache with network_info: [{"id": "75a46a16-882f-4bf9-96bf-a6874ecfbcc1", "address": "fa:16:3e:30:50:53", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.100", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a46a16-88", "ovs_interfaceid": "75a46a16-882f-4bf9-96bf-a6874ecfbcc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:55:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-359c9955-be5a-4b81-a8a8-ea28878b35fc req-5bf8d03d-b2e1-44bf-908b-0c31bc5e2cc7 service nova] Releasing lock "refresh_cache-97e71bc1-78c8-4cec-a935-878dd08ff941" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:55:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.161s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:22 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Checking if we can resize image /opt/stack/data/nova/instances/73f72f78-9abf-4b04-a973-06affde57310/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:55:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f72f78-9abf-4b04-a973-06affde57310/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:22 user nova-compute[231753]: DEBUG nova.network.neutron [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Successfully created port: 3ca923a6-55a2-4578-ad2e-c3e9248b6af2 {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:55:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f72f78-9abf-4b04-a973-06affde57310/disk --force-share --output=json" returned: 0 in 0.154s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:22 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Cannot resize image /opt/stack/data/nova/instances/73f72f78-9abf-4b04-a973-06affde57310/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:55:22 user nova-compute[231753]: DEBUG nova.objects.instance [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Lazy-loading 'migration_context' on Instance uuid 73f72f78-9abf-4b04-a973-06affde57310 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:55:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:55:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Ensure instance console log exists: /opt/stack/data/nova/instances/73f72f78-9abf-4b04-a973-06affde57310/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:55:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:55:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:55:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:55:22 user nova-compute[231753]: DEBUG nova.compute.manager [req-be8c479d-a964-4036-9b73-d4b8b763197b req-17baa2fd-d6eb-4156-bfd3-7dfdf6f14df8 service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Received event network-changed-75a46a16-882f-4bf9-96bf-a6874ecfbcc1 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:55:22 user nova-compute[231753]: DEBUG nova.compute.manager [req-be8c479d-a964-4036-9b73-d4b8b763197b req-17baa2fd-d6eb-4156-bfd3-7dfdf6f14df8 service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Refreshing instance network info cache due to event network-changed-75a46a16-882f-4bf9-96bf-a6874ecfbcc1. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:55:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-be8c479d-a964-4036-9b73-d4b8b763197b req-17baa2fd-d6eb-4156-bfd3-7dfdf6f14df8 service nova] Acquiring lock "refresh_cache-97e71bc1-78c8-4cec-a935-878dd08ff941" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:55:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-be8c479d-a964-4036-9b73-d4b8b763197b req-17baa2fd-d6eb-4156-bfd3-7dfdf6f14df8 service nova] Acquired lock "refresh_cache-97e71bc1-78c8-4cec-a935-878dd08ff941" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:55:22 user nova-compute[231753]: DEBUG nova.network.neutron [req-be8c479d-a964-4036-9b73-d4b8b763197b req-17baa2fd-d6eb-4156-bfd3-7dfdf6f14df8 service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Refreshing network info cache for port 75a46a16-882f-4bf9-96bf-a6874ecfbcc1 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:55:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b6b886d1-3ddf-4faa-8067-4c3022f73654 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "97e71bc1-78c8-4cec-a935-878dd08ff941" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:55:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b6b886d1-3ddf-4faa-8067-4c3022f73654 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "97e71bc1-78c8-4cec-a935-878dd08ff941" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:55:22 user nova-compute[231753]: INFO nova.compute.manager [None req-b6b886d1-3ddf-4faa-8067-4c3022f73654 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Detaching volume e29e73e8-aad2-4b4d-903d-761c32b8b271
Jul 29 13:55:22 user nova-compute[231753]: INFO nova.virt.block_device [None req-b6b886d1-3ddf-4faa-8067-4c3022f73654 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Attempting to driver detach volume e29e73e8-aad2-4b4d-903d-761c32b8b271 from mountpoint /dev/vdb
Jul 29 13:55:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b6b886d1-3ddf-4faa-8067-4c3022f73654 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Attempting to detach device vdb from instance 97e71bc1-78c8-4cec-a935-878dd08ff941 from the persistent domain config. {{(pid=231753) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 13:55:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-b6b886d1-3ddf-4faa-8067-4c3022f73654 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:55:22 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:55:22 user nova-compute[231753]:   <source dev="/dev/sdf"/>
Jul 29 13:55:22 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:55:22 user nova-compute[231753]:   <serial>e29e73e8-aad2-4b4d-903d-761c32b8b271</serial>
Jul 29 13:55:22 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 13:55:22 user nova-compute[231753]: </disk>
Jul 29 13:55:22 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:55:22 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-b6b886d1-3ddf-4faa-8067-4c3022f73654 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Successfully detached device vdb from instance 97e71bc1-78c8-4cec-a935-878dd08ff941 from the persistent domain config.
Jul 29 13:55:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b6b886d1-3ddf-4faa-8067-4c3022f73654 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 97e71bc1-78c8-4cec-a935-878dd08ff941 from the live domain config. {{(pid=231753) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 13:55:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-b6b886d1-3ddf-4faa-8067-4c3022f73654 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:55:22 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:55:22 user nova-compute[231753]:   <source dev="/dev/sdf"/>
Jul 29 13:55:22 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:55:22 user nova-compute[231753]:   <serial>e29e73e8-aad2-4b4d-903d-761c32b8b271</serial>
Jul 29 13:55:22 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 13:55:22 user nova-compute[231753]: </disk>
Jul 29 13:55:22 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.network.neutron [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Successfully updated port: 3ca923a6-55a2-4578-ad2e-c3e9248b6af2 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Acquiring lock "refresh_cache-73f72f78-9abf-4b04-a973-06affde57310" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Acquired lock "refresh_cache-73f72f78-9abf-4b04-a973-06affde57310" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.network.neutron [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.network.neutron [req-be8c479d-a964-4036-9b73-d4b8b763197b req-17baa2fd-d6eb-4156-bfd3-7dfdf6f14df8 service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Updated VIF entry in instance network info cache for port 75a46a16-882f-4bf9-96bf-a6874ecfbcc1. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.network.neutron [req-be8c479d-a964-4036-9b73-d4b8b763197b req-17baa2fd-d6eb-4156-bfd3-7dfdf6f14df8 service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Updating instance_info_cache with network_info: [{"id": "75a46a16-882f-4bf9-96bf-a6874ecfbcc1", "address": "fa:16:3e:30:50:53", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a46a16-88", "ovs_interfaceid": "75a46a16-882f-4bf9-96bf-a6874ecfbcc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.compute.manager [req-4002baa7-6a64-4cdd-be03-f5be3c7eb30e req-849af270-2e95-4778-acbe-a612d61fd999 service nova] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Received event network-changed-3ca923a6-55a2-4578-ad2e-c3e9248b6af2 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.compute.manager [req-4002baa7-6a64-4cdd-be03-f5be3c7eb30e req-849af270-2e95-4778-acbe-a612d61fd999 service nova] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Refreshing instance network info cache due to event network-changed-3ca923a6-55a2-4578-ad2e-c3e9248b6af2. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4002baa7-6a64-4cdd-be03-f5be3c7eb30e req-849af270-2e95-4778-acbe-a612d61fd999 service nova] Acquiring lock "refresh_cache-73f72f78-9abf-4b04-a973-06affde57310" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-be8c479d-a964-4036-9b73-d4b8b763197b req-17baa2fd-d6eb-4156-bfd3-7dfdf6f14df8 service nova] Releasing lock "refresh_cache-97e71bc1-78c8-4cec-a935-878dd08ff941" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.network.neutron [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Received event <DeviceRemovedEvent: 1690638923.3337283, 97e71bc1-78c8-4cec-a935-878dd08ff941 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=231753) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-b6b886d1-3ddf-4faa-8067-4c3022f73654 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 97e71bc1-78c8-4cec-a935-878dd08ff941 {{(pid=231753) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 13:55:23 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-b6b886d1-3ddf-4faa-8067-4c3022f73654 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Successfully detached device vdb from instance 97e71bc1-78c8-4cec-a935-878dd08ff941 from the live domain config.
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6b886d1-3ddf-4faa-8067-4c3022f73654 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6b886d1-3ddf-4faa-8067-4c3022f73654 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'przmwxba', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdf'}, None), 'kwargs': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:55:23 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-b6b886d1-3ddf-4faa-8067-4c3022f73654 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:55:23 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-b6b886d1-3ddf-4faa-8067-4c3022f73654 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-b6b886d1-3ddf-4faa-8067-4c3022f73654 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[364b6b68-e5ed-4621-99f0-df6f2b5428e0]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6b886d1-3ddf-4faa-8067-4c3022f73654 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:55:23 user nova-compute[231753]: No targets found.
Jul 29 13:55:23 user nova-compute[231753]: iSNS:
Jul 29 13:55:23 user nova-compute[231753]: No targets found.
Jul 29 13:55:23 user nova-compute[231753]: STATIC:
Jul 29 13:55:23 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea
Jul 29 13:55:23 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:55:23 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:55:23 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699
Jul 29 13:55:23 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:55:23 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:55:23 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd
Jul 29 13:55:23 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:55:23 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:55:23 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271
Jul 29 13:55:23 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:55:23 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:55:23 user nova-compute[231753]: FIRMWARE:
Jul 29 13:55:23 user nova-compute[231753]: No targets found.
Jul 29 13:55:23 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6b886d1-3ddf-4faa-8067-4c3022f73654 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:55:23 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:55:23 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6b886d1-3ddf-4faa-8067-4c3022f73654 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6304f269-5919-41e5-967d-6a1a2f96e91d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b13ed801-1bce-4c96-af1c-7334cda4a624]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)\ntcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6b886d1-3ddf-4faa-8067-4c3022f73654 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:55:23 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:55:23 user nova-compute[231753]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 (non-flash)
Jul 29 13:55:23 user nova-compute[231753]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd (non-flash)
Jul 29 13:55:23 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6b886d1-3ddf-4faa-8067-4c3022f73654 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:55:23 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:55:23 user nova-compute[231753]: tcp: [45] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 (non-flash)
Jul 29 13:55:23 user nova-compute[231753]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd (non-flash)
Jul 29 13:55:23 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6b886d1-3ddf-4faa-8067-4c3022f73654 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c802d0a60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271'): ({'sdf'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-b6b886d1-3ddf-4faa-8067-4c3022f73654 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Removing single pathed devices sdf {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eb0f386-b65a-4b59-8687-67ffc0e9c2bb]: (4, ('path checker states:\nup                  4\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdf {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdf" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9c0defa-cea6-40bd-987b-e303f3af56ef]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-b6b886d1-3ddf-4faa-8067-4c3022f73654 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Flushing IO for device /dev/sdf {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdf {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdf" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[334971b7-c50a-4a6a-8f6d-5fc66ce85c4e]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-b6b886d1-3ddf-4faa-8067-4c3022f73654 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdf/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.network.neutron [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Updating instance_info_cache with network_info: [{"id": "3ca923a6-55a2-4578-ad2e-c3e9248b6af2", "address": "fa:16:3e:39:97:1d", "network": {"id": "c5a2a904-b9ec-4da4-8206-f08aef3a48cc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2009211013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd079349ba1549b2bc93552ecb88c3e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca923a6-55", "ovs_interfaceid": "3ca923a6-55a2-4578-ad2e-c3e9248b6af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdf/device/delete" returned: 0 in 0.042s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ce5fc07-bfaa-4545-8cdf-4c811b3c4811]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-b6b886d1-3ddf-4faa-8067-4c3022f73654 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Checking to see if SCSI volumes sdf have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-b6b886d1-3ddf-4faa-8067-4c3022f73654 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] SCSI volumes sdf have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6b886d1-3ddf-4faa-8067-4c3022f73654 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.033s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9db6af5b-d261-494c-894f-9dd6136bc512]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6b886d1-3ddf-4faa-8067-4c3022f73654 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Releasing lock "refresh_cache-73f72f78-9abf-4b04-a973-06affde57310" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Instance network_info: |[{"id": "3ca923a6-55a2-4578-ad2e-c3e9248b6af2", "address": "fa:16:3e:39:97:1d", "network": {"id": "c5a2a904-b9ec-4da4-8206-f08aef3a48cc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2009211013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd079349ba1549b2bc93552ecb88c3e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca923a6-55", "ovs_interfaceid": "3ca923a6-55a2-4578-ad2e-c3e9248b6af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4002baa7-6a64-4cdd-be03-f5be3c7eb30e req-849af270-2e95-4778-acbe-a612d61fd999 service nova] Acquired lock "refresh_cache-73f72f78-9abf-4b04-a973-06affde57310" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.network.neutron [req-4002baa7-6a64-4cdd-be03-f5be3c7eb30e req-849af270-2e95-4778-acbe-a612d61fd999 service nova] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Refreshing network info cache for port 3ca923a6-55a2-4578-ad2e-c3e9248b6af2 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Start _get_guest_xml network_info=[{"id": "3ca923a6-55a2-4578-ad2e-c3e9248b6af2", "address": "fa:16:3e:39:97:1d", "network": {"id": "c5a2a904-b9ec-4da4-8206-f08aef3a48cc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2009211013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd079349ba1549b2bc93552ecb88c3e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca923a6-55", "ovs_interfaceid": "3ca923a6-55a2-4578-ad2e-c3e9248b6af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:55:23 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:55:23 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:55:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-211081681',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-211081681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2110816',id=42,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpQ8krxtkD+fR+o9MOcYNrF0cSzdV94Gcik9jCCb70O7+brM3cqPYYdLQ9Baj5NakBTR50y1wMCIGdtZhbDp4bWi9EW1a1HI8w/C/88yIIaFMZ9w7nl6iaMM+9Gh1hxGA==',key_name='tempest-keypair-1162159474',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd079349ba1549b2bc93552ecb88c3e1',ramdisk_id='',reservation_id='r-g2jhd0p1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1448691484',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:55:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1bb6c1ec3ad24904bc7004e7c431544a',uuid=73f72f78-9abf-4b04-a973-06affde57310,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ca923a6-55a2-4578-ad2e-c3e9248b6af2", "address": "fa:16:3e:39:97:1d", "network": {"id": "c5a2a904-b9ec-4da4-8206-f08aef3a48cc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2009211013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd079349ba1549b2bc93552ecb88c3e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca923a6-55", "ovs_interfaceid": "3ca923a6-55a2-4578-ad2e-c3e9248b6af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Converting VIF {"id": "3ca923a6-55a2-4578-ad2e-c3e9248b6af2", "address": "fa:16:3e:39:97:1d", "network": {"id": "c5a2a904-b9ec-4da4-8206-f08aef3a48cc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2009211013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd079349ba1549b2bc93552ecb88c3e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca923a6-55", "ovs_interfaceid": "3ca923a6-55a2-4578-ad2e-c3e9248b6af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:97:1d,bridge_name='br-int',has_traffic_filtering=True,id=3ca923a6-55a2-4578-ad2e-c3e9248b6af2,network=Network(c5a2a904-b9ec-4da4-8206-f08aef3a48cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ca923a6-55') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.objects.instance [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Lazy-loading 'pci_devices' on Instance uuid 73f72f78-9abf-4b04-a973-06affde57310 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 -p 172.16.0.220:3260 --logout" returned: 0 in 0.087s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[583d089b-6388-47f0-bc29-d25b94e264de]: (4, ('Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271, portal: 172.16.0.220,3260]\nLogout of [sid: 45, target: iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6b886d1-3ddf-4faa-8067-4c3022f73654 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271, portal: 172.16.0.220,3260]
Jul 29 13:55:23 user nova-compute[231753]: Logout of [sid: 45, target: iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271, portal: 172.16.0.220,3260] successful.
Jul 29 13:55:23 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:55:23 user nova-compute[231753]:   <uuid>73f72f78-9abf-4b04-a973-06affde57310</uuid>
Jul 29 13:55:23 user nova-compute[231753]:   <name>instance-0000002a</name>
Jul 29 13:55:23 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:55:23 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:55:23 user nova-compute[231753]:   <metadata>
Jul 29 13:55:23 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:55:23 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:55:23 user nova-compute[231753]:       <nova:name>tempest-TestServerVolumeAttachScenarioOldVersion-server-211081681</nova:name>
Jul 29 13:55:23 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:55:23</nova:creationTime>
Jul 29 13:55:23 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:55:23 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:55:23 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:55:23 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:55:23 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:55:23 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:55:23 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:55:23 user nova-compute[231753]:       <nova:owner>
Jul 29 13:55:23 user nova-compute[231753]:         <nova:user uuid="1bb6c1ec3ad24904bc7004e7c431544a">tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member</nova:user>
Jul 29 13:55:23 user nova-compute[231753]:         <nova:project uuid="bd079349ba1549b2bc93552ecb88c3e1">tempest-TestServerVolumeAttachScenarioOldVersion-1448691484</nova:project>
Jul 29 13:55:23 user nova-compute[231753]:       </nova:owner>
Jul 29 13:55:23 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:55:23 user nova-compute[231753]:       <nova:ports>
Jul 29 13:55:23 user nova-compute[231753]:         <nova:port uuid="3ca923a6-55a2-4578-ad2e-c3e9248b6af2">
Jul 29 13:55:23 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.12" ipVersion="4"/>
Jul 29 13:55:23 user nova-compute[231753]:         </nova:port>
Jul 29 13:55:23 user nova-compute[231753]:       </nova:ports>
Jul 29 13:55:23 user nova-compute[231753]:     </nova:instance>
Jul 29 13:55:23 user nova-compute[231753]:   </metadata>
Jul 29 13:55:23 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:55:23 user nova-compute[231753]:     <system>
Jul 29 13:55:23 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:55:23 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:55:23 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:55:23 user nova-compute[231753]:       <entry name="serial">73f72f78-9abf-4b04-a973-06affde57310</entry>
Jul 29 13:55:23 user nova-compute[231753]:       <entry name="uuid">73f72f78-9abf-4b04-a973-06affde57310</entry>
Jul 29 13:55:23 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:55:23 user nova-compute[231753]:     </system>
Jul 29 13:55:23 user nova-compute[231753]:   </sysinfo>
Jul 29 13:55:23 user nova-compute[231753]:   <os>
Jul 29 13:55:23 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:55:23 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:55:23 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:55:23 user nova-compute[231753]:   </os>
Jul 29 13:55:23 user nova-compute[231753]:   <features>
Jul 29 13:55:23 user nova-compute[231753]:     <acpi/>
Jul 29 13:55:23 user nova-compute[231753]:     <apic/>
Jul 29 13:55:23 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:55:23 user nova-compute[231753]:   </features>
Jul 29 13:55:23 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:55:23 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:55:23 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:55:23 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:55:23 user nova-compute[231753]:   </clock>
Jul 29 13:55:23 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:55:23 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:55:23 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:55:23 user nova-compute[231753]:   </cpu>
Jul 29 13:55:23 user nova-compute[231753]:   <devices>
Jul 29 13:55:23 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:55:23 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:55:23 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/73f72f78-9abf-4b04-a973-06affde57310/disk"/>
Jul 29 13:55:23 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:55:23 user nova-compute[231753]:     </disk>
Jul 29 13:55:23 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:55:23 user nova-compute[231753]:       <mac address="fa:16:3e:39:97:1d"/>
Jul 29 13:55:23 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:55:23 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:55:23 user nova-compute[231753]:       <target dev="tap3ca923a6-55"/>
Jul 29 13:55:23 user nova-compute[231753]:     </interface>
Jul 29 13:55:23 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:55:23 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/73f72f78-9abf-4b04-a973-06affde57310/console.log" append="off"/>
Jul 29 13:55:23 user nova-compute[231753]:     </serial>
Jul 29 13:55:23 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:55:23 user nova-compute[231753]:     <video>
Jul 29 13:55:23 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:55:23 user nova-compute[231753]:     </video>
Jul 29 13:55:23 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:55:23 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:55:23 user nova-compute[231753]:     </rng>
Jul 29 13:55:23 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:55:23 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:55:23 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:55:23 user nova-compute[231753]:     </memballoon>
Jul 29 13:55:23 user nova-compute[231753]:   </devices>
Jul 29 13:55:23 user nova-compute[231753]: </domain>
Jul 29 13:55:23 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:55:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-211081681',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-211081681',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2110816',id=42,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpQ8krxtkD+fR+o9MOcYNrF0cSzdV94Gcik9jCCb70O7+brM3cqPYYdLQ9Baj5NakBTR50y1wMCIGdtZhbDp4bWi9EW1a1HI8w/C/88yIIaFMZ9w7nl6iaMM+9Gh1hxGA==',key_name='tempest-keypair-1162159474',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='bd079349ba1549b2bc93552ecb88c3e1',ramdisk_id='',reservation_id='r-g2jhd0p1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1448691484',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:55:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1bb6c1ec3ad24904bc7004e7c431544a',uuid=73f72f78-9abf-4b04-a973-06affde57310,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3ca923a6-55a2-4578-ad2e-c3e9248b6af2", "address": "fa:16:3e:39:97:1d", "network": {"id": "c5a2a904-b9ec-4da4-8206-f08aef3a48cc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2009211013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd079349ba1549b2bc93552ecb88c3e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca923a6-55", "ovs_interfaceid": "3ca923a6-55a2-4578-ad2e-c3e9248b6af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Converting VIF {"id": "3ca923a6-55a2-4578-ad2e-c3e9248b6af2", "address": "fa:16:3e:39:97:1d", "network": {"id": "c5a2a904-b9ec-4da4-8206-f08aef3a48cc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2009211013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd079349ba1549b2bc93552ecb88c3e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca923a6-55", "ovs_interfaceid": "3ca923a6-55a2-4578-ad2e-c3e9248b6af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:39:97:1d,bridge_name='br-int',has_traffic_filtering=True,id=3ca923a6-55a2-4578-ad2e-c3e9248b6af2,network=Network(c5a2a904-b9ec-4da4-8206-f08aef3a48cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ca923a6-55') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG os_vif [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:97:1d,bridge_name='br-int',has_traffic_filtering=True,id=3ca923a6-55a2-4578-ad2e-c3e9248b6af2,network=Network(c5a2a904-b9ec-4da4-8206-f08aef3a48cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ca923a6-55') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3ca923a6-55, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3ca923a6-55, col_values=(('external_ids', {'iface-id': '3ca923a6-55a2-4578-ad2e-c3e9248b6af2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:39:97:1d', 'vm-uuid': '73f72f78-9abf-4b04-a973-06affde57310'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e29e73e8-aad2-4b4d-903d-761c32b8b271 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.028s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e425228-9357-42e3-81e9-871ebcd0c240]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6b886d1-3ddf-4faa-8067-4c3022f73654 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-b6b886d1-3ddf-4faa-8067-4c3022f73654 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.374s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-b6b886d1-3ddf-4faa-8067-4c3022f73654 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] <== disconnect_volume: return (376ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b6b886d1-3ddf-4faa-8067-4c3022f73654 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:23 user nova-compute[231753]: INFO os_vif [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:39:97:1d,bridge_name='br-int',has_traffic_filtering=True,id=3ca923a6-55a2-4578-ad2e-c3e9248b6af2,network=Network(c5a2a904-b9ec-4da4-8206-f08aef3a48cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ca923a6-55')
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] No VIF found with MAC fa:16:3e:39:97:1d, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "refresh_cache-b99a72ba-73e2-4be7-b52b-7797351daa5f" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquired lock "refresh_cache-b99a72ba-73e2-4be7-b52b-7797351daa5f" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:55:23 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Forcefully refreshing network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 13:55:24 user nova-compute[231753]: DEBUG nova.network.neutron [req-4002baa7-6a64-4cdd-be03-f5be3c7eb30e req-849af270-2e95-4778-acbe-a612d61fd999 service nova] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Updated VIF entry in instance network info cache for port 3ca923a6-55a2-4578-ad2e-c3e9248b6af2. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:55:24 user nova-compute[231753]: DEBUG nova.network.neutron [req-4002baa7-6a64-4cdd-be03-f5be3c7eb30e req-849af270-2e95-4778-acbe-a612d61fd999 service nova] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Updating instance_info_cache with network_info: [{"id": "3ca923a6-55a2-4578-ad2e-c3e9248b6af2", "address": "fa:16:3e:39:97:1d", "network": {"id": "c5a2a904-b9ec-4da4-8206-f08aef3a48cc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2009211013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd079349ba1549b2bc93552ecb88c3e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca923a6-55", "ovs_interfaceid": "3ca923a6-55a2-4578-ad2e-c3e9248b6af2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:55:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4002baa7-6a64-4cdd-be03-f5be3c7eb30e req-849af270-2e95-4778-acbe-a612d61fd999 service nova] Releasing lock "refresh_cache-73f72f78-9abf-4b04-a973-06affde57310" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:55:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:24 user nova-compute[231753]: DEBUG nova.objects.instance [None req-b6b886d1-3ddf-4faa-8067-4c3022f73654 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lazy-loading 'flavor' on Instance uuid 97e71bc1-78c8-4cec-a935-878dd08ff941 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:55:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-b6b886d1-3ddf-4faa-8067-4c3022f73654 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "97e71bc1-78c8-4cec-a935-878dd08ff941" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 2.070s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:55:25 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Updating instance_info_cache with network_info: [{"id": "d145cf59-908e-42c4-ba8e-ce5abe640639", "address": "fa:16:3e:25:37:92", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd145cf59-90", "ovs_interfaceid": "d145cf59-908e-42c4-ba8e-ce5abe640639", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:55:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Releasing lock "refresh_cache-b99a72ba-73e2-4be7-b52b-7797351daa5f" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:55:25 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Updated the network info_cache for instance {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 13:55:25 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:55:25 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:55:25 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 13:55:25 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:55:25 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:55:25 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:55:25 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:55:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:25 user nova-compute[231753]: DEBUG nova.compute.manager [req-c14cbd47-97f6-4a0b-b23e-8a0e85b82bd1 req-1dc5f08f-0330-493e-90bb-c0809a887c28 service nova] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Received event network-vif-plugged-3ca923a6-55a2-4578-ad2e-c3e9248b6af2 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:55:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c14cbd47-97f6-4a0b-b23e-8a0e85b82bd1 req-1dc5f08f-0330-493e-90bb-c0809a887c28 service nova] Acquiring lock "73f72f78-9abf-4b04-a973-06affde57310-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:55:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c14cbd47-97f6-4a0b-b23e-8a0e85b82bd1 req-1dc5f08f-0330-493e-90bb-c0809a887c28 service nova] Lock "73f72f78-9abf-4b04-a973-06affde57310-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:55:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c14cbd47-97f6-4a0b-b23e-8a0e85b82bd1 req-1dc5f08f-0330-493e-90bb-c0809a887c28 service nova] Lock "73f72f78-9abf-4b04-a973-06affde57310-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:55:25 user nova-compute[231753]: DEBUG nova.compute.manager [req-c14cbd47-97f6-4a0b-b23e-8a0e85b82bd1 req-1dc5f08f-0330-493e-90bb-c0809a887c28 service nova] [instance: 73f72f78-9abf-4b04-a973-06affde57310] No waiting events found dispatching network-vif-plugged-3ca923a6-55a2-4578-ad2e-c3e9248b6af2 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:55:25 user nova-compute[231753]: WARNING nova.compute.manager [req-c14cbd47-97f6-4a0b-b23e-8a0e85b82bd1 req-1dc5f08f-0330-493e-90bb-c0809a887c28 service nova] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Received unexpected event network-vif-plugged-3ca923a6-55a2-4578-ad2e-c3e9248b6af2 for instance with vm_state building and task_state spawning.
Jul 29 13:55:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:27 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638927.6273634, 73f72f78-9abf-4b04-a973-06affde57310 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:55:27 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 73f72f78-9abf-4b04-a973-06affde57310] VM Resumed (Lifecycle Event)
Jul 29 13:55:27 user nova-compute[231753]: DEBUG nova.compute.manager [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:55:27 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:55:27 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Instance spawned successfully.
Jul 29 13:55:27 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:55:27 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:55:27 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:55:27 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:55:27 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:55:27 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:55:27 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:55:27 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:55:27 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:55:27 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 73f72f78-9abf-4b04-a973-06affde57310] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:55:27 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690638927.629692, 73f72f78-9abf-4b04-a973-06affde57310 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:55:27 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 73f72f78-9abf-4b04-a973-06affde57310] VM Started (Lifecycle Event)
Jul 29 13:55:27 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:55:27 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:55:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-8c343507-4f17-4046-bc54-31709526d07a req-8c913773-eb98-4bdf-aa33-57df8c1fbfbf service nova] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Received event network-vif-plugged-3ca923a6-55a2-4578-ad2e-c3e9248b6af2 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:55:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8c343507-4f17-4046-bc54-31709526d07a req-8c913773-eb98-4bdf-aa33-57df8c1fbfbf service nova] Acquiring lock "73f72f78-9abf-4b04-a973-06affde57310-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:55:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8c343507-4f17-4046-bc54-31709526d07a req-8c913773-eb98-4bdf-aa33-57df8c1fbfbf service nova] Lock "73f72f78-9abf-4b04-a973-06affde57310-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:55:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8c343507-4f17-4046-bc54-31709526d07a req-8c913773-eb98-4bdf-aa33-57df8c1fbfbf service nova] Lock "73f72f78-9abf-4b04-a973-06affde57310-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:55:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-8c343507-4f17-4046-bc54-31709526d07a req-8c913773-eb98-4bdf-aa33-57df8c1fbfbf service nova] [instance: 73f72f78-9abf-4b04-a973-06affde57310] No waiting events found dispatching network-vif-plugged-3ca923a6-55a2-4578-ad2e-c3e9248b6af2 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:55:27 user nova-compute[231753]: WARNING nova.compute.manager [req-8c343507-4f17-4046-bc54-31709526d07a req-8c913773-eb98-4bdf-aa33-57df8c1fbfbf service nova] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Received unexpected event network-vif-plugged-3ca923a6-55a2-4578-ad2e-c3e9248b6af2 for instance with vm_state building and task_state spawning.
Jul 29 13:55:27 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 73f72f78-9abf-4b04-a973-06affde57310] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:55:27 user nova-compute[231753]: INFO nova.compute.manager [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Took 6.14 seconds to spawn the instance on the hypervisor.
Jul 29 13:55:27 user nova-compute[231753]: DEBUG nova.compute.manager [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:55:27 user nova-compute[231753]: INFO nova.compute.manager [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Took 7.59 seconds to build instance.
Jul 29 13:55:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9f6a5539-a972-4e50-b907-990acb927591 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Lock "73f72f78-9abf-4b04-a973-06affde57310" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.744s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:55:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:30 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690638915.6219153, ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:55:30 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] VM Stopped (Lifecycle Event)
Jul 29 13:55:30 user nova-compute[231753]: DEBUG nova.compute.manager [None req-cf37c174-0c3f-4639-a45d-b7c21e0c6c58 None None] [instance: ef8b13f5-f5b1-46d1-8cb1-c9fd0fa42965] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:55:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:55:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7e557039-82ce-46fb-a196-3cb242bc8e12 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "b6be450b-ebe7-4385-b162-2d072237aa97" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:56:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7e557039-82ce-46fb-a196-3cb242bc8e12 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "b6be450b-ebe7-4385-b162-2d072237aa97" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:56:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7e557039-82ce-46fb-a196-3cb242bc8e12 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "b6be450b-ebe7-4385-b162-2d072237aa97-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:56:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7e557039-82ce-46fb-a196-3cb242bc8e12 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "b6be450b-ebe7-4385-b162-2d072237aa97-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:56:05 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7e557039-82ce-46fb-a196-3cb242bc8e12 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "b6be450b-ebe7-4385-b162-2d072237aa97-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:56:05 user nova-compute[231753]: INFO nova.compute.manager [None req-7e557039-82ce-46fb-a196-3cb242bc8e12 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Terminating instance
Jul 29 13:56:05 user nova-compute[231753]: DEBUG nova.compute.manager [None req-7e557039-82ce-46fb-a196-3cb242bc8e12 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:56:05 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:05 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:06 user nova-compute[231753]: DEBUG nova.compute.manager [req-bcc45fba-d7eb-4b9a-a5fd-d11b988cc162 req-8297284a-a42b-4d0f-ba1f-834798443349 service nova] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Received event network-vif-unplugged-89f0da4e-b00a-4840-b7d3-0b455f6ed266 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:56:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bcc45fba-d7eb-4b9a-a5fd-d11b988cc162 req-8297284a-a42b-4d0f-ba1f-834798443349 service nova] Acquiring lock "b6be450b-ebe7-4385-b162-2d072237aa97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:56:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bcc45fba-d7eb-4b9a-a5fd-d11b988cc162 req-8297284a-a42b-4d0f-ba1f-834798443349 service nova] Lock "b6be450b-ebe7-4385-b162-2d072237aa97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:56:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bcc45fba-d7eb-4b9a-a5fd-d11b988cc162 req-8297284a-a42b-4d0f-ba1f-834798443349 service nova] Lock "b6be450b-ebe7-4385-b162-2d072237aa97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:56:06 user nova-compute[231753]: DEBUG nova.compute.manager [req-bcc45fba-d7eb-4b9a-a5fd-d11b988cc162 req-8297284a-a42b-4d0f-ba1f-834798443349 service nova] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] No waiting events found dispatching network-vif-unplugged-89f0da4e-b00a-4840-b7d3-0b455f6ed266 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:56:06 user nova-compute[231753]: DEBUG nova.compute.manager [req-bcc45fba-d7eb-4b9a-a5fd-d11b988cc162 req-8297284a-a42b-4d0f-ba1f-834798443349 service nova] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Received event network-vif-unplugged-89f0da4e-b00a-4840-b7d3-0b455f6ed266 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:56:06 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:06 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:06 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:06 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:06 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Instance destroyed successfully.
Jul 29 13:56:06 user nova-compute[231753]: DEBUG nova.objects.instance [None req-7e557039-82ce-46fb-a196-3cb242bc8e12 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lazy-loading 'resources' on Instance uuid b6be450b-ebe7-4385-b162-2d072237aa97 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:56:06 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-7e557039-82ce-46fb-a196-3cb242bc8e12 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:46:41Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1809390612',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1809390612',id=32,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:46:49Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c01165e83a3143ad83f050790f2b63fe',ramdisk_id='',reservation_id='r-ewzymtzu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-93506270',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:48:40Z,user_data=None,user_id='618ce2d56c3c4ee8ace871d308ca45fb',uuid=b6be450b-ebe7-4385-b162-2d072237aa97,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "89f0da4e-b00a-4840-b7d3-0b455f6ed266", "address": "fa:16:3e:73:e6:fa", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f0da4e-b0", "ovs_interfaceid": "89f0da4e-b00a-4840-b7d3-0b455f6ed266", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:56:06 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-7e557039-82ce-46fb-a196-3cb242bc8e12 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Converting VIF {"id": "89f0da4e-b00a-4840-b7d3-0b455f6ed266", "address": "fa:16:3e:73:e6:fa", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap89f0da4e-b0", "ovs_interfaceid": "89f0da4e-b00a-4840-b7d3-0b455f6ed266", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:56:06 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-7e557039-82ce-46fb-a196-3cb242bc8e12 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:73:e6:fa,bridge_name='br-int',has_traffic_filtering=True,id=89f0da4e-b00a-4840-b7d3-0b455f6ed266,network=Network(03362fcb-afd6-4b0a-af44-a54a848c59f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f0da4e-b0') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:56:06 user nova-compute[231753]: DEBUG os_vif [None req-7e557039-82ce-46fb-a196-3cb242bc8e12 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:e6:fa,bridge_name='br-int',has_traffic_filtering=True,id=89f0da4e-b00a-4840-b7d3-0b455f6ed266,network=Network(03362fcb-afd6-4b0a-af44-a54a848c59f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f0da4e-b0') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:56:06 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:06 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:06 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap89f0da4e-b0, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:56:06 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:06 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:56:06 user nova-compute[231753]: INFO os_vif [None req-7e557039-82ce-46fb-a196-3cb242bc8e12 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:73:e6:fa,bridge_name='br-int',has_traffic_filtering=True,id=89f0da4e-b00a-4840-b7d3-0b455f6ed266,network=Network(03362fcb-afd6-4b0a-af44-a54a848c59f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap89f0da4e-b0')
Jul 29 13:56:06 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-7e557039-82ce-46fb-a196-3cb242bc8e12 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Deleting instance files /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97_del
Jul 29 13:56:06 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-7e557039-82ce-46fb-a196-3cb242bc8e12 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Deletion of /opt/stack/data/nova/instances/b6be450b-ebe7-4385-b162-2d072237aa97_del complete
Jul 29 13:56:06 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:06 user nova-compute[231753]: INFO nova.compute.manager [None req-7e557039-82ce-46fb-a196-3cb242bc8e12 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Took 0.88 seconds to destroy the instance on the hypervisor.
Jul 29 13:56:06 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-7e557039-82ce-46fb-a196-3cb242bc8e12 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:56:06 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:56:06 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:56:06 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:06 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:07 user nova-compute[231753]: DEBUG nova.compute.manager [req-ecdf179b-7328-48c1-b24e-2d137a2c046a req-f014c5d8-ed20-4666-98ca-1e7d7a6ef8a4 service nova] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Received event network-vif-deleted-89f0da4e-b00a-4840-b7d3-0b455f6ed266 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:56:07 user nova-compute[231753]: INFO nova.compute.manager [req-ecdf179b-7328-48c1-b24e-2d137a2c046a req-f014c5d8-ed20-4666-98ca-1e7d7a6ef8a4 service nova] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Neutron deleted interface 89f0da4e-b00a-4840-b7d3-0b455f6ed266; detaching it from the instance and deleting it from the info cache
Jul 29 13:56:07 user nova-compute[231753]: DEBUG nova.network.neutron [req-ecdf179b-7328-48c1-b24e-2d137a2c046a req-f014c5d8-ed20-4666-98ca-1e7d7a6ef8a4 service nova] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:56:07 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:56:07 user nova-compute[231753]: DEBUG nova.compute.manager [req-ecdf179b-7328-48c1-b24e-2d137a2c046a req-f014c5d8-ed20-4666-98ca-1e7d7a6ef8a4 service nova] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Detach interface failed, port_id=89f0da4e-b00a-4840-b7d3-0b455f6ed266, reason: Instance b6be450b-ebe7-4385-b162-2d072237aa97 could not be found. {{(pid=231753) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 13:56:07 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Took 0.65 seconds to deallocate network for instance.
Jul 29 13:56:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7e557039-82ce-46fb-a196-3cb242bc8e12 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:56:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7e557039-82ce-46fb-a196-3cb242bc8e12 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:56:07 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-7e557039-82ce-46fb-a196-3cb242bc8e12 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:56:07 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-7e557039-82ce-46fb-a196-3cb242bc8e12 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:56:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7e557039-82ce-46fb-a196-3cb242bc8e12 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.275s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:56:07 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-7e557039-82ce-46fb-a196-3cb242bc8e12 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Deleted allocations for instance b6be450b-ebe7-4385-b162-2d072237aa97
Jul 29 13:56:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7e557039-82ce-46fb-a196-3cb242bc8e12 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "b6be450b-ebe7-4385-b162-2d072237aa97" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.978s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:56:08 user nova-compute[231753]: DEBUG nova.compute.manager [req-da44e40e-83c4-4cbc-a165-c14ee370f7f8 req-7e8f1205-568a-4bbe-a857-fea5a4fd6de6 service nova] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Received event network-vif-plugged-89f0da4e-b00a-4840-b7d3-0b455f6ed266 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:56:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-da44e40e-83c4-4cbc-a165-c14ee370f7f8 req-7e8f1205-568a-4bbe-a857-fea5a4fd6de6 service nova] Acquiring lock "b6be450b-ebe7-4385-b162-2d072237aa97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:56:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-da44e40e-83c4-4cbc-a165-c14ee370f7f8 req-7e8f1205-568a-4bbe-a857-fea5a4fd6de6 service nova] Lock "b6be450b-ebe7-4385-b162-2d072237aa97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:56:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-da44e40e-83c4-4cbc-a165-c14ee370f7f8 req-7e8f1205-568a-4bbe-a857-fea5a4fd6de6 service nova] Lock "b6be450b-ebe7-4385-b162-2d072237aa97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:56:08 user nova-compute[231753]: DEBUG nova.compute.manager [req-da44e40e-83c4-4cbc-a165-c14ee370f7f8 req-7e8f1205-568a-4bbe-a857-fea5a4fd6de6 service nova] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] No waiting events found dispatching network-vif-plugged-89f0da4e-b00a-4840-b7d3-0b455f6ed266 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:56:08 user nova-compute[231753]: WARNING nova.compute.manager [req-da44e40e-83c4-4cbc-a165-c14ee370f7f8 req-7e8f1205-568a-4bbe-a857-fea5a4fd6de6 service nova] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Received unexpected event network-vif-plugged-89f0da4e-b00a-4840-b7d3-0b455f6ed266 for instance with vm_state deleted and task_state None.
Jul 29 13:56:08 user nova-compute[231753]: DEBUG nova.compute.manager [req-da44e40e-83c4-4cbc-a165-c14ee370f7f8 req-7e8f1205-568a-4bbe-a857-fea5a4fd6de6 service nova] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Received event network-vif-plugged-89f0da4e-b00a-4840-b7d3-0b455f6ed266 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:56:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-da44e40e-83c4-4cbc-a165-c14ee370f7f8 req-7e8f1205-568a-4bbe-a857-fea5a4fd6de6 service nova] Acquiring lock "b6be450b-ebe7-4385-b162-2d072237aa97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:56:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-da44e40e-83c4-4cbc-a165-c14ee370f7f8 req-7e8f1205-568a-4bbe-a857-fea5a4fd6de6 service nova] Lock "b6be450b-ebe7-4385-b162-2d072237aa97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:56:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-da44e40e-83c4-4cbc-a165-c14ee370f7f8 req-7e8f1205-568a-4bbe-a857-fea5a4fd6de6 service nova] Lock "b6be450b-ebe7-4385-b162-2d072237aa97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:56:08 user nova-compute[231753]: DEBUG nova.compute.manager [req-da44e40e-83c4-4cbc-a165-c14ee370f7f8 req-7e8f1205-568a-4bbe-a857-fea5a4fd6de6 service nova] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] No waiting events found dispatching network-vif-plugged-89f0da4e-b00a-4840-b7d3-0b455f6ed266 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:56:08 user nova-compute[231753]: WARNING nova.compute.manager [req-da44e40e-83c4-4cbc-a165-c14ee370f7f8 req-7e8f1205-568a-4bbe-a857-fea5a4fd6de6 service nova] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Received unexpected event network-vif-plugged-89f0da4e-b00a-4840-b7d3-0b455f6ed266 for instance with vm_state deleted and task_state None.
Jul 29 13:56:08 user nova-compute[231753]: DEBUG nova.compute.manager [req-da44e40e-83c4-4cbc-a165-c14ee370f7f8 req-7e8f1205-568a-4bbe-a857-fea5a4fd6de6 service nova] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Received event network-vif-plugged-89f0da4e-b00a-4840-b7d3-0b455f6ed266 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:56:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-da44e40e-83c4-4cbc-a165-c14ee370f7f8 req-7e8f1205-568a-4bbe-a857-fea5a4fd6de6 service nova] Acquiring lock "b6be450b-ebe7-4385-b162-2d072237aa97-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:56:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-da44e40e-83c4-4cbc-a165-c14ee370f7f8 req-7e8f1205-568a-4bbe-a857-fea5a4fd6de6 service nova] Lock "b6be450b-ebe7-4385-b162-2d072237aa97-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:56:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-da44e40e-83c4-4cbc-a165-c14ee370f7f8 req-7e8f1205-568a-4bbe-a857-fea5a4fd6de6 service nova] Lock "b6be450b-ebe7-4385-b162-2d072237aa97-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:56:08 user nova-compute[231753]: DEBUG nova.compute.manager [req-da44e40e-83c4-4cbc-a165-c14ee370f7f8 req-7e8f1205-568a-4bbe-a857-fea5a4fd6de6 service nova] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] No waiting events found dispatching network-vif-plugged-89f0da4e-b00a-4840-b7d3-0b455f6ed266 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:56:08 user nova-compute[231753]: WARNING nova.compute.manager [req-da44e40e-83c4-4cbc-a165-c14ee370f7f8 req-7e8f1205-568a-4bbe-a857-fea5a4fd6de6 service nova] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Received unexpected event network-vif-plugged-89f0da4e-b00a-4840-b7d3-0b455f6ed266 for instance with vm_state deleted and task_state None.
Jul 29 13:56:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:11 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:56:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=231753) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 13:56:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 13:56:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 13:56:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-52cfab7b-132a-45c4-9c9c-354c379449b2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "97e71bc1-78c8-4cec-a935-878dd08ff941" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:56:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-52cfab7b-132a-45c4-9c9c-354c379449b2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "97e71bc1-78c8-4cec-a935-878dd08ff941" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:56:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-52cfab7b-132a-45c4-9c9c-354c379449b2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "97e71bc1-78c8-4cec-a935-878dd08ff941-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:56:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-52cfab7b-132a-45c4-9c9c-354c379449b2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "97e71bc1-78c8-4cec-a935-878dd08ff941-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:56:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-52cfab7b-132a-45c4-9c9c-354c379449b2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "97e71bc1-78c8-4cec-a935-878dd08ff941-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:56:18 user nova-compute[231753]: INFO nova.compute.manager [None req-52cfab7b-132a-45c4-9c9c-354c379449b2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Terminating instance
Jul 29 13:56:18 user nova-compute[231753]: DEBUG nova.compute.manager [None req-52cfab7b-132a-45c4-9c9c-354c379449b2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:56:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:18 user nova-compute[231753]: DEBUG nova.compute.manager [req-236f7ca7-f97d-432a-adfc-6da0e6654cec req-4d2d7549-60d4-463e-ae81-33c82b5c3c12 service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Received event network-vif-unplugged-75a46a16-882f-4bf9-96bf-a6874ecfbcc1 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:56:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-236f7ca7-f97d-432a-adfc-6da0e6654cec req-4d2d7549-60d4-463e-ae81-33c82b5c3c12 service nova] Acquiring lock "97e71bc1-78c8-4cec-a935-878dd08ff941-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:56:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-236f7ca7-f97d-432a-adfc-6da0e6654cec req-4d2d7549-60d4-463e-ae81-33c82b5c3c12 service nova] Lock "97e71bc1-78c8-4cec-a935-878dd08ff941-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:56:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-236f7ca7-f97d-432a-adfc-6da0e6654cec req-4d2d7549-60d4-463e-ae81-33c82b5c3c12 service nova] Lock "97e71bc1-78c8-4cec-a935-878dd08ff941-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:56:18 user nova-compute[231753]: DEBUG nova.compute.manager [req-236f7ca7-f97d-432a-adfc-6da0e6654cec req-4d2d7549-60d4-463e-ae81-33c82b5c3c12 service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] No waiting events found dispatching network-vif-unplugged-75a46a16-882f-4bf9-96bf-a6874ecfbcc1 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:56:18 user nova-compute[231753]: DEBUG nova.compute.manager [req-236f7ca7-f97d-432a-adfc-6da0e6654cec req-4d2d7549-60d4-463e-ae81-33c82b5c3c12 service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Received event network-vif-unplugged-75a46a16-882f-4bf9-96bf-a6874ecfbcc1 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:56:19 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Instance destroyed successfully.
Jul 29 13:56:19 user nova-compute[231753]: DEBUG nova.objects.instance [None req-52cfab7b-132a-45c4-9c9c-354c379449b2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lazy-loading 'resources' on Instance uuid 97e71bc1-78c8-4cec-a935-878dd08ff941 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:56:19 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:56:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-52cfab7b-132a-45c4-9c9c-354c379449b2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:51:16Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestMinimumBasicScenario-server-623497348',display_name='tempest-TestMinimumBasicScenario-server-623497348',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testminimumbasicscenario-server-623497348',id=37,image_ref='a69293a2-3e13-494a-9a0f-64f701eb7b42',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCDOdfCNsbojYeYIkRNTLRDWsKJreXr26I372pDbUnepiBzx/HRGHPMMnhrKYhGNX4qRkP9AX1pbq9ip43Kw9pYI3s0aq6n5ZHgh/lwRbTaOa5eLkKoFj8x7EJE+lG3xfQ==',key_name='tempest-TestMinimumBasicScenario-1021821811',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:51:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='3a0d7f4b7f8641f9890a4ac009942190',ramdisk_id='',reservation_id='r-00c46pla',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='a69293a2-3e13-494a-9a0f-64f701eb7b42',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-TestMinimumBasicScenario-187684118',owner_user_name='tempest-TestMinimumBasicScenario-187684118-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:53:37Z,user_data=None,user_id='68002afa2ff64150afe91714800481ae',uuid=97e71bc1-78c8-4cec-a935-878dd08ff941,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "75a46a16-882f-4bf9-96bf-a6874ecfbcc1", "address": "fa:16:3e:30:50:53", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a46a16-88", "ovs_interfaceid": "75a46a16-882f-4bf9-96bf-a6874ecfbcc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:56:19 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-52cfab7b-132a-45c4-9c9c-354c379449b2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Converting VIF {"id": "75a46a16-882f-4bf9-96bf-a6874ecfbcc1", "address": "fa:16:3e:30:50:53", "network": {"id": "70a92bb8-13dd-4b75-9986-5c136de68b16", "bridge": "br-int", "label": "tempest-TestMinimumBasicScenario-1519560892-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "3a0d7f4b7f8641f9890a4ac009942190", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap75a46a16-88", "ovs_interfaceid": "75a46a16-882f-4bf9-96bf-a6874ecfbcc1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:56:19 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-52cfab7b-132a-45c4-9c9c-354c379449b2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:30:50:53,bridge_name='br-int',has_traffic_filtering=True,id=75a46a16-882f-4bf9-96bf-a6874ecfbcc1,network=Network(70a92bb8-13dd-4b75-9986-5c136de68b16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a46a16-88') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:56:19 user nova-compute[231753]: DEBUG os_vif [None req-52cfab7b-132a-45c4-9c9c-354c379449b2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:50:53,bridge_name='br-int',has_traffic_filtering=True,id=75a46a16-882f-4bf9-96bf-a6874ecfbcc1,network=Network(70a92bb8-13dd-4b75-9986-5c136de68b16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a46a16-88') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:56:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap75a46a16-88, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:56:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:56:19 user nova-compute[231753]: INFO os_vif [None req-52cfab7b-132a-45c4-9c9c-354c379449b2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:30:50:53,bridge_name='br-int',has_traffic_filtering=True,id=75a46a16-882f-4bf9-96bf-a6874ecfbcc1,network=Network(70a92bb8-13dd-4b75-9986-5c136de68b16),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap75a46a16-88')
Jul 29 13:56:19 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-52cfab7b-132a-45c4-9c9c-354c379449b2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Deleting instance files /opt/stack/data/nova/instances/97e71bc1-78c8-4cec-a935-878dd08ff941_del
Jul 29 13:56:19 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-52cfab7b-132a-45c4-9c9c-354c379449b2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Deletion of /opt/stack/data/nova/instances/97e71bc1-78c8-4cec-a935-878dd08ff941_del complete
Jul 29 13:56:19 user nova-compute[231753]: INFO nova.compute.manager [None req-52cfab7b-132a-45c4-9c9c-354c379449b2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Took 0.90 seconds to destroy the instance on the hypervisor.
Jul 29 13:56:19 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-52cfab7b-132a-45c4-9c9c-354c379449b2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:56:19 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:56:19 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:56:20 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:56:20 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Took 0.61 seconds to deallocate network for instance.
Jul 29 13:56:20 user nova-compute[231753]: DEBUG nova.compute.manager [req-0c6a2c81-3363-4457-8033-964b4e97377f req-a6902612-901e-4f66-9300-0c5bc4054c7f service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Received event network-vif-deleted-75a46a16-882f-4bf9-96bf-a6874ecfbcc1 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:56:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-52cfab7b-132a-45c4-9c9c-354c379449b2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:56:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-52cfab7b-132a-45c4-9c9c-354c379449b2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:56:20 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-52cfab7b-132a-45c4-9c9c-354c379449b2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:56:20 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-52cfab7b-132a-45c4-9c9c-354c379449b2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:56:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-52cfab7b-132a-45c4-9c9c-354c379449b2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.250s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:56:20 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-52cfab7b-132a-45c4-9c9c-354c379449b2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Deleted allocations for instance 97e71bc1-78c8-4cec-a935-878dd08ff941
Jul 29 13:56:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-52cfab7b-132a-45c4-9c9c-354c379449b2 tempest-TestMinimumBasicScenario-187684118 tempest-TestMinimumBasicScenario-187684118-project-member] Lock "97e71bc1-78c8-4cec-a935-878dd08ff941" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.958s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:56:21 user nova-compute[231753]: DEBUG nova.compute.manager [req-2b8f9a2b-f710-47bd-88bd-84ee5d1c5573 req-445eda5c-9f88-4e0b-8d3e-143694e80f06 service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Received event network-vif-plugged-75a46a16-882f-4bf9-96bf-a6874ecfbcc1 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:56:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-2b8f9a2b-f710-47bd-88bd-84ee5d1c5573 req-445eda5c-9f88-4e0b-8d3e-143694e80f06 service nova] Acquiring lock "97e71bc1-78c8-4cec-a935-878dd08ff941-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:56:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-2b8f9a2b-f710-47bd-88bd-84ee5d1c5573 req-445eda5c-9f88-4e0b-8d3e-143694e80f06 service nova] Lock "97e71bc1-78c8-4cec-a935-878dd08ff941-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:56:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-2b8f9a2b-f710-47bd-88bd-84ee5d1c5573 req-445eda5c-9f88-4e0b-8d3e-143694e80f06 service nova] Lock "97e71bc1-78c8-4cec-a935-878dd08ff941-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:56:21 user nova-compute[231753]: DEBUG nova.compute.manager [req-2b8f9a2b-f710-47bd-88bd-84ee5d1c5573 req-445eda5c-9f88-4e0b-8d3e-143694e80f06 service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] No waiting events found dispatching network-vif-plugged-75a46a16-882f-4bf9-96bf-a6874ecfbcc1 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:56:21 user nova-compute[231753]: WARNING nova.compute.manager [req-2b8f9a2b-f710-47bd-88bd-84ee5d1c5573 req-445eda5c-9f88-4e0b-8d3e-143694e80f06 service nova] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Received unexpected event network-vif-plugged-75a46a16-882f-4bf9-96bf-a6874ecfbcc1 for instance with vm_state deleted and task_state None.
Jul 29 13:56:21 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:56:21 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 13:56:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "refresh_cache-1c4a953b-67c9-4c69-950a-7487735e917c" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:56:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquired lock "refresh_cache-1c4a953b-67c9-4c69-950a-7487735e917c" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:56:21 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Forcefully refreshing network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 13:56:21 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690638966.5829136, b6be450b-ebe7-4385-b162-2d072237aa97 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:56:21 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] VM Stopped (Lifecycle Event)
Jul 29 13:56:21 user nova-compute[231753]: DEBUG nova.compute.manager [None req-4ce9c8f1-7d24-4b45-9f6a-257f5081a0b8 None None] [instance: b6be450b-ebe7-4385-b162-2d072237aa97] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:56:22 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Updating instance_info_cache with network_info: [{"id": "da91541f-4471-455f-adf7-cfa9eb63de88", "address": "fa:16:3e:3d:fe:a2", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda91541f-44", "ovs_interfaceid": "da91541f-4471-455f-adf7-cfa9eb63de88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:56:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Releasing lock "refresh_cache-1c4a953b-67c9-4c69-950a-7487735e917c" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:56:22 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Updated the network info_cache for instance {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 13:56:22 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:56:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:56:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:56:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:56:22 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 13:56:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f72f78-9abf-4b04-a973-06affde57310/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f72f78-9abf-4b04-a973-06affde57310/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f72f78-9abf-4b04-a973-06affde57310/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f72f78-9abf-4b04-a973-06affde57310/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sde (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:56:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdd (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:56:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:56:23 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:56:23 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:56:23 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=8083MB free_disk=25.037322998046875GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 13:56:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:56:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:56:23 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance cf326e80-7293-4764-9411-ed05a5aeba23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:56:23 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance b99a72ba-73e2-4be7-b52b-7797351daa5f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:56:23 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 1c4a953b-67c9-4c69-950a-7487735e917c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:56:23 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:56:23 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 73f72f78-9abf-4b04-a973-06affde57310 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:56:23 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 13:56:23 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 13:56:23 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:56:23 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:56:23 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 13:56:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.411s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:56:23 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:56:23 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:56:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 13:56:24 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:56:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:26 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:56:26 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:56:27 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:56:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:34 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690638979.292586, 97e71bc1-78c8-4cec-a935-878dd08ff941 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:56:34 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] VM Stopped (Lifecycle Event)
Jul 29 13:56:34 user nova-compute[231753]: DEBUG nova.compute.manager [None req-35ec2e5b-5174-4ea7-a5b5-3ebbda3fecec None None] [instance: 97e71bc1-78c8-4cec-a935-878dd08ff941] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:56:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Acquiring lock "a3f9ad53-db31-404a-8442-37cf53f11cbc" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:56:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lock "a3f9ad53-db31-404a-8442-37cf53f11cbc" acquired by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:56:39 user nova-compute[231753]: INFO nova.compute.manager [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Unshelving
Jul 29 13:56:39 user nova-compute[231753]: INFO nova.virt.block_device [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Booting with volume 3be506b8-85e1-474c-8c6b-6f8ef82b95bf at /dev/vda
Jul 29 13:56:39 user nova-compute[231753]: DEBUG os_brick.utils [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:56:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[382c812e-9d53-45aa-9738-a1274354e2e1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:56:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ba9082f-afa3-4e3f-841e-dc21bf1f176d]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:56:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3923d893-11bc-452a-8249-5ee68abb43f9]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:56:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2754442b-bc49-4566-be7b-e42c43dfc336]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:56:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:56:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:56:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:56:39 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:56:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e463901-1f87-4752-96c7-41f67c47ee14]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:56:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:56:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:56:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:56:39 user nova-compute[231753]: DEBUG os_brick.utils [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] <== get_connector_properties: return (119ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:56:39 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Updating existing volume attachment record: 64fcdb65-10cf-4ccc-8615-e6d8e3e0f5c5 {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:56:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:56:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-6b6753a8-01e1-4599-866d-24bb54b2d3bf req-7761ecec-0cd7-49de-b899-19eb1db15908 service nova] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Received event network-changed-3c17e061-0e8d-4d45-afa6-6179b4f860e2 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:56:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-6b6753a8-01e1-4599-866d-24bb54b2d3bf req-7761ecec-0cd7-49de-b899-19eb1db15908 service nova] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Refreshing instance network info cache due to event network-changed-3c17e061-0e8d-4d45-afa6-6179b4f860e2. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:56:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6b6753a8-01e1-4599-866d-24bb54b2d3bf req-7761ecec-0cd7-49de-b899-19eb1db15908 service nova] Acquiring lock "refresh_cache-8c62c19f-f13c-4ade-a0ea-a7594c8daa0d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:56:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6b6753a8-01e1-4599-866d-24bb54b2d3bf req-7761ecec-0cd7-49de-b899-19eb1db15908 service nova] Acquired lock "refresh_cache-8c62c19f-f13c-4ade-a0ea-a7594c8daa0d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:56:44 user nova-compute[231753]: DEBUG nova.network.neutron [req-6b6753a8-01e1-4599-866d-24bb54b2d3bf req-7761ecec-0cd7-49de-b899-19eb1db15908 service nova] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Refreshing network info cache for port 3c17e061-0e8d-4d45-afa6-6179b4f860e2 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:56:45 user nova-compute[231753]: DEBUG nova.network.neutron [req-6b6753a8-01e1-4599-866d-24bb54b2d3bf req-7761ecec-0cd7-49de-b899-19eb1db15908 service nova] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Updated VIF entry in instance network info cache for port 3c17e061-0e8d-4d45-afa6-6179b4f860e2. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:56:45 user nova-compute[231753]: DEBUG nova.network.neutron [req-6b6753a8-01e1-4599-866d-24bb54b2d3bf req-7761ecec-0cd7-49de-b899-19eb1db15908 service nova] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Updating instance_info_cache with network_info: [{"id": "3c17e061-0e8d-4d45-afa6-6179b4f860e2", "address": "fa:16:3e:2e:56:1e", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.52", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c17e061-0e", "ovs_interfaceid": "3c17e061-0e8d-4d45-afa6-6179b4f860e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:56:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6b6753a8-01e1-4599-866d-24bb54b2d3bf req-7761ecec-0cd7-49de-b899-19eb1db15908 service nova] Releasing lock "refresh_cache-8c62c19f-f13c-4ade-a0ea-a7594c8daa0d" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:56:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "8c62c19f-f13c-4ade-a0ea-a7594c8daa0d" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:56:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "8c62c19f-f13c-4ade-a0ea-a7594c8daa0d" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:56:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "8c62c19f-f13c-4ade-a0ea-a7594c8daa0d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:56:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "8c62c19f-f13c-4ade-a0ea-a7594c8daa0d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:56:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "8c62c19f-f13c-4ade-a0ea-a7594c8daa0d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:56:45 user nova-compute[231753]: INFO nova.compute.manager [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Terminating instance
Jul 29 13:56:45 user nova-compute[231753]: DEBUG nova.compute.manager [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:56:45 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:45 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:45 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:45 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:45 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Instance destroyed successfully.
Jul 29 13:56:45 user nova-compute[231753]: DEBUG nova.objects.instance [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lazy-loading 'resources' on Instance uuid 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:56:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:54:52Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-image-snapshot-server-1990942375',display_name='tempest-TestVolumeBootPattern-image-snapshot-server-1990942375',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-image-snapshot-server-1990942375',id=41,image_ref='a12c16c2-cd9b-463f-9eb3-5dba5029c430',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIBgW+y+cnR8RuTrHj8CQoIXCRYJEgp/2NyW1176CxCOMhcPrkb1EL2IAgNV+HV9LlT5LA5vwN9Mshqgz6lCDmH9KJX9aYQ2yE47IAm6M4/ojV2dXoN0n30bAzEdKQAUtA==',key_name='tempest-keypair-596044462',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:55:12Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f45c92d3fe964066b9be87489b2c9f7e',ramdisk_id='',reservation_id='r-8vo5rp81',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_bdm_v2='True',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_project_name='tempest-TestVolumeBootPattern-434673895',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestVolumeBootPattern-434673895-project-member',image_root_device_name='/dev/vda',owner_project_name='tempest-TestVolumeBootPattern-434673895',owner_user_name='tempest-TestVolumeBootPattern-434673895-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:55:13Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d94a7ea0c19845b886e12c1689cf30a8',uuid=8c62c19f-f13c-4ade-a0ea-a7594c8daa0d,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3c17e061-0e8d-4d45-afa6-6179b4f860e2", "address": "fa:16:3e:2e:56:1e", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c17e061-0e", "ovs_interfaceid": "3c17e061-0e8d-4d45-afa6-6179b4f860e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:56:45 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Converting VIF {"id": "3c17e061-0e8d-4d45-afa6-6179b4f860e2", "address": "fa:16:3e:2e:56:1e", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3c17e061-0e", "ovs_interfaceid": "3c17e061-0e8d-4d45-afa6-6179b4f860e2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:56:45 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:2e:56:1e,bridge_name='br-int',has_traffic_filtering=True,id=3c17e061-0e8d-4d45-afa6-6179b4f860e2,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c17e061-0e') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:56:45 user nova-compute[231753]: DEBUG os_vif [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:56:1e,bridge_name='br-int',has_traffic_filtering=True,id=3c17e061-0e8d-4d45-afa6-6179b4f860e2,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c17e061-0e') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:56:45 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:45 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3c17e061-0e, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:56:45 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:45 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:56:45 user nova-compute[231753]: INFO os_vif [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:2e:56:1e,bridge_name='br-int',has_traffic_filtering=True,id=3c17e061-0e8d-4d45-afa6-6179b4f860e2,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3c17e061-0e')
Jul 29 13:56:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:56:45 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oHtvyifh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sde'}, None), 'kwargs': True}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:56:45 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:56:45 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:56:45 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:56:45 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:45 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:45 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[17eb78a3-d5ff-43ff-abc7-69ccf62efee8]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:56:45 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:56:45 user nova-compute[231753]: No targets found.
Jul 29 13:56:45 user nova-compute[231753]: iSNS:
Jul 29 13:56:45 user nova-compute[231753]: No targets found.
Jul 29 13:56:45 user nova-compute[231753]: STATIC:
Jul 29 13:56:45 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea
Jul 29 13:56:45 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:56:45 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:56:45 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699
Jul 29 13:56:45 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:56:45 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:56:45 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd
Jul 29 13:56:45 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:56:45 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:56:45 user nova-compute[231753]: FIRMWARE:
Jul 29 13:56:45 user nova-compute[231753]: No targets found.
Jul 29 13:56:45 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:56:45 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:56:45 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:56:45 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:56:45 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:56:45 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:45 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:45 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb6bec5-feb5-48c0-a38e-09208366dc3d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:56:45 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e60614f-17cf-41a5-84bc-de1328f3bfa2]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)\ntcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:56:46 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:56:46 user nova-compute[231753]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd (non-flash)
Jul 29 13:56:46 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:56:46 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:56:46 user nova-compute[231753]: tcp: [48] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd (non-flash)
Jul 29 13:56:46 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c983aee60>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd'): ({'sde'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Removing single pathed devices sde {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[adba29e8-a7d8-4a63-8cb2-28250e86f1c8]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sde {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sde" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[390cfd67-6b4f-4590-8049-7a521c623bcc]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Flushing IO for device /dev/sde {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sde {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sde" returned: 0 in 0.015s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ff7c83a-4cc4-4195-b63b-9807c7d7fa73]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sde/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sde/device/delete" returned: 0 in 0.042s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cd60672-54d9-4775-af2d-809e5017d0ed]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Checking to see if SCSI volumes sde have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] SCSI volumes sde have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cfe0ad1-9c86-4c0e-a432-303ae4a29879]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e521aed2-722f-4b4a-9472-17cf0c815723]: (4, ('Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd, portal: 172.16.0.220,3260]\nLogout of [sid: 48, target: iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 48, target: iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd, portal: 172.16.0.220,3260]
Jul 29 13:56:46 user nova-compute[231753]: Logout of [sid: 48, target: iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd, portal: 172.16.0.220,3260] successful.
Jul 29 13:56:46 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:30cd6d38-cf60-4904-a821-0a96b1579abd -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[91a625d0-1156-4e4c-b47d-34ff17b547b1]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.332s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] <== disconnect_volume: return (334ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:56:46 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Deleting instance files /opt/stack/data/nova/instances/8c62c19f-f13c-4ade-a0ea-a7594c8daa0d_del
Jul 29 13:56:46 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Deletion of /opt/stack/data/nova/instances/8c62c19f-f13c-4ade-a0ea-a7594c8daa0d_del complete
Jul 29 13:56:46 user nova-compute[231753]: INFO nova.compute.manager [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Took 1.32 seconds to destroy the instance on the hypervisor.
Jul 29 13:56:46 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG nova.compute.manager [req-06363942-d257-44ce-ace1-f73f8fb36029 req-169ea18f-c8b5-4e99-948f-acde7c6e7ae7 service nova] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Received event network-vif-unplugged-3c17e061-0e8d-4d45-afa6-6179b4f860e2 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-06363942-d257-44ce-ace1-f73f8fb36029 req-169ea18f-c8b5-4e99-948f-acde7c6e7ae7 service nova] Acquiring lock "8c62c19f-f13c-4ade-a0ea-a7594c8daa0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-06363942-d257-44ce-ace1-f73f8fb36029 req-169ea18f-c8b5-4e99-948f-acde7c6e7ae7 service nova] Lock "8c62c19f-f13c-4ade-a0ea-a7594c8daa0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-06363942-d257-44ce-ace1-f73f8fb36029 req-169ea18f-c8b5-4e99-948f-acde7c6e7ae7 service nova] Lock "8c62c19f-f13c-4ade-a0ea-a7594c8daa0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG nova.compute.manager [req-06363942-d257-44ce-ace1-f73f8fb36029 req-169ea18f-c8b5-4e99-948f-acde7c6e7ae7 service nova] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] No waiting events found dispatching network-vif-unplugged-3c17e061-0e8d-4d45-afa6-6179b4f860e2 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG nova.compute.manager [req-06363942-d257-44ce-ace1-f73f8fb36029 req-169ea18f-c8b5-4e99-948f-acde7c6e7ae7 service nova] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Received event network-vif-unplugged-3c17e061-0e8d-4d45-afa6-6179b4f860e2 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG nova.compute.manager [req-06363942-d257-44ce-ace1-f73f8fb36029 req-169ea18f-c8b5-4e99-948f-acde7c6e7ae7 service nova] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Received event network-vif-plugged-3c17e061-0e8d-4d45-afa6-6179b4f860e2 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-06363942-d257-44ce-ace1-f73f8fb36029 req-169ea18f-c8b5-4e99-948f-acde7c6e7ae7 service nova] Acquiring lock "8c62c19f-f13c-4ade-a0ea-a7594c8daa0d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-06363942-d257-44ce-ace1-f73f8fb36029 req-169ea18f-c8b5-4e99-948f-acde7c6e7ae7 service nova] Lock "8c62c19f-f13c-4ade-a0ea-a7594c8daa0d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-06363942-d257-44ce-ace1-f73f8fb36029 req-169ea18f-c8b5-4e99-948f-acde7c6e7ae7 service nova] Lock "8c62c19f-f13c-4ade-a0ea-a7594c8daa0d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:56:46 user nova-compute[231753]: DEBUG nova.compute.manager [req-06363942-d257-44ce-ace1-f73f8fb36029 req-169ea18f-c8b5-4e99-948f-acde7c6e7ae7 service nova] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] No waiting events found dispatching network-vif-plugged-3c17e061-0e8d-4d45-afa6-6179b4f860e2 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:56:46 user nova-compute[231753]: WARNING nova.compute.manager [req-06363942-d257-44ce-ace1-f73f8fb36029 req-169ea18f-c8b5-4e99-948f-acde7c6e7ae7 service nova] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Received unexpected event network-vif-plugged-3c17e061-0e8d-4d45-afa6-6179b4f860e2 for instance with vm_state active and task_state deleting.
Jul 29 13:56:47 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:56:47 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Took 0.97 seconds to deallocate network for instance.
Jul 29 13:56:47 user nova-compute[231753]: DEBUG nova.compute.manager [req-dca71816-d477-4483-84e0-b98bb1128e23 req-0f63fcf7-0198-45c4-8b6f-27ac37fd5143 service nova] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Received event network-vif-deleted-3c17e061-0e8d-4d45-afa6-6179b4f860e2 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:56:48 user nova-compute[231753]: INFO nova.compute.manager [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Took 0.72 seconds to detach 1 volumes for instance.
Jul 29 13:56:48 user nova-compute[231753]: DEBUG nova.compute.manager [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Deleting volume: 30cd6d38-cf60-4904-a821-0a96b1579abd {{(pid=231753) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 29 13:56:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:56:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:56:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:56:48 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:56:48 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:56:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.228s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:56:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.215s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:56:48 user nova-compute[231753]: DEBUG nova.objects.instance [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lazy-loading 'pci_requests' on Instance uuid a3f9ad53-db31-404a-8442-37cf53f11cbc {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:56:48 user nova-compute[231753]: DEBUG nova.objects.instance [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lazy-loading 'numa_topology' on Instance uuid a3f9ad53-db31-404a-8442-37cf53f11cbc {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:56:48 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Deleted allocations for instance 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d
Jul 29 13:56:48 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:56:48 user nova-compute[231753]: INFO nova.compute.claims [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Claim successful on node user
Jul 29 13:56:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7df00d24-b5e6-420c-8b1c-a98cc87baf82 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "8c62c19f-f13c-4ade-a0ea-a7594c8daa0d" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.491s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:56:48 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:56:48 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:56:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.301s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:56:48 user nova-compute[231753]: INFO nova.network.neutron [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Updating port b6be4498-da79-4335-9f95-6a191a4ce127 with attributes {'binding:host_id': 'user', 'device_owner': 'compute:nova'}
Jul 29 13:56:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Acquiring lock "refresh_cache-a3f9ad53-db31-404a-8442-37cf53f11cbc" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:56:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Acquired lock "refresh_cache-a3f9ad53-db31-404a-8442-37cf53f11cbc" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:56:49 user nova-compute[231753]: DEBUG nova.network.neutron [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:56:49 user nova-compute[231753]: DEBUG nova.compute.manager [req-ec84fe62-bf4a-4185-a87a-18bd92e16e7c req-1e9c25e4-8b39-49b2-a5b9-3e66140e59d8 service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Received event network-changed-b6be4498-da79-4335-9f95-6a191a4ce127 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:56:49 user nova-compute[231753]: DEBUG nova.compute.manager [req-ec84fe62-bf4a-4185-a87a-18bd92e16e7c req-1e9c25e4-8b39-49b2-a5b9-3e66140e59d8 service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Refreshing instance network info cache due to event network-changed-b6be4498-da79-4335-9f95-6a191a4ce127. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:56:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ec84fe62-bf4a-4185-a87a-18bd92e16e7c req-1e9c25e4-8b39-49b2-a5b9-3e66140e59d8 service nova] Acquiring lock "refresh_cache-a3f9ad53-db31-404a-8442-37cf53f11cbc" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG nova.network.neutron [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Updating instance_info_cache with network_info: [{"id": "b6be4498-da79-4335-9f95-6a191a4ce127", "address": "fa:16:3e:c2:b5:20", "network": {"id": "e36e72a2-fbed-483c-827c-436fa6786390", "bridge": "br-int", "label": "tempest-TestShelveInstance-2100930356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b552c0991c456eb101472ca6777f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6be4498-da", "ovs_interfaceid": "b6be4498-da79-4335-9f95-6a191a4ce127", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Releasing lock "refresh_cache-a3f9ad53-db31-404a-8442-37cf53f11cbc" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:56:50 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Creating image(s)
Jul 29 13:56:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Did not create local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Ensure instance console log exists: /opt/stack/data/nova/instances/a3f9ad53-db31-404a-8442-37cf53f11cbc/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Start _get_guest_xml network_info=[{"id": "b6be4498-da79-4335-9f95-6a191a4ce127", "address": "fa:16:3e:c2:b5:20", "network": {"id": "e36e72a2-fbed-483c-827c-436fa6786390", "bridge": "br-int", "label": "tempest-TestShelveInstance-2100930356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b552c0991c456eb101472ca6777f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6be4498-da", "ovs_interfaceid": "b6be4498-da79-4335-9f95-6a191a4ce127", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZYvkJSh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': 'a3f9ad53-db31-404a-8442-37cf53f11cbc', 'attached_at': '', 'detached_at': '', 'volume_id': '3be506b8-85e1-474c-8c6b-6f8ef82b95bf', 'serial': '3be506b8-85e1-474c-8c6b-6f8ef82b95bf'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': True, 'attachment_id': '64fcdb65-10cf-4ccc-8615-e6d8e3e0f5c5', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ec84fe62-bf4a-4185-a87a-18bd92e16e7c req-1e9c25e4-8b39-49b2-a5b9-3e66140e59d8 service nova] Acquired lock "refresh_cache-a3f9ad53-db31-404a-8442-37cf53f11cbc" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG nova.network.neutron [req-ec84fe62-bf4a-4185-a87a-18bd92e16e7c req-1e9c25e4-8b39-49b2-a5b9-3e66140e59d8 service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Refreshing network info cache for port b6be4498-da79-4335-9f95-6a191a4ce127 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:56:50 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:56:50 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:56:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=1,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=<?>,status=<?>,tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG nova.objects.instance [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lazy-loading 'vcpu_model' on Instance uuid a3f9ad53-db31-404a-8442-37cf53f11cbc {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZYvkJSh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:56:50 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:56:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:56:50 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:56:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:56:50 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[97e205ad-4610-4844-a7f0-2371578f5ed9]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:56:50 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[af0803e1-9944-46a7-8e9d-d7c6871c8587]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf] added
Jul 29 13:56:50 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[250f5cf1-7e25-4ccd-91ce-f44e7904f09b]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1e7bc9-e7ae-4d80-9f9f-3fdd8e9f0e5e]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BZYvkJSh {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --op update -n node.session.auth.username -v BZYvkJSh" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c6c7079-85be-4d8c-8486-007821ee8ed0]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'BZYvkJSh'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[1004aac5-5dc1-474b-94e4-a869eae56928]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[07475f7a-ef8f-4ac0-a260-81d284e27b95]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:56:50 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:56:50 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:56:50 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:56:50 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1d32d2b-d865-4874-852d-5d58fae1cbb0]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf, portal: 172.16.0.220,3260]
Jul 29 13:56:50 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf, portal: 172.16.0.220,3260] successful.
Jul 29 13:56:50 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0390a7dc-7536-48a4-b5fe-03a927b3f68a]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f101c818-702d-49b0-bf94-3031982a1f8d]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:56:50 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:56:50 user nova-compute[231753]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)
Jul 29 13:56:50 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:56:50 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:56:50 user nova-compute[231753]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)
Jul 29 13:56:50 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.296s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] HCTL ('33', '-', '-', 0) found on session 49 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0d9145-d9be-4002-804d-1d67c0e75144]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Searching for a device in session 49 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZYvkJSh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:56:50 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:51 user nova-compute[231753]: DEBUG nova.network.neutron [req-ec84fe62-bf4a-4185-a87a-18bd92e16e7c req-1e9c25e4-8b39-49b2-a5b9-3e66140e59d8 service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Updated VIF entry in instance network info cache for port b6be4498-da79-4335-9f95-6a191a4ce127. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:56:51 user nova-compute[231753]: DEBUG nova.network.neutron [req-ec84fe62-bf4a-4185-a87a-18bd92e16e7c req-1e9c25e4-8b39-49b2-a5b9-3e66140e59d8 service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Updating instance_info_cache with network_info: [{"id": "b6be4498-da79-4335-9f95-6a191a4ce127", "address": "fa:16:3e:c2:b5:20", "network": {"id": "e36e72a2-fbed-483c-827c-436fa6786390", "bridge": "br-int", "label": "tempest-TestShelveInstance-2100930356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b552c0991c456eb101472ca6777f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6be4498-da", "ovs_interfaceid": "b6be4498-da79-4335-9f95-6a191a4ce127", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:56:51 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-ec84fe62-bf4a-4185-a87a-18bd92e16e7c req-1e9c25e4-8b39-49b2-a5b9-3e66140e59d8 service nova] Releasing lock "refresh_cache-a3f9ad53-db31-404a-8442-37cf53f11cbc" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:56:51 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.334s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:56:51 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] <== connect_volume: return (1335ms) {'type': 'block', 'scsi_wwn': '26263613832393537', 'path': '/dev/sdb'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:56:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26263613832393537', 'path': '/dev/sdb'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:56:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-29T13:52:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2135603216',display_name='tempest-TestShelveInstance-server-2135603216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2135603216',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-537474645',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:53:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='06b552c0991c456eb101472ca6777f19',ramdisk_id='',reservation_id='r-g6l31lk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-108803446',owner_user_name='tempest-TestShelveInstance-108803446-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:56:40Z,user_data=None,user_id='3d35af1d300041a2b0fd8039d1a4b623',uuid=a3f9ad53-db31-404a-8442-37cf53f11cbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b6be4498-da79-4335-9f95-6a191a4ce127", "address": "fa:16:3e:c2:b5:20", "network": {"id": "e36e72a2-fbed-483c-827c-436fa6786390", "bridge": "br-int", "label": "tempest-TestShelveInstance-2100930356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b552c0991c456eb101472ca6777f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6be4498-da", "ovs_interfaceid": "b6be4498-da79-4335-9f95-6a191a4ce127", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:56:51 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Converting VIF {"id": "b6be4498-da79-4335-9f95-6a191a4ce127", "address": "fa:16:3e:c2:b5:20", "network": {"id": "e36e72a2-fbed-483c-827c-436fa6786390", "bridge": "br-int", "label": "tempest-TestShelveInstance-2100930356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b552c0991c456eb101472ca6777f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6be4498-da", "ovs_interfaceid": "b6be4498-da79-4335-9f95-6a191a4ce127", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:56:51 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:b5:20,bridge_name='br-int',has_traffic_filtering=True,id=b6be4498-da79-4335-9f95-6a191a4ce127,network=Network(e36e72a2-fbed-483c-827c-436fa6786390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6be4498-da') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:56:51 user nova-compute[231753]: DEBUG nova.objects.instance [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lazy-loading 'pci_devices' on Instance uuid a3f9ad53-db31-404a-8442-37cf53f11cbc {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:56:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:56:51 user nova-compute[231753]:   <uuid>a3f9ad53-db31-404a-8442-37cf53f11cbc</uuid>
Jul 29 13:56:51 user nova-compute[231753]:   <name>instance-00000028</name>
Jul 29 13:56:51 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:56:51 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:56:51 user nova-compute[231753]:   <metadata>
Jul 29 13:56:51 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:56:51 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:56:51 user nova-compute[231753]:       <nova:name>tempest-TestShelveInstance-server-2135603216</nova:name>
Jul 29 13:56:51 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:56:50</nova:creationTime>
Jul 29 13:56:51 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:56:51 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:56:51 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:56:51 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:56:51 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:56:51 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:56:51 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:56:51 user nova-compute[231753]:       <nova:owner>
Jul 29 13:56:51 user nova-compute[231753]:         <nova:user uuid="3d35af1d300041a2b0fd8039d1a4b623">tempest-TestShelveInstance-108803446-project-member</nova:user>
Jul 29 13:56:51 user nova-compute[231753]:         <nova:project uuid="06b552c0991c456eb101472ca6777f19">tempest-TestShelveInstance-108803446</nova:project>
Jul 29 13:56:51 user nova-compute[231753]:       </nova:owner>
Jul 29 13:56:51 user nova-compute[231753]:       <nova:ports>
Jul 29 13:56:51 user nova-compute[231753]:         <nova:port uuid="b6be4498-da79-4335-9f95-6a191a4ce127">
Jul 29 13:56:51 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 29 13:56:51 user nova-compute[231753]:         </nova:port>
Jul 29 13:56:51 user nova-compute[231753]:       </nova:ports>
Jul 29 13:56:51 user nova-compute[231753]:     </nova:instance>
Jul 29 13:56:51 user nova-compute[231753]:   </metadata>
Jul 29 13:56:51 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:56:51 user nova-compute[231753]:     <system>
Jul 29 13:56:51 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:56:51 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:56:51 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:56:51 user nova-compute[231753]:       <entry name="serial">a3f9ad53-db31-404a-8442-37cf53f11cbc</entry>
Jul 29 13:56:51 user nova-compute[231753]:       <entry name="uuid">a3f9ad53-db31-404a-8442-37cf53f11cbc</entry>
Jul 29 13:56:51 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:56:51 user nova-compute[231753]:     </system>
Jul 29 13:56:51 user nova-compute[231753]:   </sysinfo>
Jul 29 13:56:51 user nova-compute[231753]:   <os>
Jul 29 13:56:51 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:56:51 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:56:51 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:56:51 user nova-compute[231753]:   </os>
Jul 29 13:56:51 user nova-compute[231753]:   <features>
Jul 29 13:56:51 user nova-compute[231753]:     <acpi/>
Jul 29 13:56:51 user nova-compute[231753]:     <apic/>
Jul 29 13:56:51 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:56:51 user nova-compute[231753]:   </features>
Jul 29 13:56:51 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:56:51 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:56:51 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:56:51 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:56:51 user nova-compute[231753]:   </clock>
Jul 29 13:56:51 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:56:51 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:56:51 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:56:51 user nova-compute[231753]:   </cpu>
Jul 29 13:56:51 user nova-compute[231753]:   <devices>
Jul 29 13:56:51 user nova-compute[231753]:     <disk type="block" device="disk">
Jul 29 13:56:51 user nova-compute[231753]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:56:51 user nova-compute[231753]:       <source dev="/dev/sdb"/>
Jul 29 13:56:51 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:56:51 user nova-compute[231753]:       <serial>3be506b8-85e1-474c-8c6b-6f8ef82b95bf</serial>
Jul 29 13:56:51 user nova-compute[231753]:     </disk>
Jul 29 13:56:51 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:56:51 user nova-compute[231753]:       <mac address="fa:16:3e:c2:b5:20"/>
Jul 29 13:56:51 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:56:51 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:56:51 user nova-compute[231753]:       <target dev="tapb6be4498-da"/>
Jul 29 13:56:51 user nova-compute[231753]:     </interface>
Jul 29 13:56:51 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:56:51 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/a3f9ad53-db31-404a-8442-37cf53f11cbc/console.log" append="off"/>
Jul 29 13:56:51 user nova-compute[231753]:     </serial>
Jul 29 13:56:51 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:56:51 user nova-compute[231753]:     <video>
Jul 29 13:56:51 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:56:51 user nova-compute[231753]:     </video>
Jul 29 13:56:51 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:56:51 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:56:51 user nova-compute[231753]:     </rng>
Jul 29 13:56:51 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:56:51 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:56:51 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:56:51 user nova-compute[231753]:     </memballoon>
Jul 29 13:56:51 user nova-compute[231753]:   </devices>
Jul 29 13:56:51 user nova-compute[231753]: </domain>
Jul 29 13:56:51 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:56:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-29T13:52:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2135603216',display_name='tempest-TestShelveInstance-server-2135603216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2135603216',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name='tempest-TestShelveInstance-537474645',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:53:11Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='06b552c0991c456eb101472ca6777f19',ramdisk_id='',reservation_id='r-g6l31lk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-108803446',owner_user_name='tempest-TestShelveInstance-108803446-project-member'},tags=<?>,task_state='spawning',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:56:40Z,user_data=None,user_id='3d35af1d300041a2b0fd8039d1a4b623',uuid=a3f9ad53-db31-404a-8442-37cf53f11cbc,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b6be4498-da79-4335-9f95-6a191a4ce127", "address": "fa:16:3e:c2:b5:20", "network": {"id": "e36e72a2-fbed-483c-827c-436fa6786390", "bridge": "br-int", "label": "tempest-TestShelveInstance-2100930356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b552c0991c456eb101472ca6777f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6be4498-da", "ovs_interfaceid": "b6be4498-da79-4335-9f95-6a191a4ce127", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:56:51 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Converting VIF {"id": "b6be4498-da79-4335-9f95-6a191a4ce127", "address": "fa:16:3e:c2:b5:20", "network": {"id": "e36e72a2-fbed-483c-827c-436fa6786390", "bridge": "br-int", "label": "tempest-TestShelveInstance-2100930356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b552c0991c456eb101472ca6777f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6be4498-da", "ovs_interfaceid": "b6be4498-da79-4335-9f95-6a191a4ce127", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:56:51 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c2:b5:20,bridge_name='br-int',has_traffic_filtering=True,id=b6be4498-da79-4335-9f95-6a191a4ce127,network=Network(e36e72a2-fbed-483c-827c-436fa6786390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6be4498-da') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:56:51 user nova-compute[231753]: DEBUG os_vif [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:b5:20,bridge_name='br-int',has_traffic_filtering=True,id=b6be4498-da79-4335-9f95-6a191a4ce127,network=Network(e36e72a2-fbed-483c-827c-436fa6786390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6be4498-da') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:56:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:56:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:56:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6be4498-da, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:56:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapb6be4498-da, col_values=(('external_ids', {'iface-id': 'b6be4498-da79-4335-9f95-6a191a4ce127', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c2:b5:20', 'vm-uuid': 'a3f9ad53-db31-404a-8442-37cf53f11cbc'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:56:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:56:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:51 user nova-compute[231753]: INFO os_vif [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c2:b5:20,bridge_name='br-int',has_traffic_filtering=True,id=b6be4498-da79-4335-9f95-6a191a4ce127,network=Network(e36e72a2-fbed-483c-827c-436fa6786390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6be4498-da')
Jul 29 13:56:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:56:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] No VIF found with MAC fa:16:3e:c2:b5:20, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:56:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:53 user nova-compute[231753]: DEBUG nova.compute.manager [req-c3f3adca-5a18-410f-a80f-502ab4e9087f req-df189a5d-9f5b-4849-86e6-d3166e6e3875 service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Received event network-vif-plugged-b6be4498-da79-4335-9f95-6a191a4ce127 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:56:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c3f3adca-5a18-410f-a80f-502ab4e9087f req-df189a5d-9f5b-4849-86e6-d3166e6e3875 service nova] Acquiring lock "a3f9ad53-db31-404a-8442-37cf53f11cbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:56:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c3f3adca-5a18-410f-a80f-502ab4e9087f req-df189a5d-9f5b-4849-86e6-d3166e6e3875 service nova] Lock "a3f9ad53-db31-404a-8442-37cf53f11cbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:56:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c3f3adca-5a18-410f-a80f-502ab4e9087f req-df189a5d-9f5b-4849-86e6-d3166e6e3875 service nova] Lock "a3f9ad53-db31-404a-8442-37cf53f11cbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:56:53 user nova-compute[231753]: DEBUG nova.compute.manager [req-c3f3adca-5a18-410f-a80f-502ab4e9087f req-df189a5d-9f5b-4849-86e6-d3166e6e3875 service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] No waiting events found dispatching network-vif-plugged-b6be4498-da79-4335-9f95-6a191a4ce127 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:56:53 user nova-compute[231753]: WARNING nova.compute.manager [req-c3f3adca-5a18-410f-a80f-502ab4e9087f req-df189a5d-9f5b-4849-86e6-d3166e6e3875 service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Received unexpected event network-vif-plugged-b6be4498-da79-4335-9f95-6a191a4ce127 for instance with vm_state shelved_offloaded and task_state spawning.
Jul 29 13:56:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:55 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690639015.1667712, a3f9ad53-db31-404a-8442-37cf53f11cbc => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:56:55 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] VM Resumed (Lifecycle Event)
Jul 29 13:56:55 user nova-compute[231753]: DEBUG nova.compute.manager [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:56:55 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:56:55 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Instance spawned successfully.
Jul 29 13:56:55 user nova-compute[231753]: DEBUG nova.compute.manager [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:56:55 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:56:55 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:56:55 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:56:55 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690639015.1683226, a3f9ad53-db31-404a-8442-37cf53f11cbc => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:56:55 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] VM Started (Lifecycle Event)
Jul 29 13:56:55 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:56:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e06569d8-ac8e-495a-8131-0a6663fe69de tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lock "a3f9ad53-db31-404a-8442-37cf53f11cbc" "released" by "nova.compute.manager.ComputeManager.unshelve_instance.<locals>.do_unshelve_instance" :: held 15.623s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:56:55 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:56:55 user nova-compute[231753]: DEBUG nova.compute.manager [req-b458cf53-7c12-4a11-a748-d3437b1406ea req-fe2a21b5-8c17-46b6-aa33-d7cb726d742a service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Received event network-vif-plugged-b6be4498-da79-4335-9f95-6a191a4ce127 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:56:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b458cf53-7c12-4a11-a748-d3437b1406ea req-fe2a21b5-8c17-46b6-aa33-d7cb726d742a service nova] Acquiring lock "a3f9ad53-db31-404a-8442-37cf53f11cbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:56:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b458cf53-7c12-4a11-a748-d3437b1406ea req-fe2a21b5-8c17-46b6-aa33-d7cb726d742a service nova] Lock "a3f9ad53-db31-404a-8442-37cf53f11cbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:56:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b458cf53-7c12-4a11-a748-d3437b1406ea req-fe2a21b5-8c17-46b6-aa33-d7cb726d742a service nova] Lock "a3f9ad53-db31-404a-8442-37cf53f11cbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:56:55 user nova-compute[231753]: DEBUG nova.compute.manager [req-b458cf53-7c12-4a11-a748-d3437b1406ea req-fe2a21b5-8c17-46b6-aa33-d7cb726d742a service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] No waiting events found dispatching network-vif-plugged-b6be4498-da79-4335-9f95-6a191a4ce127 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:56:55 user nova-compute[231753]: WARNING nova.compute.manager [req-b458cf53-7c12-4a11-a748-d3437b1406ea req-fe2a21b5-8c17-46b6-aa33-d7cb726d742a service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Received unexpected event network-vif-plugged-b6be4498-da79-4335-9f95-6a191a4ce127 for instance with vm_state active and task_state None.
Jul 29 13:56:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "b99a72ba-73e2-4be7-b52b-7797351daa5f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:56:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "b99a72ba-73e2-4be7-b52b-7797351daa5f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:56:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:56:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:56:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:56:56 user nova-compute[231753]: INFO nova.compute.manager [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Terminating instance
Jul 29 13:56:56 user nova-compute[231753]: DEBUG nova.compute.manager [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:56:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:56 user nova-compute[231753]: DEBUG nova.compute.manager [req-c362e67c-aff1-4f94-bece-9fa37555dc7c req-f6d2ed12-014e-4a51-a7c7-166a5e81a4b6 service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Received event network-vif-unplugged-d145cf59-908e-42c4-ba8e-ce5abe640639 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:56:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c362e67c-aff1-4f94-bece-9fa37555dc7c req-f6d2ed12-014e-4a51-a7c7-166a5e81a4b6 service nova] Acquiring lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:56:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c362e67c-aff1-4f94-bece-9fa37555dc7c req-f6d2ed12-014e-4a51-a7c7-166a5e81a4b6 service nova] Lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:56:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c362e67c-aff1-4f94-bece-9fa37555dc7c req-f6d2ed12-014e-4a51-a7c7-166a5e81a4b6 service nova] Lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:56:56 user nova-compute[231753]: DEBUG nova.compute.manager [req-c362e67c-aff1-4f94-bece-9fa37555dc7c req-f6d2ed12-014e-4a51-a7c7-166a5e81a4b6 service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] No waiting events found dispatching network-vif-unplugged-d145cf59-908e-42c4-ba8e-ce5abe640639 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:56:56 user nova-compute[231753]: DEBUG nova.compute.manager [req-c362e67c-aff1-4f94-bece-9fa37555dc7c req-f6d2ed12-014e-4a51-a7c7-166a5e81a4b6 service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Received event network-vif-unplugged-d145cf59-908e-42c4-ba8e-ce5abe640639 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:56:57 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Instance destroyed successfully.
Jul 29 13:56:57 user nova-compute[231753]: DEBUG nova.objects.instance [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lazy-loading 'resources' on Instance uuid b99a72ba-73e2-4be7-b52b-7797351daa5f {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:41:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-697372546',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-697372546',id=24,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:43:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c01165e83a3143ad83f050790f2b63fe',ramdisk_id='',reservation_id='r-9hzwg4i4',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-93506270',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:44:56Z,user_data=None,user_id='618ce2d56c3c4ee8ace871d308ca45fb',uuid=b99a72ba-73e2-4be7-b52b-7797351daa5f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d145cf59-908e-42c4-ba8e-ce5abe640639", "address": "fa:16:3e:25:37:92", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd145cf59-90", "ovs_interfaceid": "d145cf59-908e-42c4-ba8e-ce5abe640639", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Converting VIF {"id": "d145cf59-908e-42c4-ba8e-ce5abe640639", "address": "fa:16:3e:25:37:92", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.5", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd145cf59-90", "ovs_interfaceid": "d145cf59-908e-42c4-ba8e-ce5abe640639", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:25:37:92,bridge_name='br-int',has_traffic_filtering=True,id=d145cf59-908e-42c4-ba8e-ce5abe640639,network=Network(03362fcb-afd6-4b0a-af44-a54a848c59f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd145cf59-90') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG os_vif [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:37:92,bridge_name='br-int',has_traffic_filtering=True,id=d145cf59-908e-42c4-ba8e-ce5abe640639,network=Network(03362fcb-afd6-4b0a-af44-a54a848c59f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd145cf59-90') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd145cf59-90, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:56:57 user nova-compute[231753]: INFO os_vif [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:25:37:92,bridge_name='br-int',has_traffic_filtering=True,id=d145cf59-908e-42c4-ba8e-ce5abe640639,network=Network(03362fcb-afd6-4b0a-af44-a54a848c59f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd145cf59-90')
Jul 29 13:56:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'pxcjmHFe', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': True}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:56:57 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:56:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e990a9fc-b248-4acd-96bd-31e0ce517548]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:56:57 user nova-compute[231753]: No targets found.
Jul 29 13:56:57 user nova-compute[231753]: iSNS:
Jul 29 13:56:57 user nova-compute[231753]: No targets found.
Jul 29 13:56:57 user nova-compute[231753]: STATIC:
Jul 29 13:56:57 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea
Jul 29 13:56:57 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:56:57 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:56:57 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf
Jul 29 13:56:57 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:56:57 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:56:57 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699
Jul 29 13:56:57 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:56:57 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:56:57 user nova-compute[231753]: FIRMWARE:
Jul 29 13:56:57 user nova-compute[231753]: No targets found.
Jul 29 13:56:57 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:56:57 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:56:57 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[495e0dda-28c8-4e46-8364-785d7b89e5fb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e3db9c-2a21-449e-a7dd-6106ea995436]: (4, ('tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)\ntcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:56:57 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:56:57 user nova-compute[231753]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)
Jul 29 13:56:57 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsi session list stdout=tcp: [24] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea (non-flash)
Jul 29 13:56:57 user nova-compute[231753]: tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:56:57 user nova-compute[231753]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)
Jul 29 13:56:57 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ca01f5cf0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea'): ({'sdd'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Removing single pathed devices sdd {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[1842b3d8-8fdf-42d1-849f-0091f004df8e]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7a6a1c-953e-43ba-bb8c-a00a3c783e13]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Flushing IO for device /dev/sdd {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[cda140b7-866b-46bd-83ab-f255431c369f]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.048s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[69275035-8844-436b-bd5d-6cb80d27502f]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] SCSI volumes sdd have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[df7e0787-2221-49b3-bff6-6ce798ed5e76]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea -p 172.16.0.220:3260 --logout" returned: 0 in 0.065s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8b81da7-14fb-48b7-b58c-80d0002c805c]: (4, ('Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea, portal: 172.16.0.220,3260]\nLogout of [sid: 24, target: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea, portal: 172.16.0.220,3260]
Jul 29 13:56:57 user nova-compute[231753]: Logout of [sid: 24, target: iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea, portal: 172.16.0.220,3260] successful.
Jul 29 13:56:57 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:fda4c8ca-fe57-4522-b8bf-0086825e92ea -p 172.16.0.220:3260 --op delete" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0beffc3c-984a-42fe-acce-f8e5fe09d981]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.325s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] <== disconnect_volume: return (326ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:56:57 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Deleting instance files /opt/stack/data/nova/instances/b99a72ba-73e2-4be7-b52b-7797351daa5f_del
Jul 29 13:56:57 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Deletion of /opt/stack/data/nova/instances/b99a72ba-73e2-4be7-b52b-7797351daa5f_del complete
Jul 29 13:56:57 user nova-compute[231753]: INFO nova.compute.manager [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Took 1.22 seconds to destroy the instance on the hypervisor.
Jul 29 13:56:57 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:56:57 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:56:58 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:56:58 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Took 0.71 seconds to deallocate network for instance.
Jul 29 13:56:58 user nova-compute[231753]: DEBUG nova.compute.manager [req-9c3bc081-bbd1-405e-a9ce-d3c114f7468c req-a32db0dd-d1c5-4ff7-b626-7f7a760a39fe service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Received event network-vif-deleted-d145cf59-908e-42c4-ba8e-ce5abe640639 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:56:58 user nova-compute[231753]: INFO nova.compute.manager [req-9c3bc081-bbd1-405e-a9ce-d3c114f7468c req-a32db0dd-d1c5-4ff7-b626-7f7a760a39fe service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Neutron deleted interface d145cf59-908e-42c4-ba8e-ce5abe640639; detaching it from the instance and deleting it from the info cache
Jul 29 13:56:58 user nova-compute[231753]: DEBUG nova.network.neutron [req-9c3bc081-bbd1-405e-a9ce-d3c114f7468c req-a32db0dd-d1c5-4ff7-b626-7f7a760a39fe service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:56:58 user nova-compute[231753]: DEBUG nova.compute.manager [req-9c3bc081-bbd1-405e-a9ce-d3c114f7468c req-a32db0dd-d1c5-4ff7-b626-7f7a760a39fe service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Detach interface failed, port_id=d145cf59-908e-42c4-ba8e-ce5abe640639, reason: Instance b99a72ba-73e2-4be7-b52b-7797351daa5f could not be found. {{(pid=231753) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 13:56:58 user nova-compute[231753]: DEBUG nova.compute.manager [req-9af9133e-86de-452c-ab63-007877c2bf09 req-d8f4e534-9c9f-43d9-bbb8-5e22fc102d9f service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Received event network-vif-plugged-d145cf59-908e-42c4-ba8e-ce5abe640639 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:56:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9af9133e-86de-452c-ab63-007877c2bf09 req-d8f4e534-9c9f-43d9-bbb8-5e22fc102d9f service nova] Acquiring lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:56:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9af9133e-86de-452c-ab63-007877c2bf09 req-d8f4e534-9c9f-43d9-bbb8-5e22fc102d9f service nova] Lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:56:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9af9133e-86de-452c-ab63-007877c2bf09 req-d8f4e534-9c9f-43d9-bbb8-5e22fc102d9f service nova] Lock "b99a72ba-73e2-4be7-b52b-7797351daa5f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:56:58 user nova-compute[231753]: DEBUG nova.compute.manager [req-9af9133e-86de-452c-ab63-007877c2bf09 req-d8f4e534-9c9f-43d9-bbb8-5e22fc102d9f service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] No waiting events found dispatching network-vif-plugged-d145cf59-908e-42c4-ba8e-ce5abe640639 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:56:58 user nova-compute[231753]: WARNING nova.compute.manager [req-9af9133e-86de-452c-ab63-007877c2bf09 req-d8f4e534-9c9f-43d9-bbb8-5e22fc102d9f service nova] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Received unexpected event network-vif-plugged-d145cf59-908e-42c4-ba8e-ce5abe640639 for instance with vm_state active and task_state deleting.
Jul 29 13:56:59 user nova-compute[231753]: INFO nova.compute.manager [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Took 0.93 seconds to detach 1 volumes for instance.
Jul 29 13:56:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:56:59 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:56:59 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:56:59 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:56:59 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:56:59 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.225s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:56:59 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Deleted allocations for instance b99a72ba-73e2-4be7-b52b-7797351daa5f
Jul 29 13:56:59 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7f7ca7c7-d02a-4c24-9c60-9609a4d631b6 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "b99a72ba-73e2-4be7-b52b-7797351daa5f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.296s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:57:00 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690639005.8619237, 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:57:00 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] VM Stopped (Lifecycle Event)
Jul 29 13:57:00 user nova-compute[231753]: DEBUG nova.compute.manager [None req-3baffebe-744f-4019-b61d-866f85ef16b2 None None] [instance: 8c62c19f-f13c-4ade-a0ea-a7594c8daa0d] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:57:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Acquiring lock "3132d31d-7901-4001-bc19-7836f2ecfc70" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:57:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Lock "3132d31d-7901-4001-bc19-7836f2ecfc70" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:57:07 user nova-compute[231753]: DEBUG nova.compute.manager [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:57:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:57:07 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:57:07 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:57:07 user nova-compute[231753]: INFO nova.compute.claims [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Claim successful on node user
Jul 29 13:57:08 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:57:08 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:57:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.301s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:57:08 user nova-compute[231753]: DEBUG nova.compute.manager [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:57:08 user nova-compute[231753]: DEBUG nova.compute.manager [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:57:08 user nova-compute[231753]: DEBUG nova.network.neutron [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:57:08 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:57:08 user nova-compute[231753]: DEBUG nova.compute.manager [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:57:08 user nova-compute[231753]: DEBUG nova.compute.manager [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:57:08 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:57:08 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Creating image(s)
Jul 29 13:57:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Acquiring lock "/opt/stack/data/nova/instances/3132d31d-7901-4001-bc19-7836f2ecfc70/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:57:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Lock "/opt/stack/data/nova/instances/3132d31d-7901-4001-bc19-7836f2ecfc70/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:57:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Lock "/opt/stack/data/nova/instances/3132d31d-7901-4001-bc19-7836f2ecfc70/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:57:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:08 user nova-compute[231753]: DEBUG nova.policy [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '56465b2b917b4aa1abaf1bb352c54970', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0d72c0cabd46471cb086a958a20cdb1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:57:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.147s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:57:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:57:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.134s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/3132d31d-7901-4001-bc19-7836f2ecfc70/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/3132d31d-7901-4001-bc19-7836f2ecfc70/disk 1073741824" returned: 0 in 0.056s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.196s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:57:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.140s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:08 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3132d31d-7901-4001-bc19-7836f2ecfc70/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:57:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3132d31d-7901-4001-bc19-7836f2ecfc70/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:08 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3132d31d-7901-4001-bc19-7836f2ecfc70/disk --force-share --output=json" returned: 0 in 0.142s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:08 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Cannot resize image /opt/stack/data/nova/instances/3132d31d-7901-4001-bc19-7836f2ecfc70/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:57:08 user nova-compute[231753]: DEBUG nova.objects.instance [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Lazy-loading 'migration_context' on Instance uuid 3132d31d-7901-4001-bc19-7836f2ecfc70 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:57:08 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:57:08 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Ensure instance console log exists: /opt/stack/data/nova/instances/3132d31d-7901-4001-bc19-7836f2ecfc70/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:57:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:57:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:57:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:57:09 user nova-compute[231753]: DEBUG nova.network.neutron [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Successfully created port: fe5f0747-a1bf-4c90-a21d-817beed45cb0 {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:57:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG nova.network.neutron [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Successfully updated port: fe5f0747-a1bf-4c90-a21d-817beed45cb0 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Acquiring lock "refresh_cache-3132d31d-7901-4001-bc19-7836f2ecfc70" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Acquired lock "refresh_cache-3132d31d-7901-4001-bc19-7836f2ecfc70" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG nova.network.neutron [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG nova.compute.manager [req-9959c888-4460-47c5-9c8e-4fcb19459710 req-5c269a38-0c92-4d84-b70a-12a046472e02 service nova] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Received event network-changed-fe5f0747-a1bf-4c90-a21d-817beed45cb0 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG nova.compute.manager [req-9959c888-4460-47c5-9c8e-4fcb19459710 req-5c269a38-0c92-4d84-b70a-12a046472e02 service nova] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Refreshing instance network info cache due to event network-changed-fe5f0747-a1bf-4c90-a21d-817beed45cb0. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9959c888-4460-47c5-9c8e-4fcb19459710 req-5c269a38-0c92-4d84-b70a-12a046472e02 service nova] Acquiring lock "refresh_cache-3132d31d-7901-4001-bc19-7836f2ecfc70" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG nova.network.neutron [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG nova.network.neutron [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Updating instance_info_cache with network_info: [{"id": "fe5f0747-a1bf-4c90-a21d-817beed45cb0", "address": "fa:16:3e:f0:1a:24", "network": {"id": "51c31371-2b36-45dd-b627-b589d64051f8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c691c184cace4b549169d1b6e8985e5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe5f0747-a1", "ovs_interfaceid": "fe5f0747-a1bf-4c90-a21d-817beed45cb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Releasing lock "refresh_cache-3132d31d-7901-4001-bc19-7836f2ecfc70" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG nova.compute.manager [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Instance network_info: |[{"id": "fe5f0747-a1bf-4c90-a21d-817beed45cb0", "address": "fa:16:3e:f0:1a:24", "network": {"id": "51c31371-2b36-45dd-b627-b589d64051f8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c691c184cace4b549169d1b6e8985e5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe5f0747-a1", "ovs_interfaceid": "fe5f0747-a1bf-4c90-a21d-817beed45cb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9959c888-4460-47c5-9c8e-4fcb19459710 req-5c269a38-0c92-4d84-b70a-12a046472e02 service nova] Acquired lock "refresh_cache-3132d31d-7901-4001-bc19-7836f2ecfc70" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG nova.network.neutron [req-9959c888-4460-47c5-9c8e-4fcb19459710 req-5c269a38-0c92-4d84-b70a-12a046472e02 service nova] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Refreshing network info cache for port fe5f0747-a1bf-4c90-a21d-817beed45cb0 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Start _get_guest_xml network_info=[{"id": "fe5f0747-a1bf-4c90-a21d-817beed45cb0", "address": "fa:16:3e:f0:1a:24", "network": {"id": "51c31371-2b36-45dd-b627-b589d64051f8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c691c184cace4b549169d1b6e8985e5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe5f0747-a1", "ovs_interfaceid": "fe5f0747-a1bf-4c90-a21d-817beed45cb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:57:10 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:57:10 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:57:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:57:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1679588816',display_name='tempest-VolumesNegativeTest-instance-1679588816',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1679588816',id=43,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d72c0cabd46471cb086a958a20cdb1c',ramdisk_id='',reservation_id='r-tvq2yzkc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-178110141',owner_user_name='tempest-VolumesNegativeTest-178110141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:57:08Z,user_data=None,user_id='56465b2b917b4aa1abaf1bb352c54970',uuid=3132d31d-7901-4001-bc19-7836f2ecfc70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe5f0747-a1bf-4c90-a21d-817beed45cb0", "address": "fa:16:3e:f0:1a:24", "network": {"id": "51c31371-2b36-45dd-b627-b589d64051f8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c691c184cace4b549169d1b6e8985e5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe5f0747-a1", "ovs_interfaceid": "fe5f0747-a1bf-4c90-a21d-817beed45cb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Converting VIF {"id": "fe5f0747-a1bf-4c90-a21d-817beed45cb0", "address": "fa:16:3e:f0:1a:24", "network": {"id": "51c31371-2b36-45dd-b627-b589d64051f8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c691c184cace4b549169d1b6e8985e5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe5f0747-a1", "ovs_interfaceid": "fe5f0747-a1bf-4c90-a21d-817beed45cb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:1a:24,bridge_name='br-int',has_traffic_filtering=True,id=fe5f0747-a1bf-4c90-a21d-817beed45cb0,network=Network(51c31371-2b36-45dd-b627-b589d64051f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe5f0747-a1') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG nova.objects.instance [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Lazy-loading 'pci_devices' on Instance uuid 3132d31d-7901-4001-bc19-7836f2ecfc70 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:57:10 user nova-compute[231753]:   <uuid>3132d31d-7901-4001-bc19-7836f2ecfc70</uuid>
Jul 29 13:57:10 user nova-compute[231753]:   <name>instance-0000002b</name>
Jul 29 13:57:10 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:57:10 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:57:10 user nova-compute[231753]:   <metadata>
Jul 29 13:57:10 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:57:10 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:57:10 user nova-compute[231753]:       <nova:name>tempest-VolumesNegativeTest-instance-1679588816</nova:name>
Jul 29 13:57:10 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:57:10</nova:creationTime>
Jul 29 13:57:10 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:57:10 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:57:10 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:57:10 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:57:10 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:57:10 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:57:10 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:57:10 user nova-compute[231753]:       <nova:owner>
Jul 29 13:57:10 user nova-compute[231753]:         <nova:user uuid="56465b2b917b4aa1abaf1bb352c54970">tempest-VolumesNegativeTest-178110141-project-member</nova:user>
Jul 29 13:57:10 user nova-compute[231753]:         <nova:project uuid="0d72c0cabd46471cb086a958a20cdb1c">tempest-VolumesNegativeTest-178110141</nova:project>
Jul 29 13:57:10 user nova-compute[231753]:       </nova:owner>
Jul 29 13:57:10 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:57:10 user nova-compute[231753]:       <nova:ports>
Jul 29 13:57:10 user nova-compute[231753]:         <nova:port uuid="fe5f0747-a1bf-4c90-a21d-817beed45cb0">
Jul 29 13:57:10 user nova-compute[231753]:           <nova:ip type="fixed" address="192.168.233.228" ipVersion="4"/>
Jul 29 13:57:10 user nova-compute[231753]:         </nova:port>
Jul 29 13:57:10 user nova-compute[231753]:       </nova:ports>
Jul 29 13:57:10 user nova-compute[231753]:     </nova:instance>
Jul 29 13:57:10 user nova-compute[231753]:   </metadata>
Jul 29 13:57:10 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:57:10 user nova-compute[231753]:     <system>
Jul 29 13:57:10 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:57:10 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:57:10 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:57:10 user nova-compute[231753]:       <entry name="serial">3132d31d-7901-4001-bc19-7836f2ecfc70</entry>
Jul 29 13:57:10 user nova-compute[231753]:       <entry name="uuid">3132d31d-7901-4001-bc19-7836f2ecfc70</entry>
Jul 29 13:57:10 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:57:10 user nova-compute[231753]:     </system>
Jul 29 13:57:10 user nova-compute[231753]:   </sysinfo>
Jul 29 13:57:10 user nova-compute[231753]:   <os>
Jul 29 13:57:10 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:57:10 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:57:10 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:57:10 user nova-compute[231753]:   </os>
Jul 29 13:57:10 user nova-compute[231753]:   <features>
Jul 29 13:57:10 user nova-compute[231753]:     <acpi/>
Jul 29 13:57:10 user nova-compute[231753]:     <apic/>
Jul 29 13:57:10 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:57:10 user nova-compute[231753]:   </features>
Jul 29 13:57:10 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:57:10 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:57:10 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:57:10 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:57:10 user nova-compute[231753]:   </clock>
Jul 29 13:57:10 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:57:10 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:57:10 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:57:10 user nova-compute[231753]:   </cpu>
Jul 29 13:57:10 user nova-compute[231753]:   <devices>
Jul 29 13:57:10 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:57:10 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:57:10 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/3132d31d-7901-4001-bc19-7836f2ecfc70/disk"/>
Jul 29 13:57:10 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:57:10 user nova-compute[231753]:     </disk>
Jul 29 13:57:10 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:57:10 user nova-compute[231753]:       <mac address="fa:16:3e:f0:1a:24"/>
Jul 29 13:57:10 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:57:10 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:57:10 user nova-compute[231753]:       <target dev="tapfe5f0747-a1"/>
Jul 29 13:57:10 user nova-compute[231753]:     </interface>
Jul 29 13:57:10 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:57:10 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/3132d31d-7901-4001-bc19-7836f2ecfc70/console.log" append="off"/>
Jul 29 13:57:10 user nova-compute[231753]:     </serial>
Jul 29 13:57:10 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:57:10 user nova-compute[231753]:     <video>
Jul 29 13:57:10 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:57:10 user nova-compute[231753]:     </video>
Jul 29 13:57:10 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:57:10 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:57:10 user nova-compute[231753]:     </rng>
Jul 29 13:57:10 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:57:10 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:57:10 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:57:10 user nova-compute[231753]:     </memballoon>
Jul 29 13:57:10 user nova-compute[231753]:   </devices>
Jul 29 13:57:10 user nova-compute[231753]: </domain>
Jul 29 13:57:10 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:57:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1679588816',display_name='tempest-VolumesNegativeTest-instance-1679588816',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1679588816',id=43,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='0d72c0cabd46471cb086a958a20cdb1c',ramdisk_id='',reservation_id='r-tvq2yzkc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesNegativeTest-178110141',owner_user_name='tempest-VolumesNegativeTest-178110141-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:57:08Z,user_data=None,user_id='56465b2b917b4aa1abaf1bb352c54970',uuid=3132d31d-7901-4001-bc19-7836f2ecfc70,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fe5f0747-a1bf-4c90-a21d-817beed45cb0", "address": "fa:16:3e:f0:1a:24", "network": {"id": "51c31371-2b36-45dd-b627-b589d64051f8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c691c184cace4b549169d1b6e8985e5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe5f0747-a1", "ovs_interfaceid": "fe5f0747-a1bf-4c90-a21d-817beed45cb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Converting VIF {"id": "fe5f0747-a1bf-4c90-a21d-817beed45cb0", "address": "fa:16:3e:f0:1a:24", "network": {"id": "51c31371-2b36-45dd-b627-b589d64051f8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c691c184cace4b549169d1b6e8985e5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe5f0747-a1", "ovs_interfaceid": "fe5f0747-a1bf-4c90-a21d-817beed45cb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:1a:24,bridge_name='br-int',has_traffic_filtering=True,id=fe5f0747-a1bf-4c90-a21d-817beed45cb0,network=Network(51c31371-2b36-45dd-b627-b589d64051f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe5f0747-a1') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG os_vif [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:1a:24,bridge_name='br-int',has_traffic_filtering=True,id=fe5f0747-a1bf-4c90-a21d-817beed45cb0,network=Network(51c31371-2b36-45dd-b627-b589d64051f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe5f0747-a1') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfe5f0747-a1, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapfe5f0747-a1, col_values=(('external_ids', {'iface-id': 'fe5f0747-a1bf-4c90-a21d-817beed45cb0', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f0:1a:24', 'vm-uuid': '3132d31d-7901-4001-bc19-7836f2ecfc70'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:10 user nova-compute[231753]: INFO os_vif [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:1a:24,bridge_name='br-int',has_traffic_filtering=True,id=fe5f0747-a1bf-4c90-a21d-817beed45cb0,network=Network(51c31371-2b36-45dd-b627-b589d64051f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe5f0747-a1')
Jul 29 13:57:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:57:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] No VIF found with MAC fa:16:3e:f0:1a:24, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:57:11 user nova-compute[231753]: DEBUG nova.network.neutron [req-9959c888-4460-47c5-9c8e-4fcb19459710 req-5c269a38-0c92-4d84-b70a-12a046472e02 service nova] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Updated VIF entry in instance network info cache for port fe5f0747-a1bf-4c90-a21d-817beed45cb0. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:57:11 user nova-compute[231753]: DEBUG nova.network.neutron [req-9959c888-4460-47c5-9c8e-4fcb19459710 req-5c269a38-0c92-4d84-b70a-12a046472e02 service nova] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Updating instance_info_cache with network_info: [{"id": "fe5f0747-a1bf-4c90-a21d-817beed45cb0", "address": "fa:16:3e:f0:1a:24", "network": {"id": "51c31371-2b36-45dd-b627-b589d64051f8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c691c184cace4b549169d1b6e8985e5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe5f0747-a1", "ovs_interfaceid": "fe5f0747-a1bf-4c90-a21d-817beed45cb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:57:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9959c888-4460-47c5-9c8e-4fcb19459710 req-5c269a38-0c92-4d84-b70a-12a046472e02 service nova] Releasing lock "refresh_cache-3132d31d-7901-4001-bc19-7836f2ecfc70" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:57:11 user nova-compute[231753]: DEBUG nova.compute.manager [req-b4875fc7-ec14-42dc-970d-34b56ec44fea req-b5056d13-6e3c-4a36-828f-45f9603ed675 service nova] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Received event network-changed-3ca923a6-55a2-4578-ad2e-c3e9248b6af2 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:57:11 user nova-compute[231753]: DEBUG nova.compute.manager [req-b4875fc7-ec14-42dc-970d-34b56ec44fea req-b5056d13-6e3c-4a36-828f-45f9603ed675 service nova] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Refreshing instance network info cache due to event network-changed-3ca923a6-55a2-4578-ad2e-c3e9248b6af2. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:57:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b4875fc7-ec14-42dc-970d-34b56ec44fea req-b5056d13-6e3c-4a36-828f-45f9603ed675 service nova] Acquiring lock "refresh_cache-73f72f78-9abf-4b04-a973-06affde57310" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:57:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b4875fc7-ec14-42dc-970d-34b56ec44fea req-b5056d13-6e3c-4a36-828f-45f9603ed675 service nova] Acquired lock "refresh_cache-73f72f78-9abf-4b04-a973-06affde57310" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:57:11 user nova-compute[231753]: DEBUG nova.network.neutron [req-b4875fc7-ec14-42dc-970d-34b56ec44fea req-b5056d13-6e3c-4a36-828f-45f9603ed675 service nova] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Refreshing network info cache for port 3ca923a6-55a2-4578-ad2e-c3e9248b6af2 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:57:11 user nova-compute[231753]: DEBUG nova.network.neutron [req-b4875fc7-ec14-42dc-970d-34b56ec44fea req-b5056d13-6e3c-4a36-828f-45f9603ed675 service nova] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Updated VIF entry in instance network info cache for port 3ca923a6-55a2-4578-ad2e-c3e9248b6af2. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:57:11 user nova-compute[231753]: DEBUG nova.network.neutron [req-b4875fc7-ec14-42dc-970d-34b56ec44fea req-b5056d13-6e3c-4a36-828f-45f9603ed675 service nova] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Updating instance_info_cache with network_info: [{"id": "3ca923a6-55a2-4578-ad2e-c3e9248b6af2", "address": "fa:16:3e:39:97:1d", "network": {"id": "c5a2a904-b9ec-4da4-8206-f08aef3a48cc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2009211013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd079349ba1549b2bc93552ecb88c3e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca923a6-55", "ovs_interfaceid": "3ca923a6-55a2-4578-ad2e-c3e9248b6af2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:57:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b4875fc7-ec14-42dc-970d-34b56ec44fea req-b5056d13-6e3c-4a36-828f-45f9603ed675 service nova] Releasing lock "refresh_cache-73f72f78-9abf-4b04-a973-06affde57310" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:57:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:12 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690639017.1700528, b99a72ba-73e2-4be7-b52b-7797351daa5f => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:57:12 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] VM Stopped (Lifecycle Event)
Jul 29 13:57:12 user nova-compute[231753]: DEBUG nova.compute.manager [None req-02eab343-f318-47ee-82ff-65716c9c9d7e None None] [instance: b99a72ba-73e2-4be7-b52b-7797351daa5f] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:57:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:12 user nova-compute[231753]: DEBUG nova.compute.manager [req-b0dbdc8c-1908-49b7-8b91-004c1066a4d7 req-d0d286c3-8827-443a-b794-0ccf8b5146d6 service nova] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Received event network-vif-plugged-fe5f0747-a1bf-4c90-a21d-817beed45cb0 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:57:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b0dbdc8c-1908-49b7-8b91-004c1066a4d7 req-d0d286c3-8827-443a-b794-0ccf8b5146d6 service nova] Acquiring lock "3132d31d-7901-4001-bc19-7836f2ecfc70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:57:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b0dbdc8c-1908-49b7-8b91-004c1066a4d7 req-d0d286c3-8827-443a-b794-0ccf8b5146d6 service nova] Lock "3132d31d-7901-4001-bc19-7836f2ecfc70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:57:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b0dbdc8c-1908-49b7-8b91-004c1066a4d7 req-d0d286c3-8827-443a-b794-0ccf8b5146d6 service nova] Lock "3132d31d-7901-4001-bc19-7836f2ecfc70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:57:12 user nova-compute[231753]: DEBUG nova.compute.manager [req-b0dbdc8c-1908-49b7-8b91-004c1066a4d7 req-d0d286c3-8827-443a-b794-0ccf8b5146d6 service nova] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] No waiting events found dispatching network-vif-plugged-fe5f0747-a1bf-4c90-a21d-817beed45cb0 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:57:12 user nova-compute[231753]: WARNING nova.compute.manager [req-b0dbdc8c-1908-49b7-8b91-004c1066a4d7 req-d0d286c3-8827-443a-b794-0ccf8b5146d6 service nova] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Received unexpected event network-vif-plugged-fe5f0747-a1bf-4c90-a21d-817beed45cb0 for instance with vm_state building and task_state spawning.
Jul 29 13:57:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:14 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690639034.2298715, 3132d31d-7901-4001-bc19-7836f2ecfc70 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:57:14 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] VM Resumed (Lifecycle Event)
Jul 29 13:57:14 user nova-compute[231753]: DEBUG nova.compute.manager [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:57:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:57:14 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Instance spawned successfully.
Jul 29 13:57:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:57:14 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:57:14 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:57:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:57:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:57:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:57:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:57:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:57:14 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:57:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:14 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:57:14 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690639034.2338095, 3132d31d-7901-4001-bc19-7836f2ecfc70 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:57:14 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] VM Started (Lifecycle Event)
Jul 29 13:57:14 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:57:14 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:57:14 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:57:14 user nova-compute[231753]: INFO nova.compute.manager [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Took 6.05 seconds to spawn the instance on the hypervisor.
Jul 29 13:57:14 user nova-compute[231753]: DEBUG nova.compute.manager [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:57:14 user nova-compute[231753]: DEBUG nova.compute.manager [req-37480866-4051-49fb-8104-5794d7181752 req-2db543ea-0da2-4873-afe0-4e2af83f6370 service nova] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Received event network-vif-plugged-fe5f0747-a1bf-4c90-a21d-817beed45cb0 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:57:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-37480866-4051-49fb-8104-5794d7181752 req-2db543ea-0da2-4873-afe0-4e2af83f6370 service nova] Acquiring lock "3132d31d-7901-4001-bc19-7836f2ecfc70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:57:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-37480866-4051-49fb-8104-5794d7181752 req-2db543ea-0da2-4873-afe0-4e2af83f6370 service nova] Lock "3132d31d-7901-4001-bc19-7836f2ecfc70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:57:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-37480866-4051-49fb-8104-5794d7181752 req-2db543ea-0da2-4873-afe0-4e2af83f6370 service nova] Lock "3132d31d-7901-4001-bc19-7836f2ecfc70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:57:14 user nova-compute[231753]: DEBUG nova.compute.manager [req-37480866-4051-49fb-8104-5794d7181752 req-2db543ea-0da2-4873-afe0-4e2af83f6370 service nova] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] No waiting events found dispatching network-vif-plugged-fe5f0747-a1bf-4c90-a21d-817beed45cb0 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:57:14 user nova-compute[231753]: WARNING nova.compute.manager [req-37480866-4051-49fb-8104-5794d7181752 req-2db543ea-0da2-4873-afe0-4e2af83f6370 service nova] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Received unexpected event network-vif-plugged-fe5f0747-a1bf-4c90-a21d-817beed45cb0 for instance with vm_state building and task_state spawning.
Jul 29 13:57:14 user nova-compute[231753]: INFO nova.compute.manager [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Took 6.65 seconds to build instance.
Jul 29 13:57:14 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2d1139c2-0bbd-42e8-b741-b2f6200b169a tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Lock "3132d31d-7901-4001-bc19-7836f2ecfc70" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.743s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:57:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Acquiring lock "73f72f78-9abf-4b04-a973-06affde57310" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:57:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Lock "73f72f78-9abf-4b04-a973-06affde57310" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:57:15 user nova-compute[231753]: DEBUG nova.objects.instance [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Lazy-loading 'flavor' on Instance uuid 73f72f78-9abf-4b04-a973-06affde57310 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:57:15 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Lock "73f72f78-9abf-4b04-a973-06affde57310" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.067s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:57:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Acquiring lock "73f72f78-9abf-4b04-a973-06affde57310" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:57:15 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Lock "73f72f78-9abf-4b04-a973-06affde57310" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:57:15 user nova-compute[231753]: INFO nova.compute.manager [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Attaching volume 06de2268-350f-418e-9ee9-a6d9c3db07de to /dev/vdb
Jul 29 13:57:15 user nova-compute[231753]: DEBUG os_brick.utils [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:57:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:15 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb51423c-6c7b-4f5f-9d00-4c255cf202be]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:57:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:15 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f45c79-cd3c-429b-b4c4-f73932fdacbe]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:57:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:15 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f4b5b86-28ef-4f76-b722-4eca7b6d5329]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:57:15 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[89cff96a-6d0a-4b5a-b6d2-978265ed4d76]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:57:15 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:57:16 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:57:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:16 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:57:16 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:57:16 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4844660-aa7c-455f-b016-7951170d1fbe]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:57:16 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:57:16 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:57:16 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:57:16 user nova-compute[231753]: DEBUG os_brick.utils [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:57:16 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Updating existing volume attachment record: 8d87db70-af21-48bf-b958-597212f67e9b {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:57:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:19 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:57:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:21 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:57:21 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 13:57:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "refresh_cache-a3f9ad53-db31-404a-8442-37cf53f11cbc" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:57:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquired lock "refresh_cache-a3f9ad53-db31-404a-8442-37cf53f11cbc" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:57:21 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Forcefully refreshing network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 13:57:22 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Updating instance_info_cache with network_info: [{"id": "b6be4498-da79-4335-9f95-6a191a4ce127", "address": "fa:16:3e:c2:b5:20", "network": {"id": "e36e72a2-fbed-483c-827c-436fa6786390", "bridge": "br-int", "label": "tempest-TestShelveInstance-2100930356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b552c0991c456eb101472ca6777f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6be4498-da", "ovs_interfaceid": "b6be4498-da79-4335-9f95-6a191a4ce127", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:57:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Releasing lock "refresh_cache-a3f9ad53-db31-404a-8442-37cf53f11cbc" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:57:22 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Updated the network info_cache for instance {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 13:57:22 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:57:22 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:57:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:57:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:57:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:57:22 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 13:57:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f72f78-9abf-4b04-a973-06affde57310/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f72f78-9abf-4b04-a973-06affde57310/disk --force-share --output=json" returned: 0 in 0.144s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f72f78-9abf-4b04-a973-06affde57310/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f72f78-9abf-4b04-a973-06affde57310/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3132d31d-7901-4001-bc19-7836f2ecfc70/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3132d31d-7901-4001-bc19-7836f2ecfc70/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:22 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3132d31d-7901-4001-bc19-7836f2ecfc70/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3132d31d-7901-4001-bc19-7836f2ecfc70/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:57:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:57:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:57:23 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jZxLWJvk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:57:23 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:57:23 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:57:23 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:57:23 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:57:23 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:57:23 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:57:23 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:57:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:23 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:57:23 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:57:23 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=8034MB free_disk=25.064075469970703GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 13:57:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:57:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:57:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de -p 172.16.0.220:3260" returned: 21 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:23 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd23050-5230-456a-8ca4-d1ecb99ef85f]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:57:23 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:57:23 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:57:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.039s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:23 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcaa6948-ea73-49f0-809b-4d3a50f5529e]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:57:23 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de] added
Jul 29 13:57:23 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:57:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:23 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bd2edca-54b0-46f4-af52-925e2e3790b0]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:57:23 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:57:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.027s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:23 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[fccb8db3-e19e-4a8f-9cfc-9ab31e55b519]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:57:23 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:57:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jZxLWJvk {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance cf326e80-7293-4764-9411-ed05a5aeba23 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 1c4a953b-67c9-4c69-950a-7487735e917c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 73f72f78-9abf-4b04-a973-06affde57310 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance a3f9ad53-db31-404a-8442-37cf53f11cbc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 3132d31d-7901-4001-bc19-7836f2ecfc70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de -p 172.16.0.220:3260 --op update -n node.session.auth.username -v jZxLWJvk" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[242d0ad5-2697-4392-96a3-40310abf1090]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'jZxLWJvk'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d98273-bdb0-48e5-b7b3-f8e786ac19f2]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5b86ebf-c53d-4201-a440-4b5fa5f035bb]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:57:24 user nova-compute[231753]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)
Jul 29 13:57:24 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:57:24 user nova-compute[231753]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)
Jul 29 13:57:24 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de -p 172.16.0.220:3260 --login" returned: 0 in 0.060s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cbb222e-b934-4d08-947a-cf06981076b5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de, portal: 172.16.0.220,3260]
Jul 29 13:57:24 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de, portal: 172.16.0.220,3260] successful.
Jul 29 13:57:24 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d63fcc7-b6bd-4b00-82b7-bdf001ef3da9]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[eeb26ff4-a897-4a5a-8f74-9322104b0ad8]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:57:24 user nova-compute[231753]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)
Jul 29 13:57:24 user nova-compute[231753]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de (non-flash)
Jul 29 13:57:24 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:57:24 user nova-compute[231753]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)
Jul 29 13:57:24 user nova-compute[231753]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de (non-flash)
Jul 29 13:57:24 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.320s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] HCTL ('35', '-', '-', 0) found on session 50 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba99c38d-d8b2-4f02-a53e-e0decafa44da]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: None {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.371s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:57:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:25 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Searching for a device in session 50 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:57:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jZxLWJvk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:57:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.351s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:57:25 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] <== connect_volume: return (1352ms) {'type': 'block', 'scsi_wwn': '26132313137666330', 'path': '/dev/sdd'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:57:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26132313137666330', 'path': '/dev/sdd'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:57:25 user nova-compute[231753]: DEBUG nova.objects.instance [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Lazy-loading 'flavor' on Instance uuid 73f72f78-9abf-4b04-a973-06affde57310 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:57:25 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:57:25 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:57:25 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 13:57:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 13:57:25 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:57:25 user nova-compute[231753]:   <source dev="/dev/sdd"/>
Jul 29 13:57:25 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:57:25 user nova-compute[231753]:   <serial>06de2268-350f-418e-9ee9-a6d9c3db07de</serial>
Jul 29 13:57:25 user nova-compute[231753]: </disk>
Jul 29 13:57:25 user nova-compute[231753]:  {{(pid=231753) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 13:57:25 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:57:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:57:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] No BDM found with device name vdb, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:57:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] No VIF found with MAC fa:16:3e:39:97:1d, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:57:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-92b52173-504e-4bdd-a07e-e0ef3a0ad8fa tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Lock "73f72f78-9abf-4b04-a973-06affde57310" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.998s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:57:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:26 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:57:27 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:57:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-889adeb5-c728-41e6-9c27-3e4d876d9f20 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Acquiring lock "73f72f78-9abf-4b04-a973-06affde57310" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:57:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-889adeb5-c728-41e6-9c27-3e4d876d9f20 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Lock "73f72f78-9abf-4b04-a973-06affde57310" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:57:27 user nova-compute[231753]: INFO nova.compute.manager [None req-889adeb5-c728-41e6-9c27-3e4d876d9f20 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Detaching volume 06de2268-350f-418e-9ee9-a6d9c3db07de
Jul 29 13:57:27 user nova-compute[231753]: INFO nova.virt.block_device [None req-889adeb5-c728-41e6-9c27-3e4d876d9f20 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Attempting to driver detach volume 06de2268-350f-418e-9ee9-a6d9c3db07de from mountpoint /dev/vdb
Jul 29 13:57:27 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-889adeb5-c728-41e6-9c27-3e4d876d9f20 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Attempting to detach device vdb from instance 73f72f78-9abf-4b04-a973-06affde57310 from the persistent domain config. {{(pid=231753) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 13:57:27 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-889adeb5-c728-41e6-9c27-3e4d876d9f20 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:57:27 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:57:27 user nova-compute[231753]:   <source dev="/dev/sdd"/>
Jul 29 13:57:27 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:57:27 user nova-compute[231753]:   <serial>06de2268-350f-418e-9ee9-a6d9c3db07de</serial>
Jul 29 13:57:27 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 13:57:27 user nova-compute[231753]: </disk>
Jul 29 13:57:27 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:57:27 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-889adeb5-c728-41e6-9c27-3e4d876d9f20 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Successfully detached device vdb from instance 73f72f78-9abf-4b04-a973-06affde57310 from the persistent domain config.
Jul 29 13:57:27 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-889adeb5-c728-41e6-9c27-3e4d876d9f20 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 73f72f78-9abf-4b04-a973-06affde57310 from the live domain config. {{(pid=231753) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 13:57:27 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-889adeb5-c728-41e6-9c27-3e4d876d9f20 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:57:27 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:57:27 user nova-compute[231753]:   <source dev="/dev/sdd"/>
Jul 29 13:57:27 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:57:27 user nova-compute[231753]:   <serial>06de2268-350f-418e-9ee9-a6d9c3db07de</serial>
Jul 29 13:57:27 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 13:57:27 user nova-compute[231753]: </disk>
Jul 29 13:57:27 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Received event <DeviceRemovedEvent: 1690639048.2374082, 73f72f78-9abf-4b04-a973-06affde57310 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=231753) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-889adeb5-c728-41e6-9c27-3e4d876d9f20 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 73f72f78-9abf-4b04-a973-06affde57310 {{(pid=231753) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 13:57:28 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-889adeb5-c728-41e6-9c27-3e4d876d9f20 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Successfully detached device vdb from instance 73f72f78-9abf-4b04-a973-06affde57310 from the live domain config.
Jul 29 13:57:28 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-889adeb5-c728-41e6-9c27-3e4d876d9f20 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-889adeb5-c728-41e6-9c27-3e4d876d9f20 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'jZxLWJvk', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:57:28 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-889adeb5-c728-41e6-9c27-3e4d876d9f20 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:57:28 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-889adeb5-c728-41e6-9c27-3e4d876d9f20 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-889adeb5-c728-41e6-9c27-3e4d876d9f20 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6df941c-cab8-4051-8ded-282554722256]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-889adeb5-c728-41e6-9c27-3e4d876d9f20 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:57:28 user nova-compute[231753]: No targets found.
Jul 29 13:57:28 user nova-compute[231753]: iSNS:
Jul 29 13:57:28 user nova-compute[231753]: No targets found.
Jul 29 13:57:28 user nova-compute[231753]: STATIC:
Jul 29 13:57:28 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf
Jul 29 13:57:28 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:57:28 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:57:28 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699
Jul 29 13:57:28 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:57:28 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:57:28 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de
Jul 29 13:57:28 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:57:28 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:57:28 user nova-compute[231753]: FIRMWARE:
Jul 29 13:57:28 user nova-compute[231753]: No targets found.
Jul 29 13:57:28 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-889adeb5-c728-41e6-9c27-3e4d876d9f20 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:57:28 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:57:28 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-889adeb5-c728-41e6-9c27-3e4d876d9f20 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0140b75b-f0c3-483e-a377-fb93370c7ebb]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea77fe76-42b2-4d05-97fb-c014f4216807]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)\ntcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-889adeb5-c728-41e6-9c27-3e4d876d9f20 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:57:28 user nova-compute[231753]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)
Jul 29 13:57:28 user nova-compute[231753]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de (non-flash)
Jul 29 13:57:28 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-889adeb5-c728-41e6-9c27-3e4d876d9f20 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:57:28 user nova-compute[231753]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)
Jul 29 13:57:28 user nova-compute[231753]: tcp: [50] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de (non-flash)
Jul 29 13:57:28 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-889adeb5-c728-41e6-9c27-3e4d876d9f20 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c8035f6d0>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de'): ({'sdd'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-889adeb5-c728-41e6-9c27-3e4d876d9f20 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Removing single pathed devices sdd {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[600978de-a831-41d1-a969-3c3c8a99daa1]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5e83f07-63a2-4aa6-8ef6-5930aea4cb2d]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-889adeb5-c728-41e6-9c27-3e4d876d9f20 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Flushing IO for device /dev/sdd {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.014s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e14427a-cec3-46fe-8f0a-c49d47e350e5]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-889adeb5-c728-41e6-9c27-3e4d876d9f20 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cc5a559-0b79-4ce5-a732-edd8cebdf093]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-889adeb5-c728-41e6-9c27-3e4d876d9f20 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-889adeb5-c728-41e6-9c27-3e4d876d9f20 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] SCSI volumes sdd have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-889adeb5-c728-41e6-9c27-3e4d876d9f20 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[13594210-56f6-4195-abb6-7d57fbb40ae4]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-889adeb5-c728-41e6-9c27-3e4d876d9f20 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de -p 172.16.0.220:3260 --logout" returned: 0 in 0.054s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[19bf1580-e5bc-43c0-be03-fc06131b1c90]: (4, ('Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de, portal: 172.16.0.220,3260]\nLogout of [sid: 50, target: iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-889adeb5-c728-41e6-9c27-3e4d876d9f20 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 50, target: iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de, portal: 172.16.0.220,3260]
Jul 29 13:57:28 user nova-compute[231753]: Logout of [sid: 50, target: iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de, portal: 172.16.0.220,3260] successful.
Jul 29 13:57:28 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:06de2268-350f-418e-9ee9-a6d9c3db07de -p 172.16.0.220:3260 --op delete" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ae5c3d9-c57d-418c-9539-b32db00e2997]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-889adeb5-c728-41e6-9c27-3e4d876d9f20 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-889adeb5-c728-41e6-9c27-3e4d876d9f20 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.290s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-889adeb5-c728-41e6-9c27-3e4d876d9f20 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] <== disconnect_volume: return (291ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:57:28 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-889adeb5-c728-41e6-9c27-3e4d876d9f20 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:57:29 user nova-compute[231753]: DEBUG nova.objects.instance [None req-889adeb5-c728-41e6-9c27-3e4d876d9f20 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Lazy-loading 'flavor' on Instance uuid 73f72f78-9abf-4b04-a973-06affde57310 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:57:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-889adeb5-c728-41e6-9c27-3e4d876d9f20 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Lock "73f72f78-9abf-4b04-a973-06affde57310" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.629s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:57:30 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:30 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:35 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Acquiring lock "8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:57:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:57:36 user nova-compute[231753]: DEBUG nova.compute.manager [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:57:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:57:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:57:36 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:57:36 user nova-compute[231753]: INFO nova.compute.claims [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Claim successful on node user
Jul 29 13:57:36 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:57:36 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:57:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.361s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:57:36 user nova-compute[231753]: DEBUG nova.compute.manager [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:57:36 user nova-compute[231753]: DEBUG nova.compute.manager [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:57:36 user nova-compute[231753]: DEBUG nova.network.neutron [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:57:36 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:57:36 user nova-compute[231753]: DEBUG nova.compute.manager [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:57:36 user nova-compute[231753]: DEBUG nova.policy [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe8dbee1098a44418ba739f073503497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28da183a39e9413ebf7f0bc22ea1ae5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:57:36 user nova-compute[231753]: DEBUG nova.compute.manager [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:57:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:57:36 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Creating image(s)
Jul 29 13:57:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Acquiring lock "/opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:57:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "/opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:57:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "/opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:57:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:37 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.136s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:57:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:57:37 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:37 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.155s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:37 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:37 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk 1073741824" returned: 0 in 0.055s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.218s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:57:37 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:37 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.152s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:37 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:57:37 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:37 user nova-compute[231753]: DEBUG nova.network.neutron [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Successfully created port: eea8caab-510b-4b6d-bf98-d1149bd48f91 {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:57:37 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:37 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Cannot resize image /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:57:37 user nova-compute[231753]: DEBUG nova.objects.instance [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lazy-loading 'migration_context' on Instance uuid 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:57:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:57:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Ensure instance console log exists: /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:57:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:57:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:57:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG nova.network.neutron [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Successfully updated port: eea8caab-510b-4b6d-bf98-d1149bd48f91 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Acquiring lock "refresh_cache-8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Acquired lock "refresh_cache-8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG nova.network.neutron [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG nova.compute.manager [req-43283fb8-60ac-44f8-9c0b-b84736fd9664 req-1091bec9-5521-47e8-990a-f11eb0aaa0ea service nova] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Received event network-changed-eea8caab-510b-4b6d-bf98-d1149bd48f91 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG nova.compute.manager [req-43283fb8-60ac-44f8-9c0b-b84736fd9664 req-1091bec9-5521-47e8-990a-f11eb0aaa0ea service nova] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Refreshing instance network info cache due to event network-changed-eea8caab-510b-4b6d-bf98-d1149bd48f91. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-43283fb8-60ac-44f8-9c0b-b84736fd9664 req-1091bec9-5521-47e8-990a-f11eb0aaa0ea service nova] Acquiring lock "refresh_cache-8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG nova.network.neutron [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG nova.network.neutron [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Updating instance_info_cache with network_info: [{"id": "eea8caab-510b-4b6d-bf98-d1149bd48f91", "address": "fa:16:3e:cf:43:1e", "network": {"id": "a10f7c69-0720-46b5-b252-6523dc61a6ca", "bridge": "br-int", "label": "tempest-TestStampPattern-1661615052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28da183a39e9413ebf7f0bc22ea1ae5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea8caab-51", "ovs_interfaceid": "eea8caab-510b-4b6d-bf98-d1149bd48f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Releasing lock "refresh_cache-8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG nova.compute.manager [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Instance network_info: |[{"id": "eea8caab-510b-4b6d-bf98-d1149bd48f91", "address": "fa:16:3e:cf:43:1e", "network": {"id": "a10f7c69-0720-46b5-b252-6523dc61a6ca", "bridge": "br-int", "label": "tempest-TestStampPattern-1661615052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28da183a39e9413ebf7f0bc22ea1ae5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea8caab-51", "ovs_interfaceid": "eea8caab-510b-4b6d-bf98-d1149bd48f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-43283fb8-60ac-44f8-9c0b-b84736fd9664 req-1091bec9-5521-47e8-990a-f11eb0aaa0ea service nova] Acquired lock "refresh_cache-8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG nova.network.neutron [req-43283fb8-60ac-44f8-9c0b-b84736fd9664 req-1091bec9-5521-47e8-990a-f11eb0aaa0ea service nova] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Refreshing network info cache for port eea8caab-510b-4b6d-bf98-d1149bd48f91 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Start _get_guest_xml network_info=[{"id": "eea8caab-510b-4b6d-bf98-d1149bd48f91", "address": "fa:16:3e:cf:43:1e", "network": {"id": "a10f7c69-0720-46b5-b252-6523dc61a6ca", "bridge": "br-int", "label": "tempest-TestStampPattern-1661615052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28da183a39e9413ebf7f0bc22ea1ae5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea8caab-51", "ovs_interfaceid": "eea8caab-510b-4b6d-bf98-d1149bd48f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:57:38 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:57:38 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:57:38 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:57:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1347009007',display_name='tempest-TestStampPattern-server-1347009007',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1347009007',id=44,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJ0UCuB1s/FcIxNR+PeaL27O4FLCSRuPA3sNGjkAYL2ft4zG9hnQn3p/NaR8N5IEf65ITJPm24CQQ3JghZ9yGOSsBJ6AidP6UmfWpGZKzXSpLz9fY7+5vRgRPmfh/cMFA==',key_name='tempest-TestStampPattern-2343879',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28da183a39e9413ebf7f0bc22ea1ae5d',ramdisk_id='',reservation_id='r-gflmac11',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-442563326',owner_user_name='tempest-TestStampPattern-442563326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:57:37Z,user_data=None,user_id='fe8dbee1098a44418ba739f073503497',uuid=8e8d1ee0-4906-4411-a1fd-c5997a22b5e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eea8caab-510b-4b6d-bf98-d1149bd48f91", "address": "fa:16:3e:cf:43:1e", "network": {"id": "a10f7c69-0720-46b5-b252-6523dc61a6ca", "bridge": "br-int", "label": "tempest-TestStampPattern-1661615052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28da183a39e9413ebf7f0bc22ea1ae5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea8caab-51", "ovs_interfaceid": "eea8caab-510b-4b6d-bf98-d1149bd48f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Converting VIF {"id": "eea8caab-510b-4b6d-bf98-d1149bd48f91", "address": "fa:16:3e:cf:43:1e", "network": {"id": "a10f7c69-0720-46b5-b252-6523dc61a6ca", "bridge": "br-int", "label": "tempest-TestStampPattern-1661615052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28da183a39e9413ebf7f0bc22ea1ae5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea8caab-51", "ovs_interfaceid": "eea8caab-510b-4b6d-bf98-d1149bd48f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:43:1e,bridge_name='br-int',has_traffic_filtering=True,id=eea8caab-510b-4b6d-bf98-d1149bd48f91,network=Network(a10f7c69-0720-46b5-b252-6523dc61a6ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeea8caab-51') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG nova.objects.instance [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lazy-loading 'pci_devices' on Instance uuid 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:57:38 user nova-compute[231753]:   <uuid>8e8d1ee0-4906-4411-a1fd-c5997a22b5e8</uuid>
Jul 29 13:57:38 user nova-compute[231753]:   <name>instance-0000002c</name>
Jul 29 13:57:38 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:57:38 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:57:38 user nova-compute[231753]:   <metadata>
Jul 29 13:57:38 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:57:38 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:57:38 user nova-compute[231753]:       <nova:name>tempest-TestStampPattern-server-1347009007</nova:name>
Jul 29 13:57:38 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:57:38</nova:creationTime>
Jul 29 13:57:38 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:57:38 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:57:38 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:57:38 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:57:38 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:57:38 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:57:38 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:57:38 user nova-compute[231753]:       <nova:owner>
Jul 29 13:57:38 user nova-compute[231753]:         <nova:user uuid="fe8dbee1098a44418ba739f073503497">tempest-TestStampPattern-442563326-project-member</nova:user>
Jul 29 13:57:38 user nova-compute[231753]:         <nova:project uuid="28da183a39e9413ebf7f0bc22ea1ae5d">tempest-TestStampPattern-442563326</nova:project>
Jul 29 13:57:38 user nova-compute[231753]:       </nova:owner>
Jul 29 13:57:38 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:57:38 user nova-compute[231753]:       <nova:ports>
Jul 29 13:57:38 user nova-compute[231753]:         <nova:port uuid="eea8caab-510b-4b6d-bf98-d1149bd48f91">
Jul 29 13:57:38 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.14" ipVersion="4"/>
Jul 29 13:57:38 user nova-compute[231753]:         </nova:port>
Jul 29 13:57:38 user nova-compute[231753]:       </nova:ports>
Jul 29 13:57:38 user nova-compute[231753]:     </nova:instance>
Jul 29 13:57:38 user nova-compute[231753]:   </metadata>
Jul 29 13:57:38 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:57:38 user nova-compute[231753]:     <system>
Jul 29 13:57:38 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:57:38 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:57:38 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:57:38 user nova-compute[231753]:       <entry name="serial">8e8d1ee0-4906-4411-a1fd-c5997a22b5e8</entry>
Jul 29 13:57:38 user nova-compute[231753]:       <entry name="uuid">8e8d1ee0-4906-4411-a1fd-c5997a22b5e8</entry>
Jul 29 13:57:38 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:57:38 user nova-compute[231753]:     </system>
Jul 29 13:57:38 user nova-compute[231753]:   </sysinfo>
Jul 29 13:57:38 user nova-compute[231753]:   <os>
Jul 29 13:57:38 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:57:38 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:57:38 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:57:38 user nova-compute[231753]:   </os>
Jul 29 13:57:38 user nova-compute[231753]:   <features>
Jul 29 13:57:38 user nova-compute[231753]:     <acpi/>
Jul 29 13:57:38 user nova-compute[231753]:     <apic/>
Jul 29 13:57:38 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:57:38 user nova-compute[231753]:   </features>
Jul 29 13:57:38 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:57:38 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:57:38 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:57:38 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:57:38 user nova-compute[231753]:   </clock>
Jul 29 13:57:38 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:57:38 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:57:38 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:57:38 user nova-compute[231753]:   </cpu>
Jul 29 13:57:38 user nova-compute[231753]:   <devices>
Jul 29 13:57:38 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:57:38 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:57:38 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk"/>
Jul 29 13:57:38 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:57:38 user nova-compute[231753]:     </disk>
Jul 29 13:57:38 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:57:38 user nova-compute[231753]:       <mac address="fa:16:3e:cf:43:1e"/>
Jul 29 13:57:38 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:57:38 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:57:38 user nova-compute[231753]:       <target dev="tapeea8caab-51"/>
Jul 29 13:57:38 user nova-compute[231753]:     </interface>
Jul 29 13:57:38 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:57:38 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/console.log" append="off"/>
Jul 29 13:57:38 user nova-compute[231753]:     </serial>
Jul 29 13:57:38 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:57:38 user nova-compute[231753]:     <video>
Jul 29 13:57:38 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:57:38 user nova-compute[231753]:     </video>
Jul 29 13:57:38 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:57:38 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:57:38 user nova-compute[231753]:     </rng>
Jul 29 13:57:38 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:57:38 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:57:38 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:57:38 user nova-compute[231753]:     </memballoon>
Jul 29 13:57:38 user nova-compute[231753]:   </devices>
Jul 29 13:57:38 user nova-compute[231753]: </domain>
Jul 29 13:57:38 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:57:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-1347009007',display_name='tempest-TestStampPattern-server-1347009007',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1347009007',id=44,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJ0UCuB1s/FcIxNR+PeaL27O4FLCSRuPA3sNGjkAYL2ft4zG9hnQn3p/NaR8N5IEf65ITJPm24CQQ3JghZ9yGOSsBJ6AidP6UmfWpGZKzXSpLz9fY7+5vRgRPmfh/cMFA==',key_name='tempest-TestStampPattern-2343879',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28da183a39e9413ebf7f0bc22ea1ae5d',ramdisk_id='',reservation_id='r-gflmac11',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestStampPattern-442563326',owner_user_name='tempest-TestStampPattern-442563326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:57:37Z,user_data=None,user_id='fe8dbee1098a44418ba739f073503497',uuid=8e8d1ee0-4906-4411-a1fd-c5997a22b5e8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "eea8caab-510b-4b6d-bf98-d1149bd48f91", "address": "fa:16:3e:cf:43:1e", "network": {"id": "a10f7c69-0720-46b5-b252-6523dc61a6ca", "bridge": "br-int", "label": "tempest-TestStampPattern-1661615052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28da183a39e9413ebf7f0bc22ea1ae5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea8caab-51", "ovs_interfaceid": "eea8caab-510b-4b6d-bf98-d1149bd48f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Converting VIF {"id": "eea8caab-510b-4b6d-bf98-d1149bd48f91", "address": "fa:16:3e:cf:43:1e", "network": {"id": "a10f7c69-0720-46b5-b252-6523dc61a6ca", "bridge": "br-int", "label": "tempest-TestStampPattern-1661615052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28da183a39e9413ebf7f0bc22ea1ae5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea8caab-51", "ovs_interfaceid": "eea8caab-510b-4b6d-bf98-d1149bd48f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cf:43:1e,bridge_name='br-int',has_traffic_filtering=True,id=eea8caab-510b-4b6d-bf98-d1149bd48f91,network=Network(a10f7c69-0720-46b5-b252-6523dc61a6ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeea8caab-51') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG os_vif [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:43:1e,bridge_name='br-int',has_traffic_filtering=True,id=eea8caab-510b-4b6d-bf98-d1149bd48f91,network=Network(a10f7c69-0720-46b5-b252-6523dc61a6ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeea8caab-51') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapeea8caab-51, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapeea8caab-51, col_values=(('external_ids', {'iface-id': 'eea8caab-510b-4b6d-bf98-d1149bd48f91', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cf:43:1e', 'vm-uuid': '8e8d1ee0-4906-4411-a1fd-c5997a22b5e8'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:38 user nova-compute[231753]: INFO os_vif [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cf:43:1e,bridge_name='br-int',has_traffic_filtering=True,id=eea8caab-510b-4b6d-bf98-d1149bd48f91,network=Network(a10f7c69-0720-46b5-b252-6523dc61a6ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeea8caab-51')
Jul 29 13:57:38 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:57:38 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] No VIF found with MAC fa:16:3e:cf:43:1e, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:57:39 user nova-compute[231753]: DEBUG nova.network.neutron [req-43283fb8-60ac-44f8-9c0b-b84736fd9664 req-1091bec9-5521-47e8-990a-f11eb0aaa0ea service nova] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Updated VIF entry in instance network info cache for port eea8caab-510b-4b6d-bf98-d1149bd48f91. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:57:39 user nova-compute[231753]: DEBUG nova.network.neutron [req-43283fb8-60ac-44f8-9c0b-b84736fd9664 req-1091bec9-5521-47e8-990a-f11eb0aaa0ea service nova] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Updating instance_info_cache with network_info: [{"id": "eea8caab-510b-4b6d-bf98-d1149bd48f91", "address": "fa:16:3e:cf:43:1e", "network": {"id": "a10f7c69-0720-46b5-b252-6523dc61a6ca", "bridge": "br-int", "label": "tempest-TestStampPattern-1661615052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28da183a39e9413ebf7f0bc22ea1ae5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea8caab-51", "ovs_interfaceid": "eea8caab-510b-4b6d-bf98-d1149bd48f91", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:57:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-43283fb8-60ac-44f8-9c0b-b84736fd9664 req-1091bec9-5521-47e8-990a-f11eb0aaa0ea service nova] Releasing lock "refresh_cache-8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:57:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:40 user nova-compute[231753]: DEBUG nova.compute.manager [req-74aa7952-13ae-483a-964b-4f2c488b94fd req-cdae5815-cf9a-437f-b850-b0f1861c2f1e service nova] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Received event network-vif-plugged-eea8caab-510b-4b6d-bf98-d1149bd48f91 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:57:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-74aa7952-13ae-483a-964b-4f2c488b94fd req-cdae5815-cf9a-437f-b850-b0f1861c2f1e service nova] Acquiring lock "8e8d1ee0-4906-4411-a1fd-c5997a22b5e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:57:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-74aa7952-13ae-483a-964b-4f2c488b94fd req-cdae5815-cf9a-437f-b850-b0f1861c2f1e service nova] Lock "8e8d1ee0-4906-4411-a1fd-c5997a22b5e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:57:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-74aa7952-13ae-483a-964b-4f2c488b94fd req-cdae5815-cf9a-437f-b850-b0f1861c2f1e service nova] Lock "8e8d1ee0-4906-4411-a1fd-c5997a22b5e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:57:40 user nova-compute[231753]: DEBUG nova.compute.manager [req-74aa7952-13ae-483a-964b-4f2c488b94fd req-cdae5815-cf9a-437f-b850-b0f1861c2f1e service nova] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] No waiting events found dispatching network-vif-plugged-eea8caab-510b-4b6d-bf98-d1149bd48f91 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:57:40 user nova-compute[231753]: WARNING nova.compute.manager [req-74aa7952-13ae-483a-964b-4f2c488b94fd req-cdae5815-cf9a-437f-b850-b0f1861c2f1e service nova] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Received unexpected event network-vif-plugged-eea8caab-510b-4b6d-bf98-d1149bd48f91 for instance with vm_state building and task_state spawning.
Jul 29 13:57:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "1c4a953b-67c9-4c69-950a-7487735e917c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "1c4a953b-67c9-4c69-950a-7487735e917c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "1c4a953b-67c9-4c69-950a-7487735e917c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "1c4a953b-67c9-4c69-950a-7487735e917c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "1c4a953b-67c9-4c69-950a-7487735e917c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:57:42 user nova-compute[231753]: INFO nova.compute.manager [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Terminating instance
Jul 29 13:57:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690639062.3603134, 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:57:42 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] VM Resumed (Lifecycle Event)
Jul 29 13:57:42 user nova-compute[231753]: DEBUG nova.compute.manager [req-669a6e0b-fea7-4421-bcd0-cfb55ad43760 req-3ddb74f7-b87e-4633-8b40-3464011b06fa service nova] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Received event network-vif-unplugged-da91541f-4471-455f-adf7-cfa9eb63de88 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-669a6e0b-fea7-4421-bcd0-cfb55ad43760 req-3ddb74f7-b87e-4633-8b40-3464011b06fa service nova] Acquiring lock "1c4a953b-67c9-4c69-950a-7487735e917c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-669a6e0b-fea7-4421-bcd0-cfb55ad43760 req-3ddb74f7-b87e-4633-8b40-3464011b06fa service nova] Lock "1c4a953b-67c9-4c69-950a-7487735e917c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-669a6e0b-fea7-4421-bcd0-cfb55ad43760 req-3ddb74f7-b87e-4633-8b40-3464011b06fa service nova] Lock "1c4a953b-67c9-4c69-950a-7487735e917c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG nova.compute.manager [req-669a6e0b-fea7-4421-bcd0-cfb55ad43760 req-3ddb74f7-b87e-4633-8b40-3464011b06fa service nova] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] No waiting events found dispatching network-vif-unplugged-da91541f-4471-455f-adf7-cfa9eb63de88 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG nova.compute.manager [req-669a6e0b-fea7-4421-bcd0-cfb55ad43760 req-3ddb74f7-b87e-4633-8b40-3464011b06fa service nova] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Received event network-vif-unplugged-da91541f-4471-455f-adf7-cfa9eb63de88 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:57:42 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Instance spawned successfully.
Jul 29 13:57:42 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:57:42 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:57:42 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690639062.361899, 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:57:42 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] VM Started (Lifecycle Event)
Jul 29 13:57:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:57:42 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:57:42 user nova-compute[231753]: INFO nova.compute.manager [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Took 5.60 seconds to spawn the instance on the hypervisor.
Jul 29 13:57:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG nova.compute.manager [req-6cce115f-49f2-45d7-801c-a23fa84ace94 req-e0cefb1e-2ce8-43f6-9b2c-aa4b179e6788 service nova] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Received event network-vif-plugged-eea8caab-510b-4b6d-bf98-d1149bd48f91 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6cce115f-49f2-45d7-801c-a23fa84ace94 req-e0cefb1e-2ce8-43f6-9b2c-aa4b179e6788 service nova] Acquiring lock "8e8d1ee0-4906-4411-a1fd-c5997a22b5e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6cce115f-49f2-45d7-801c-a23fa84ace94 req-e0cefb1e-2ce8-43f6-9b2c-aa4b179e6788 service nova] Lock "8e8d1ee0-4906-4411-a1fd-c5997a22b5e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6cce115f-49f2-45d7-801c-a23fa84ace94 req-e0cefb1e-2ce8-43f6-9b2c-aa4b179e6788 service nova] Lock "8e8d1ee0-4906-4411-a1fd-c5997a22b5e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG nova.compute.manager [req-6cce115f-49f2-45d7-801c-a23fa84ace94 req-e0cefb1e-2ce8-43f6-9b2c-aa4b179e6788 service nova] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] No waiting events found dispatching network-vif-plugged-eea8caab-510b-4b6d-bf98-d1149bd48f91 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:57:42 user nova-compute[231753]: WARNING nova.compute.manager [req-6cce115f-49f2-45d7-801c-a23fa84ace94 req-e0cefb1e-2ce8-43f6-9b2c-aa4b179e6788 service nova] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Received unexpected event network-vif-plugged-eea8caab-510b-4b6d-bf98-d1149bd48f91 for instance with vm_state building and task_state spawning.
Jul 29 13:57:42 user nova-compute[231753]: INFO nova.compute.manager [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Took 6.28 seconds to build instance.
Jul 29 13:57:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-62a52680-15cd-4ede-8afc-9eade424e304 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.373s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:42 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Instance destroyed successfully.
Jul 29 13:57:42 user nova-compute[231753]: DEBUG nova.objects.instance [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lazy-loading 'resources' on Instance uuid 1c4a953b-67c9-4c69-950a-7487735e917c {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:52:51Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-volume-backed-server-1545635091',display_name='tempest-TestVolumeBootPattern-volume-backed-server-1545635091',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-volume-backed-server-1545635091',id=39,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNYEyA/OCWVQKmYyb6Rhc6uucXQytbp/n4pNNQWQCFx6a6MxgYxsIgln3h+2tWrNEsj4k7xfNIjDNCY9pTqAVFiI3NzGPRdC+4iQbM3P/nk+/101jOiENF3D7vU4FM+hqw==',key_name='tempest-keypair-1776646106',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:53:06Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f45c92d3fe964066b9be87489b2c9f7e',ramdisk_id='',reservation_id='r-6n810j1q',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-434673895',owner_user_name='tempest-TestVolumeBootPattern-434673895-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:53:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='d94a7ea0c19845b886e12c1689cf30a8',uuid=1c4a953b-67c9-4c69-950a-7487735e917c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "da91541f-4471-455f-adf7-cfa9eb63de88", "address": "fa:16:3e:3d:fe:a2", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda91541f-44", "ovs_interfaceid": "da91541f-4471-455f-adf7-cfa9eb63de88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Converting VIF {"id": "da91541f-4471-455f-adf7-cfa9eb63de88", "address": "fa:16:3e:3d:fe:a2", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.101", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapda91541f-44", "ovs_interfaceid": "da91541f-4471-455f-adf7-cfa9eb63de88", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3d:fe:a2,bridge_name='br-int',has_traffic_filtering=True,id=da91541f-4471-455f-adf7-cfa9eb63de88,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda91541f-44') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG os_vif [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:fe:a2,bridge_name='br-int',has_traffic_filtering=True,id=da91541f-4471-455f-adf7-cfa9eb63de88,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda91541f-44') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapda91541f-44, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:42 user nova-compute[231753]: INFO os_vif [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3d:fe:a2,bridge_name='br-int',has_traffic_filtering=True,id=da91541f-4471-455f-adf7-cfa9eb63de88,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapda91541f-44')
Jul 29 13:57:42 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'mcHrOkjh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:57:42 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:57:42 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a631cd-a42b-4360-b922-b65023e3e76e]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:57:42 user nova-compute[231753]: No targets found.
Jul 29 13:57:42 user nova-compute[231753]: iSNS:
Jul 29 13:57:42 user nova-compute[231753]: No targets found.
Jul 29 13:57:42 user nova-compute[231753]: STATIC:
Jul 29 13:57:42 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf
Jul 29 13:57:42 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:57:42 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:57:42 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699
Jul 29 13:57:42 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:57:42 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:57:42 user nova-compute[231753]: FIRMWARE:
Jul 29 13:57:42 user nova-compute[231753]: No targets found.
Jul 29 13:57:42 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:57:42 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:57:42 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.031s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[609f0358-50d7-4ab6-b4e1-7bfe63e9038a]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.029s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[68ae86ba-5818-4900-ad22-1bbc511dfb5f]: (4, ('tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)\ntcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:57:42 user nova-compute[231753]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)
Jul 29 13:57:42 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsi session list stdout=tcp: [43] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 (non-flash)
Jul 29 13:57:42 user nova-compute[231753]: tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)
Jul 29 13:57:42 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c806b4310>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699'): ({'sdc'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Removing single pathed devices sdc {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3642e76b-dc9d-4c9c-9e80-9b7dc6505283]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:57:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:43 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa43d95b-9ee3-4939-9f28-4d31d9d3caa8]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:57:43 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Flushing IO for device /dev/sdc {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:57:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:43 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9efee40-8007-45a9-9996-8a808b8f7d34]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:57:43 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:57:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.057s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:43 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca07c042-63b7-4937-82a0-1700742921bf]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:57:43 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:57:43 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] SCSI volumes sdc have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:57:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:57:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:43 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a6387d-5629-4b0f-a5a1-f98fe55236d1]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:57:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:57:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 -p 172.16.0.220:3260 --logout" returned: 0 in 0.068s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:43 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f15a0dd-03d1-485d-825a-465cc49cd9b4]: (4, ('Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699, portal: 172.16.0.220,3260]\nLogout of [sid: 43, target: iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:57:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 43, target: iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699, portal: 172.16.0.220,3260]
Jul 29 13:57:43 user nova-compute[231753]: Logout of [sid: 43, target: iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699, portal: 172.16.0.220,3260] successful.
Jul 29 13:57:43 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:57:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:57:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:a4fd52a0-187e-4105-9637-1cd908377699 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:57:43 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8848870-a520-4c41-8f63-093b61337706]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:57:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:57:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.359s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:57:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] <== disconnect_volume: return (361ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:57:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:57:43 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Deleting instance files /opt/stack/data/nova/instances/1c4a953b-67c9-4c69-950a-7487735e917c_del
Jul 29 13:57:43 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Deletion of /opt/stack/data/nova/instances/1c4a953b-67c9-4c69-950a-7487735e917c_del complete
Jul 29 13:57:43 user nova-compute[231753]: INFO nova.compute.manager [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Took 1.27 seconds to destroy the instance on the hypervisor.
Jul 29 13:57:43 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:57:43 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:57:43 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:57:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-e564c2ed-053e-429b-8730-f6cb71e092d9 req-0747bf05-cdd0-450c-9db7-8b16a2b3552c service nova] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Received event network-vif-plugged-da91541f-4471-455f-adf7-cfa9eb63de88 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:57:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e564c2ed-053e-429b-8730-f6cb71e092d9 req-0747bf05-cdd0-450c-9db7-8b16a2b3552c service nova] Acquiring lock "1c4a953b-67c9-4c69-950a-7487735e917c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:57:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e564c2ed-053e-429b-8730-f6cb71e092d9 req-0747bf05-cdd0-450c-9db7-8b16a2b3552c service nova] Lock "1c4a953b-67c9-4c69-950a-7487735e917c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:57:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e564c2ed-053e-429b-8730-f6cb71e092d9 req-0747bf05-cdd0-450c-9db7-8b16a2b3552c service nova] Lock "1c4a953b-67c9-4c69-950a-7487735e917c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:57:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-e564c2ed-053e-429b-8730-f6cb71e092d9 req-0747bf05-cdd0-450c-9db7-8b16a2b3552c service nova] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] No waiting events found dispatching network-vif-plugged-da91541f-4471-455f-adf7-cfa9eb63de88 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:57:44 user nova-compute[231753]: WARNING nova.compute.manager [req-e564c2ed-053e-429b-8730-f6cb71e092d9 req-0747bf05-cdd0-450c-9db7-8b16a2b3552c service nova] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Received unexpected event network-vif-plugged-da91541f-4471-455f-adf7-cfa9eb63de88 for instance with vm_state active and task_state deleting.
Jul 29 13:57:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-e564c2ed-053e-429b-8730-f6cb71e092d9 req-0747bf05-cdd0-450c-9db7-8b16a2b3552c service nova] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Received event network-vif-plugged-da91541f-4471-455f-adf7-cfa9eb63de88 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:57:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e564c2ed-053e-429b-8730-f6cb71e092d9 req-0747bf05-cdd0-450c-9db7-8b16a2b3552c service nova] Acquiring lock "1c4a953b-67c9-4c69-950a-7487735e917c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:57:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e564c2ed-053e-429b-8730-f6cb71e092d9 req-0747bf05-cdd0-450c-9db7-8b16a2b3552c service nova] Lock "1c4a953b-67c9-4c69-950a-7487735e917c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:57:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e564c2ed-053e-429b-8730-f6cb71e092d9 req-0747bf05-cdd0-450c-9db7-8b16a2b3552c service nova] Lock "1c4a953b-67c9-4c69-950a-7487735e917c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:57:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-e564c2ed-053e-429b-8730-f6cb71e092d9 req-0747bf05-cdd0-450c-9db7-8b16a2b3552c service nova] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] No waiting events found dispatching network-vif-plugged-da91541f-4471-455f-adf7-cfa9eb63de88 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:57:44 user nova-compute[231753]: WARNING nova.compute.manager [req-e564c2ed-053e-429b-8730-f6cb71e092d9 req-0747bf05-cdd0-450c-9db7-8b16a2b3552c service nova] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Received unexpected event network-vif-plugged-da91541f-4471-455f-adf7-cfa9eb63de88 for instance with vm_state active and task_state deleting.
Jul 29 13:57:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-e564c2ed-053e-429b-8730-f6cb71e092d9 req-0747bf05-cdd0-450c-9db7-8b16a2b3552c service nova] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Received event network-vif-plugged-da91541f-4471-455f-adf7-cfa9eb63de88 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:57:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e564c2ed-053e-429b-8730-f6cb71e092d9 req-0747bf05-cdd0-450c-9db7-8b16a2b3552c service nova] Acquiring lock "1c4a953b-67c9-4c69-950a-7487735e917c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:57:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e564c2ed-053e-429b-8730-f6cb71e092d9 req-0747bf05-cdd0-450c-9db7-8b16a2b3552c service nova] Lock "1c4a953b-67c9-4c69-950a-7487735e917c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:57:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e564c2ed-053e-429b-8730-f6cb71e092d9 req-0747bf05-cdd0-450c-9db7-8b16a2b3552c service nova] Lock "1c4a953b-67c9-4c69-950a-7487735e917c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:57:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-e564c2ed-053e-429b-8730-f6cb71e092d9 req-0747bf05-cdd0-450c-9db7-8b16a2b3552c service nova] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] No waiting events found dispatching network-vif-plugged-da91541f-4471-455f-adf7-cfa9eb63de88 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:57:44 user nova-compute[231753]: WARNING nova.compute.manager [req-e564c2ed-053e-429b-8730-f6cb71e092d9 req-0747bf05-cdd0-450c-9db7-8b16a2b3552c service nova] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Received unexpected event network-vif-plugged-da91541f-4471-455f-adf7-cfa9eb63de88 for instance with vm_state active and task_state deleting.
Jul 29 13:57:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-e564c2ed-053e-429b-8730-f6cb71e092d9 req-0747bf05-cdd0-450c-9db7-8b16a2b3552c service nova] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Received event network-vif-unplugged-da91541f-4471-455f-adf7-cfa9eb63de88 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:57:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e564c2ed-053e-429b-8730-f6cb71e092d9 req-0747bf05-cdd0-450c-9db7-8b16a2b3552c service nova] Acquiring lock "1c4a953b-67c9-4c69-950a-7487735e917c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:57:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e564c2ed-053e-429b-8730-f6cb71e092d9 req-0747bf05-cdd0-450c-9db7-8b16a2b3552c service nova] Lock "1c4a953b-67c9-4c69-950a-7487735e917c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:57:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e564c2ed-053e-429b-8730-f6cb71e092d9 req-0747bf05-cdd0-450c-9db7-8b16a2b3552c service nova] Lock "1c4a953b-67c9-4c69-950a-7487735e917c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:57:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-e564c2ed-053e-429b-8730-f6cb71e092d9 req-0747bf05-cdd0-450c-9db7-8b16a2b3552c service nova] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] No waiting events found dispatching network-vif-unplugged-da91541f-4471-455f-adf7-cfa9eb63de88 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:57:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-e564c2ed-053e-429b-8730-f6cb71e092d9 req-0747bf05-cdd0-450c-9db7-8b16a2b3552c service nova] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Received event network-vif-unplugged-da91541f-4471-455f-adf7-cfa9eb63de88 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:57:44 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:57:44 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Took 1.39 seconds to deallocate network for instance.
Jul 29 13:57:45 user nova-compute[231753]: INFO nova.compute.manager [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Took 0.72 seconds to detach 1 volumes for instance.
Jul 29 13:57:45 user nova-compute[231753]: DEBUG nova.compute.manager [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Deleting volume: a4fd52a0-187e-4105-9637-1cd908377699 {{(pid=231753) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 29 13:57:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:57:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:57:45 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:57:45 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:57:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.247s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:57:45 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Deleted allocations for instance 1c4a953b-67c9-4c69-950a-7487735e917c
Jul 29 13:57:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-c9dc4ce1-d5d8-413c-8ccb-5b6a4cf84da8 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "1c4a953b-67c9-4c69-950a-7487735e917c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.877s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:57:46 user nova-compute[231753]: DEBUG nova.compute.manager [req-224723c8-84bc-42f7-85b3-a0d9b35d2860 req-9440eabf-f2bf-4fdf-b3fc-226d7bdd2e6b service nova] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Received event network-vif-plugged-da91541f-4471-455f-adf7-cfa9eb63de88 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:57:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-224723c8-84bc-42f7-85b3-a0d9b35d2860 req-9440eabf-f2bf-4fdf-b3fc-226d7bdd2e6b service nova] Acquiring lock "1c4a953b-67c9-4c69-950a-7487735e917c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:57:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-224723c8-84bc-42f7-85b3-a0d9b35d2860 req-9440eabf-f2bf-4fdf-b3fc-226d7bdd2e6b service nova] Lock "1c4a953b-67c9-4c69-950a-7487735e917c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:57:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-224723c8-84bc-42f7-85b3-a0d9b35d2860 req-9440eabf-f2bf-4fdf-b3fc-226d7bdd2e6b service nova] Lock "1c4a953b-67c9-4c69-950a-7487735e917c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:57:46 user nova-compute[231753]: DEBUG nova.compute.manager [req-224723c8-84bc-42f7-85b3-a0d9b35d2860 req-9440eabf-f2bf-4fdf-b3fc-226d7bdd2e6b service nova] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] No waiting events found dispatching network-vif-plugged-da91541f-4471-455f-adf7-cfa9eb63de88 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:57:46 user nova-compute[231753]: WARNING nova.compute.manager [req-224723c8-84bc-42f7-85b3-a0d9b35d2860 req-9440eabf-f2bf-4fdf-b3fc-226d7bdd2e6b service nova] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Received unexpected event network-vif-plugged-da91541f-4471-455f-adf7-cfa9eb63de88 for instance with vm_state deleted and task_state None.
Jul 29 13:57:46 user nova-compute[231753]: DEBUG nova.compute.manager [req-224723c8-84bc-42f7-85b3-a0d9b35d2860 req-9440eabf-f2bf-4fdf-b3fc-226d7bdd2e6b service nova] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Received event network-vif-deleted-da91541f-4471-455f-adf7-cfa9eb63de88 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:57:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7b3caca1-6eaa-413c-ada7-37e8dbb99dd2 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "cf326e80-7293-4764-9411-ed05a5aeba23" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:57:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7b3caca1-6eaa-413c-ada7-37e8dbb99dd2 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "cf326e80-7293-4764-9411-ed05a5aeba23" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:57:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7b3caca1-6eaa-413c-ada7-37e8dbb99dd2 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "cf326e80-7293-4764-9411-ed05a5aeba23-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:57:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7b3caca1-6eaa-413c-ada7-37e8dbb99dd2 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "cf326e80-7293-4764-9411-ed05a5aeba23-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:57:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7b3caca1-6eaa-413c-ada7-37e8dbb99dd2 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "cf326e80-7293-4764-9411-ed05a5aeba23-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:57:47 user nova-compute[231753]: INFO nova.compute.manager [None req-7b3caca1-6eaa-413c-ada7-37e8dbb99dd2 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Terminating instance
Jul 29 13:57:47 user nova-compute[231753]: DEBUG nova.compute.manager [None req-7b3caca1-6eaa-413c-ada7-37e8dbb99dd2 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:57:47 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:47 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:47 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:47 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:47 user nova-compute[231753]: DEBUG nova.compute.manager [req-2d9000d6-694f-43b6-8b3f-23bb7062548e req-a761728d-f4cf-4262-b086-6b057902c600 service nova] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Received event network-vif-unplugged-fbd63de1-966b-4791-8c72-6a5e2d26a7e2 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:57:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-2d9000d6-694f-43b6-8b3f-23bb7062548e req-a761728d-f4cf-4262-b086-6b057902c600 service nova] Acquiring lock "cf326e80-7293-4764-9411-ed05a5aeba23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:57:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-2d9000d6-694f-43b6-8b3f-23bb7062548e req-a761728d-f4cf-4262-b086-6b057902c600 service nova] Lock "cf326e80-7293-4764-9411-ed05a5aeba23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:57:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-2d9000d6-694f-43b6-8b3f-23bb7062548e req-a761728d-f4cf-4262-b086-6b057902c600 service nova] Lock "cf326e80-7293-4764-9411-ed05a5aeba23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.003s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:57:47 user nova-compute[231753]: DEBUG nova.compute.manager [req-2d9000d6-694f-43b6-8b3f-23bb7062548e req-a761728d-f4cf-4262-b086-6b057902c600 service nova] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] No waiting events found dispatching network-vif-unplugged-fbd63de1-966b-4791-8c72-6a5e2d26a7e2 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:57:47 user nova-compute[231753]: DEBUG nova.compute.manager [req-2d9000d6-694f-43b6-8b3f-23bb7062548e req-a761728d-f4cf-4262-b086-6b057902c600 service nova] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Received event network-vif-unplugged-fbd63de1-966b-4791-8c72-6a5e2d26a7e2 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:57:47 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:48 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Instance destroyed successfully.
Jul 29 13:57:48 user nova-compute[231753]: DEBUG nova.objects.instance [None req-7b3caca1-6eaa-413c-ada7-37e8dbb99dd2 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lazy-loading 'resources' on Instance uuid cf326e80-7293-4764-9411-ed05a5aeba23 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:57:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-7b3caca1-6eaa-413c-ada7-37e8dbb99dd2 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:38:08Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1544171267',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-serverbootfromvolumestablerescuetest-server-1544171267',id=17,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:38:16Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='c01165e83a3143ad83f050790f2b63fe',ramdisk_id='',reservation_id='r-0mwlo0g6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-93506270',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:40:06Z,user_data=None,user_id='618ce2d56c3c4ee8ace871d308ca45fb',uuid=cf326e80-7293-4764-9411-ed05a5aeba23,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fbd63de1-966b-4791-8c72-6a5e2d26a7e2", "address": "fa:16:3e:09:75:c0", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd63de1-96", "ovs_interfaceid": "fbd63de1-966b-4791-8c72-6a5e2d26a7e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:57:48 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-7b3caca1-6eaa-413c-ada7-37e8dbb99dd2 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Converting VIF {"id": "fbd63de1-966b-4791-8c72-6a5e2d26a7e2", "address": "fa:16:3e:09:75:c0", "network": {"id": "03362fcb-afd6-4b0a-af44-a54a848c59f9", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-381802514-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "c01165e83a3143ad83f050790f2b63fe", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfbd63de1-96", "ovs_interfaceid": "fbd63de1-966b-4791-8c72-6a5e2d26a7e2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:57:48 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-7b3caca1-6eaa-413c-ada7-37e8dbb99dd2 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:09:75:c0,bridge_name='br-int',has_traffic_filtering=True,id=fbd63de1-966b-4791-8c72-6a5e2d26a7e2,network=Network(03362fcb-afd6-4b0a-af44-a54a848c59f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbd63de1-96') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:57:48 user nova-compute[231753]: DEBUG os_vif [None req-7b3caca1-6eaa-413c-ada7-37e8dbb99dd2 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:75:c0,bridge_name='br-int',has_traffic_filtering=True,id=fbd63de1-966b-4791-8c72-6a5e2d26a7e2,network=Network(03362fcb-afd6-4b0a-af44-a54a848c59f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbd63de1-96') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:57:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfbd63de1-96, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:57:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:57:48 user nova-compute[231753]: INFO os_vif [None req-7b3caca1-6eaa-413c-ada7-37e8dbb99dd2 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:09:75:c0,bridge_name='br-int',has_traffic_filtering=True,id=fbd63de1-966b-4791-8c72-6a5e2d26a7e2,network=Network(03362fcb-afd6-4b0a-af44-a54a848c59f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfbd63de1-96')
Jul 29 13:57:48 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-7b3caca1-6eaa-413c-ada7-37e8dbb99dd2 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Deleting instance files /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23_del
Jul 29 13:57:48 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-7b3caca1-6eaa-413c-ada7-37e8dbb99dd2 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Deletion of /opt/stack/data/nova/instances/cf326e80-7293-4764-9411-ed05a5aeba23_del complete
Jul 29 13:57:48 user nova-compute[231753]: INFO nova.compute.manager [None req-7b3caca1-6eaa-413c-ada7-37e8dbb99dd2 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Took 0.94 seconds to destroy the instance on the hypervisor.
Jul 29 13:57:48 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-7b3caca1-6eaa-413c-ada7-37e8dbb99dd2 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:57:48 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:57:48 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:57:48 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:57:48 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Took 0.54 seconds to deallocate network for instance.
Jul 29 13:57:49 user nova-compute[231753]: DEBUG nova.compute.manager [req-6289228e-9425-4598-a878-250753d6dbf0 req-5b230b8e-6ae6-4500-8332-a5b3b14cd035 service nova] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Received event network-vif-deleted-fbd63de1-966b-4791-8c72-6a5e2d26a7e2 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:57:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7b3caca1-6eaa-413c-ada7-37e8dbb99dd2 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:57:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7b3caca1-6eaa-413c-ada7-37e8dbb99dd2 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:57:49 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-7b3caca1-6eaa-413c-ada7-37e8dbb99dd2 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:57:49 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-7b3caca1-6eaa-413c-ada7-37e8dbb99dd2 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:57:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7b3caca1-6eaa-413c-ada7-37e8dbb99dd2 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.273s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:57:49 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-7b3caca1-6eaa-413c-ada7-37e8dbb99dd2 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Deleted allocations for instance cf326e80-7293-4764-9411-ed05a5aeba23
Jul 29 13:57:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-7b3caca1-6eaa-413c-ada7-37e8dbb99dd2 tempest-ServerBootFromVolumeStableRescueTest-93506270 tempest-ServerBootFromVolumeStableRescueTest-93506270-project-member] Lock "cf326e80-7293-4764-9411-ed05a5aeba23" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.958s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:57:49 user nova-compute[231753]: DEBUG nova.compute.manager [req-252c8b44-4370-4c11-b028-b9f1a2f8bc75 req-9887c840-02fd-458a-a551-5314be3e8106 service nova] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Received event network-vif-plugged-fbd63de1-966b-4791-8c72-6a5e2d26a7e2 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:57:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-252c8b44-4370-4c11-b028-b9f1a2f8bc75 req-9887c840-02fd-458a-a551-5314be3e8106 service nova] Acquiring lock "cf326e80-7293-4764-9411-ed05a5aeba23-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:57:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-252c8b44-4370-4c11-b028-b9f1a2f8bc75 req-9887c840-02fd-458a-a551-5314be3e8106 service nova] Lock "cf326e80-7293-4764-9411-ed05a5aeba23-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:57:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-252c8b44-4370-4c11-b028-b9f1a2f8bc75 req-9887c840-02fd-458a-a551-5314be3e8106 service nova] Lock "cf326e80-7293-4764-9411-ed05a5aeba23-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:57:49 user nova-compute[231753]: DEBUG nova.compute.manager [req-252c8b44-4370-4c11-b028-b9f1a2f8bc75 req-9887c840-02fd-458a-a551-5314be3e8106 service nova] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] No waiting events found dispatching network-vif-plugged-fbd63de1-966b-4791-8c72-6a5e2d26a7e2 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:57:49 user nova-compute[231753]: WARNING nova.compute.manager [req-252c8b44-4370-4c11-b028-b9f1a2f8bc75 req-9887c840-02fd-458a-a551-5314be3e8106 service nova] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Received unexpected event network-vif-plugged-fbd63de1-966b-4791-8c72-6a5e2d26a7e2 for instance with vm_state deleted and task_state None.
Jul 29 13:57:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:57:57 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690639062.762071, 1c4a953b-67c9-4c69-950a-7487735e917c => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:57:57 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] VM Stopped (Lifecycle Event)
Jul 29 13:57:57 user nova-compute[231753]: DEBUG nova.compute.manager [None req-93fa2322-6b60-46d1-ab18-e50c2741802e None None] [instance: 1c4a953b-67c9-4c69-950a-7487735e917c] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:57:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:57:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:03 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690639068.244989, cf326e80-7293-4764-9411-ed05a5aeba23 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:58:03 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] VM Stopped (Lifecycle Event)
Jul 29 13:58:03 user nova-compute[231753]: DEBUG nova.compute.manager [None req-2ab949e7-c920-4611-9073-88a152eb2531 None None] [instance: cf326e80-7293-4764-9411-ed05a5aeba23] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:58:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:08 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:13 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:20 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:58:21 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:58:21 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 13:58:21 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Rebuilding the list of instances to heal {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 13:58:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "refresh_cache-73f72f78-9abf-4b04-a973-06affde57310" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:58:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquired lock "refresh_cache-73f72f78-9abf-4b04-a973-06affde57310" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:58:21 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Forcefully refreshing network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 13:58:21 user nova-compute[231753]: DEBUG nova.objects.instance [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lazy-loading 'info_cache' on Instance uuid 73f72f78-9abf-4b04-a973-06affde57310 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:58:22 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Updating instance_info_cache with network_info: [{"id": "3ca923a6-55a2-4578-ad2e-c3e9248b6af2", "address": "fa:16:3e:39:97:1d", "network": {"id": "c5a2a904-b9ec-4da4-8206-f08aef3a48cc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2009211013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd079349ba1549b2bc93552ecb88c3e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca923a6-55", "ovs_interfaceid": "3ca923a6-55a2-4578-ad2e-c3e9248b6af2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:58:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Releasing lock "refresh_cache-73f72f78-9abf-4b04-a973-06affde57310" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:58:22 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Updated the network info_cache for instance {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 13:58:23 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:58:23 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:58:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:58:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:58:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:58:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:58:23 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 13:58:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-32f1b34f-8ebb-4773-ad46-0e6f1b06d843 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Acquiring lock "73f72f78-9abf-4b04-a973-06affde57310" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:58:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-32f1b34f-8ebb-4773-ad46-0e6f1b06d843 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Lock "73f72f78-9abf-4b04-a973-06affde57310" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:58:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-32f1b34f-8ebb-4773-ad46-0e6f1b06d843 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Acquiring lock "73f72f78-9abf-4b04-a973-06affde57310-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:58:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-32f1b34f-8ebb-4773-ad46-0e6f1b06d843 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Lock "73f72f78-9abf-4b04-a973-06affde57310-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:58:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-32f1b34f-8ebb-4773-ad46-0e6f1b06d843 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Lock "73f72f78-9abf-4b04-a973-06affde57310-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:58:23 user nova-compute[231753]: INFO nova.compute.manager [None req-32f1b34f-8ebb-4773-ad46-0e6f1b06d843 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Terminating instance
Jul 29 13:58:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-32f1b34f-8ebb-4773-ad46-0e6f1b06d843 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:58:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f72f78-9abf-4b04-a973-06affde57310/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:58:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f72f78-9abf-4b04-a973-06affde57310/disk --force-share --output=json" returned: 0 in 0.170s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:58:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f72f78-9abf-4b04-a973-06affde57310/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:58:23 user nova-compute[231753]: DEBUG nova.compute.manager [req-921d9461-7b76-4dd7-9180-1766e373e396 req-c72fef6e-0ffd-44cc-8711-179e3ad10ad5 service nova] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Received event network-vif-unplugged-3ca923a6-55a2-4578-ad2e-c3e9248b6af2 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:58:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-921d9461-7b76-4dd7-9180-1766e373e396 req-c72fef6e-0ffd-44cc-8711-179e3ad10ad5 service nova] Acquiring lock "73f72f78-9abf-4b04-a973-06affde57310-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:58:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-921d9461-7b76-4dd7-9180-1766e373e396 req-c72fef6e-0ffd-44cc-8711-179e3ad10ad5 service nova] Lock "73f72f78-9abf-4b04-a973-06affde57310-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:58:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-921d9461-7b76-4dd7-9180-1766e373e396 req-c72fef6e-0ffd-44cc-8711-179e3ad10ad5 service nova] Lock "73f72f78-9abf-4b04-a973-06affde57310-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:58:23 user nova-compute[231753]: DEBUG nova.compute.manager [req-921d9461-7b76-4dd7-9180-1766e373e396 req-c72fef6e-0ffd-44cc-8711-179e3ad10ad5 service nova] [instance: 73f72f78-9abf-4b04-a973-06affde57310] No waiting events found dispatching network-vif-unplugged-3ca923a6-55a2-4578-ad2e-c3e9248b6af2 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:58:23 user nova-compute[231753]: DEBUG nova.compute.manager [req-921d9461-7b76-4dd7-9180-1766e373e396 req-c72fef6e-0ffd-44cc-8711-179e3ad10ad5 service nova] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Received event network-vif-unplugged-3ca923a6-55a2-4578-ad2e-c3e9248b6af2 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:58:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/73f72f78-9abf-4b04-a973-06affde57310/disk --force-share --output=json" returned: 0 in 0.164s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:58:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:58:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk --force-share --output=json" returned: 0 in 0.147s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:58:23 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:58:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:58:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3132d31d-7901-4001-bc19-7836f2ecfc70/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:58:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:24 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Instance destroyed successfully.
Jul 29 13:58:24 user nova-compute[231753]: DEBUG nova.objects.instance [None req-32f1b34f-8ebb-4773-ad46-0e6f1b06d843 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Lazy-loading 'resources' on Instance uuid 73f72f78-9abf-4b04-a973-06affde57310 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:58:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-32f1b34f-8ebb-4773-ad46-0e6f1b06d843 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:55:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestServerVolumeAttachScenarioOldVersion-server-211081681',display_name='tempest-TestServerVolumeAttachScenarioOldVersion-server-211081681',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testservervolumeattachscenariooldversion-server-2110816',id=42,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLpQ8krxtkD+fR+o9MOcYNrF0cSzdV94Gcik9jCCb70O7+brM3cqPYYdLQ9Baj5NakBTR50y1wMCIGdtZhbDp4bWi9EW1a1HI8w/C/88yIIaFMZ9w7nl6iaMM+9Gh1hxGA==',key_name='tempest-keypair-1162159474',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:55:27Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='bd079349ba1549b2bc93552ecb88c3e1',ramdisk_id='',reservation_id='r-g2jhd0p1',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestServerVolumeAttachScenarioOldVersion-1448691484',owner_user_name='tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:55:28Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='1bb6c1ec3ad24904bc7004e7c431544a',uuid=73f72f78-9abf-4b04-a973-06affde57310,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3ca923a6-55a2-4578-ad2e-c3e9248b6af2", "address": "fa:16:3e:39:97:1d", "network": {"id": "c5a2a904-b9ec-4da4-8206-f08aef3a48cc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2009211013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd079349ba1549b2bc93552ecb88c3e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca923a6-55", "ovs_interfaceid": "3ca923a6-55a2-4578-ad2e-c3e9248b6af2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:58:24 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-32f1b34f-8ebb-4773-ad46-0e6f1b06d843 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Converting VIF {"id": "3ca923a6-55a2-4578-ad2e-c3e9248b6af2", "address": "fa:16:3e:39:97:1d", "network": {"id": "c5a2a904-b9ec-4da4-8206-f08aef3a48cc", "bridge": "br-int", "label": "tempest-TestServerVolumeAttachScenarioOldVersion-2009211013-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "bd079349ba1549b2bc93552ecb88c3e1", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3ca923a6-55", "ovs_interfaceid": "3ca923a6-55a2-4578-ad2e-c3e9248b6af2", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:58:24 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-32f1b34f-8ebb-4773-ad46-0e6f1b06d843 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:39:97:1d,bridge_name='br-int',has_traffic_filtering=True,id=3ca923a6-55a2-4578-ad2e-c3e9248b6af2,network=Network(c5a2a904-b9ec-4da4-8206-f08aef3a48cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ca923a6-55') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:58:24 user nova-compute[231753]: DEBUG os_vif [None req-32f1b34f-8ebb-4773-ad46-0e6f1b06d843 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:97:1d,bridge_name='br-int',has_traffic_filtering=True,id=3ca923a6-55a2-4578-ad2e-c3e9248b6af2,network=Network(c5a2a904-b9ec-4da4-8206-f08aef3a48cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ca923a6-55') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:58:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3ca923a6-55, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:58:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:58:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3132d31d-7901-4001-bc19-7836f2ecfc70/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:58:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3132d31d-7901-4001-bc19-7836f2ecfc70/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:58:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:24 user nova-compute[231753]: INFO os_vif [None req-32f1b34f-8ebb-4773-ad46-0e6f1b06d843 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:39:97:1d,bridge_name='br-int',has_traffic_filtering=True,id=3ca923a6-55a2-4578-ad2e-c3e9248b6af2,network=Network(c5a2a904-b9ec-4da4-8206-f08aef3a48cc),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3ca923a6-55')
Jul 29 13:58:24 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-32f1b34f-8ebb-4773-ad46-0e6f1b06d843 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Deleting instance files /opt/stack/data/nova/instances/73f72f78-9abf-4b04-a973-06affde57310_del
Jul 29 13:58:24 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-32f1b34f-8ebb-4773-ad46-0e6f1b06d843 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Deletion of /opt/stack/data/nova/instances/73f72f78-9abf-4b04-a973-06affde57310_del complete
Jul 29 13:58:24 user nova-compute[231753]: INFO nova.compute.manager [None req-32f1b34f-8ebb-4773-ad46-0e6f1b06d843 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Took 0.96 seconds to destroy the instance on the hypervisor.
Jul 29 13:58:24 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-32f1b34f-8ebb-4773-ad46-0e6f1b06d843 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:58:24 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:58:24 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 73f72f78-9abf-4b04-a973-06affde57310] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:58:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3132d31d-7901-4001-bc19-7836f2ecfc70/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:58:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:58:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:24 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:58:24 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:58:24 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=8082MB free_disk=25.130077362060547GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 13:58:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:58:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:58:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:25 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 73f72f78-9abf-4b04-a973-06affde57310 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:58:25 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance a3f9ad53-db31-404a-8442-37cf53f11cbc actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:58:25 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 3132d31d-7901-4001-bc19-7836f2ecfc70 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:58:25 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:58:25 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 13:58:25 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 13:58:25 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:58:25 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:58:25 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 13:58:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.329s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:58:25 user nova-compute[231753]: DEBUG nova.compute.manager [req-b292fb07-d9a5-49b0-88b4-73a67ee00020 req-41c21914-e5b3-4b79-9e54-17f1d0a545de service nova] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Received event network-vif-plugged-3ca923a6-55a2-4578-ad2e-c3e9248b6af2 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:58:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b292fb07-d9a5-49b0-88b4-73a67ee00020 req-41c21914-e5b3-4b79-9e54-17f1d0a545de service nova] Acquiring lock "73f72f78-9abf-4b04-a973-06affde57310-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:58:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b292fb07-d9a5-49b0-88b4-73a67ee00020 req-41c21914-e5b3-4b79-9e54-17f1d0a545de service nova] Lock "73f72f78-9abf-4b04-a973-06affde57310-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:58:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b292fb07-d9a5-49b0-88b4-73a67ee00020 req-41c21914-e5b3-4b79-9e54-17f1d0a545de service nova] Lock "73f72f78-9abf-4b04-a973-06affde57310-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:58:25 user nova-compute[231753]: DEBUG nova.compute.manager [req-b292fb07-d9a5-49b0-88b4-73a67ee00020 req-41c21914-e5b3-4b79-9e54-17f1d0a545de service nova] [instance: 73f72f78-9abf-4b04-a973-06affde57310] No waiting events found dispatching network-vif-plugged-3ca923a6-55a2-4578-ad2e-c3e9248b6af2 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:58:25 user nova-compute[231753]: WARNING nova.compute.manager [req-b292fb07-d9a5-49b0-88b4-73a67ee00020 req-41c21914-e5b3-4b79-9e54-17f1d0a545de service nova] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Received unexpected event network-vif-plugged-3ca923a6-55a2-4578-ad2e-c3e9248b6af2 for instance with vm_state active and task_state deleting.
Jul 29 13:58:25 user nova-compute[231753]: DEBUG nova.compute.manager [req-b292fb07-d9a5-49b0-88b4-73a67ee00020 req-41c21914-e5b3-4b79-9e54-17f1d0a545de service nova] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Received event network-vif-plugged-3ca923a6-55a2-4578-ad2e-c3e9248b6af2 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:58:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b292fb07-d9a5-49b0-88b4-73a67ee00020 req-41c21914-e5b3-4b79-9e54-17f1d0a545de service nova] Acquiring lock "73f72f78-9abf-4b04-a973-06affde57310-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:58:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b292fb07-d9a5-49b0-88b4-73a67ee00020 req-41c21914-e5b3-4b79-9e54-17f1d0a545de service nova] Lock "73f72f78-9abf-4b04-a973-06affde57310-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:58:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b292fb07-d9a5-49b0-88b4-73a67ee00020 req-41c21914-e5b3-4b79-9e54-17f1d0a545de service nova] Lock "73f72f78-9abf-4b04-a973-06affde57310-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:58:25 user nova-compute[231753]: DEBUG nova.compute.manager [req-b292fb07-d9a5-49b0-88b4-73a67ee00020 req-41c21914-e5b3-4b79-9e54-17f1d0a545de service nova] [instance: 73f72f78-9abf-4b04-a973-06affde57310] No waiting events found dispatching network-vif-plugged-3ca923a6-55a2-4578-ad2e-c3e9248b6af2 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:58:25 user nova-compute[231753]: WARNING nova.compute.manager [req-b292fb07-d9a5-49b0-88b4-73a67ee00020 req-41c21914-e5b3-4b79-9e54-17f1d0a545de service nova] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Received unexpected event network-vif-plugged-3ca923a6-55a2-4578-ad2e-c3e9248b6af2 for instance with vm_state active and task_state deleting.
Jul 29 13:58:25 user nova-compute[231753]: DEBUG nova.compute.manager [req-b292fb07-d9a5-49b0-88b4-73a67ee00020 req-41c21914-e5b3-4b79-9e54-17f1d0a545de service nova] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Received event network-vif-plugged-3ca923a6-55a2-4578-ad2e-c3e9248b6af2 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:58:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b292fb07-d9a5-49b0-88b4-73a67ee00020 req-41c21914-e5b3-4b79-9e54-17f1d0a545de service nova] Acquiring lock "73f72f78-9abf-4b04-a973-06affde57310-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:58:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b292fb07-d9a5-49b0-88b4-73a67ee00020 req-41c21914-e5b3-4b79-9e54-17f1d0a545de service nova] Lock "73f72f78-9abf-4b04-a973-06affde57310-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:58:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b292fb07-d9a5-49b0-88b4-73a67ee00020 req-41c21914-e5b3-4b79-9e54-17f1d0a545de service nova] Lock "73f72f78-9abf-4b04-a973-06affde57310-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:58:25 user nova-compute[231753]: DEBUG nova.compute.manager [req-b292fb07-d9a5-49b0-88b4-73a67ee00020 req-41c21914-e5b3-4b79-9e54-17f1d0a545de service nova] [instance: 73f72f78-9abf-4b04-a973-06affde57310] No waiting events found dispatching network-vif-plugged-3ca923a6-55a2-4578-ad2e-c3e9248b6af2 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:58:25 user nova-compute[231753]: WARNING nova.compute.manager [req-b292fb07-d9a5-49b0-88b4-73a67ee00020 req-41c21914-e5b3-4b79-9e54-17f1d0a545de service nova] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Received unexpected event network-vif-plugged-3ca923a6-55a2-4578-ad2e-c3e9248b6af2 for instance with vm_state active and task_state deleting.
Jul 29 13:58:25 user nova-compute[231753]: DEBUG nova.compute.manager [req-b292fb07-d9a5-49b0-88b4-73a67ee00020 req-41c21914-e5b3-4b79-9e54-17f1d0a545de service nova] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Received event network-vif-unplugged-3ca923a6-55a2-4578-ad2e-c3e9248b6af2 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:58:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b292fb07-d9a5-49b0-88b4-73a67ee00020 req-41c21914-e5b3-4b79-9e54-17f1d0a545de service nova] Acquiring lock "73f72f78-9abf-4b04-a973-06affde57310-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:58:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b292fb07-d9a5-49b0-88b4-73a67ee00020 req-41c21914-e5b3-4b79-9e54-17f1d0a545de service nova] Lock "73f72f78-9abf-4b04-a973-06affde57310-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:58:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b292fb07-d9a5-49b0-88b4-73a67ee00020 req-41c21914-e5b3-4b79-9e54-17f1d0a545de service nova] Lock "73f72f78-9abf-4b04-a973-06affde57310-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:58:25 user nova-compute[231753]: DEBUG nova.compute.manager [req-b292fb07-d9a5-49b0-88b4-73a67ee00020 req-41c21914-e5b3-4b79-9e54-17f1d0a545de service nova] [instance: 73f72f78-9abf-4b04-a973-06affde57310] No waiting events found dispatching network-vif-unplugged-3ca923a6-55a2-4578-ad2e-c3e9248b6af2 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:58:25 user nova-compute[231753]: DEBUG nova.compute.manager [req-b292fb07-d9a5-49b0-88b4-73a67ee00020 req-41c21914-e5b3-4b79-9e54-17f1d0a545de service nova] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Received event network-vif-unplugged-3ca923a6-55a2-4578-ad2e-c3e9248b6af2 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:58:26 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:58:26 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Took 2.09 seconds to deallocate network for instance.
Jul 29 13:58:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-32f1b34f-8ebb-4773-ad46-0e6f1b06d843 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:58:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-32f1b34f-8ebb-4773-ad46-0e6f1b06d843 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:58:26 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-32f1b34f-8ebb-4773-ad46-0e6f1b06d843 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:58:26 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-32f1b34f-8ebb-4773-ad46-0e6f1b06d843 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:58:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-32f1b34f-8ebb-4773-ad46-0e6f1b06d843 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.200s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:58:26 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-32f1b34f-8ebb-4773-ad46-0e6f1b06d843 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Deleted allocations for instance 73f72f78-9abf-4b04-a973-06affde57310
Jul 29 13:58:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-32f1b34f-8ebb-4773-ad46-0e6f1b06d843 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484 tempest-TestServerVolumeAttachScenarioOldVersion-1448691484-project-member] Lock "73f72f78-9abf-4b04-a973-06affde57310" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.449s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:58:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-e449ae2a-ab88-4cff-acbf-bb55c7cf5393 req-61f5842d-67d2-4721-878e-5fa7c81888c9 service nova] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Received event network-vif-plugged-3ca923a6-55a2-4578-ad2e-c3e9248b6af2 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:58:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e449ae2a-ab88-4cff-acbf-bb55c7cf5393 req-61f5842d-67d2-4721-878e-5fa7c81888c9 service nova] Acquiring lock "73f72f78-9abf-4b04-a973-06affde57310-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:58:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e449ae2a-ab88-4cff-acbf-bb55c7cf5393 req-61f5842d-67d2-4721-878e-5fa7c81888c9 service nova] Lock "73f72f78-9abf-4b04-a973-06affde57310-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:58:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e449ae2a-ab88-4cff-acbf-bb55c7cf5393 req-61f5842d-67d2-4721-878e-5fa7c81888c9 service nova] Lock "73f72f78-9abf-4b04-a973-06affde57310-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:58:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-e449ae2a-ab88-4cff-acbf-bb55c7cf5393 req-61f5842d-67d2-4721-878e-5fa7c81888c9 service nova] [instance: 73f72f78-9abf-4b04-a973-06affde57310] No waiting events found dispatching network-vif-plugged-3ca923a6-55a2-4578-ad2e-c3e9248b6af2 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:58:27 user nova-compute[231753]: WARNING nova.compute.manager [req-e449ae2a-ab88-4cff-acbf-bb55c7cf5393 req-61f5842d-67d2-4721-878e-5fa7c81888c9 service nova] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Received unexpected event network-vif-plugged-3ca923a6-55a2-4578-ad2e-c3e9248b6af2 for instance with vm_state deleted and task_state None.
Jul 29 13:58:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-e449ae2a-ab88-4cff-acbf-bb55c7cf5393 req-61f5842d-67d2-4721-878e-5fa7c81888c9 service nova] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Received event network-vif-deleted-3ca923a6-55a2-4578-ad2e-c3e9248b6af2 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:58:28 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:58:28 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:58:28 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:58:28 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 13:58:28 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:58:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:29 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:58:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:31 user nova-compute[231753]: DEBUG nova.compute.manager [req-6e101cd1-c6c5-45ff-88ca-192a5e4d7ff8 req-da74d769-fd5f-4936-8002-35a48280743d service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Received event network-changed-b6be4498-da79-4335-9f95-6a191a4ce127 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:58:31 user nova-compute[231753]: DEBUG nova.compute.manager [req-6e101cd1-c6c5-45ff-88ca-192a5e4d7ff8 req-da74d769-fd5f-4936-8002-35a48280743d service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Refreshing instance network info cache due to event network-changed-b6be4498-da79-4335-9f95-6a191a4ce127. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:58:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6e101cd1-c6c5-45ff-88ca-192a5e4d7ff8 req-da74d769-fd5f-4936-8002-35a48280743d service nova] Acquiring lock "refresh_cache-a3f9ad53-db31-404a-8442-37cf53f11cbc" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:58:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6e101cd1-c6c5-45ff-88ca-192a5e4d7ff8 req-da74d769-fd5f-4936-8002-35a48280743d service nova] Acquired lock "refresh_cache-a3f9ad53-db31-404a-8442-37cf53f11cbc" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:58:31 user nova-compute[231753]: DEBUG nova.network.neutron [req-6e101cd1-c6c5-45ff-88ca-192a5e4d7ff8 req-da74d769-fd5f-4936-8002-35a48280743d service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Refreshing network info cache for port b6be4498-da79-4335-9f95-6a191a4ce127 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:58:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Acquiring lock "a3f9ad53-db31-404a-8442-37cf53f11cbc" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:58:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lock "a3f9ad53-db31-404a-8442-37cf53f11cbc" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:58:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Acquiring lock "a3f9ad53-db31-404a-8442-37cf53f11cbc-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:58:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lock "a3f9ad53-db31-404a-8442-37cf53f11cbc-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:58:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lock "a3f9ad53-db31-404a-8442-37cf53f11cbc-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:58:31 user nova-compute[231753]: INFO nova.compute.manager [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Terminating instance
Jul 29 13:58:31 user nova-compute[231753]: DEBUG nova.compute.manager [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:58:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:31 user nova-compute[231753]: DEBUG nova.compute.manager [req-be0cd893-394c-4286-b565-4a2958be4502 req-828caddf-5882-4a5c-99de-67857fa678a2 service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Received event network-vif-unplugged-b6be4498-da79-4335-9f95-6a191a4ce127 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:58:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-be0cd893-394c-4286-b565-4a2958be4502 req-828caddf-5882-4a5c-99de-67857fa678a2 service nova] Acquiring lock "a3f9ad53-db31-404a-8442-37cf53f11cbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:58:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-be0cd893-394c-4286-b565-4a2958be4502 req-828caddf-5882-4a5c-99de-67857fa678a2 service nova] Lock "a3f9ad53-db31-404a-8442-37cf53f11cbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:58:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-be0cd893-394c-4286-b565-4a2958be4502 req-828caddf-5882-4a5c-99de-67857fa678a2 service nova] Lock "a3f9ad53-db31-404a-8442-37cf53f11cbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:58:31 user nova-compute[231753]: DEBUG nova.compute.manager [req-be0cd893-394c-4286-b565-4a2958be4502 req-828caddf-5882-4a5c-99de-67857fa678a2 service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] No waiting events found dispatching network-vif-unplugged-b6be4498-da79-4335-9f95-6a191a4ce127 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:58:31 user nova-compute[231753]: DEBUG nova.compute.manager [req-be0cd893-394c-4286-b565-4a2958be4502 req-828caddf-5882-4a5c-99de-67857fa678a2 service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Received event network-vif-unplugged-b6be4498-da79-4335-9f95-6a191a4ce127 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:58:31 user nova-compute[231753]: DEBUG nova.network.neutron [req-6e101cd1-c6c5-45ff-88ca-192a5e4d7ff8 req-da74d769-fd5f-4936-8002-35a48280743d service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Updated VIF entry in instance network info cache for port b6be4498-da79-4335-9f95-6a191a4ce127. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:58:31 user nova-compute[231753]: DEBUG nova.network.neutron [req-6e101cd1-c6c5-45ff-88ca-192a5e4d7ff8 req-da74d769-fd5f-4936-8002-35a48280743d service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Updating instance_info_cache with network_info: [{"id": "b6be4498-da79-4335-9f95-6a191a4ce127", "address": "fa:16:3e:c2:b5:20", "network": {"id": "e36e72a2-fbed-483c-827c-436fa6786390", "bridge": "br-int", "label": "tempest-TestShelveInstance-2100930356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b552c0991c456eb101472ca6777f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6be4498-da", "ovs_interfaceid": "b6be4498-da79-4335-9f95-6a191a4ce127", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:58:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6e101cd1-c6c5-45ff-88ca-192a5e4d7ff8 req-da74d769-fd5f-4936-8002-35a48280743d service nova] Releasing lock "refresh_cache-a3f9ad53-db31-404a-8442-37cf53f11cbc" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:58:32 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Instance destroyed successfully.
Jul 29 13:58:32 user nova-compute[231753]: DEBUG nova.objects.instance [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lazy-loading 'resources' on Instance uuid a3f9ad53-db31-404a-8442-37cf53f11cbc {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='',created_at=2023-07-29T13:52:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestShelveInstance-server-2135603216',display_name='tempest-TestShelveInstance-server-2135603216',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testshelveinstance-server-2135603216',id=40,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNUKilSQcjDTu+cgwtmk8BQ6EjoQq0ApEPABTW7D4u0KoVMoLIZVjeebdmok5ki73AVOSz5g4howD++ogO973qWj4XNZQyc+wqIw+w41ZPmWJLZZo3ziBpQVpEeJBldBeA==',key_name='tempest-TestShelveInstance-537474645',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:56:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='06b552c0991c456eb101472ca6777f19',ramdisk_id='',reservation_id='r-g6l31lk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',clean_attempts='1',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestShelveInstance-108803446',owner_user_name='tempest-TestShelveInstance-108803446-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:56:55Z,user_data=None,user_id='3d35af1d300041a2b0fd8039d1a4b623',uuid=a3f9ad53-db31-404a-8442-37cf53f11cbc,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6be4498-da79-4335-9f95-6a191a4ce127", "address": "fa:16:3e:c2:b5:20", "network": {"id": "e36e72a2-fbed-483c-827c-436fa6786390", "bridge": "br-int", "label": "tempest-TestShelveInstance-2100930356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b552c0991c456eb101472ca6777f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6be4498-da", "ovs_interfaceid": "b6be4498-da79-4335-9f95-6a191a4ce127", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Converting VIF {"id": "b6be4498-da79-4335-9f95-6a191a4ce127", "address": "fa:16:3e:c2:b5:20", "network": {"id": "e36e72a2-fbed-483c-827c-436fa6786390", "bridge": "br-int", "label": "tempest-TestShelveInstance-2100930356-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.53", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "06b552c0991c456eb101472ca6777f19", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6be4498-da", "ovs_interfaceid": "b6be4498-da79-4335-9f95-6a191a4ce127", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c2:b5:20,bridge_name='br-int',has_traffic_filtering=True,id=b6be4498-da79-4335-9f95-6a191a4ce127,network=Network(e36e72a2-fbed-483c-827c-436fa6786390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6be4498-da') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG os_vif [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:b5:20,bridge_name='br-int',has_traffic_filtering=True,id=b6be4498-da79-4335-9f95-6a191a4ce127,network=Network(e36e72a2-fbed-483c-827c-436fa6786390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6be4498-da') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6be4498-da, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:58:32 user nova-compute[231753]: INFO os_vif [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c2:b5:20,bridge_name='br-int',has_traffic_filtering=True,id=b6be4498-da79-4335-9f95-6a191a4ce127,network=Network(e36e72a2-fbed-483c-827c-436fa6786390),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6be4498-da')
Jul 29 13:58:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'BZYvkJSh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:58:32 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:58:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[86bc21dc-11af-4e29-841c-5d918cd56aea]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:58:32 user nova-compute[231753]: No targets found.
Jul 29 13:58:32 user nova-compute[231753]: iSNS:
Jul 29 13:58:32 user nova-compute[231753]: No targets found.
Jul 29 13:58:32 user nova-compute[231753]: STATIC:
Jul 29 13:58:32 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf
Jul 29 13:58:32 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:58:32 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:58:32 user nova-compute[231753]: FIRMWARE:
Jul 29 13:58:32 user nova-compute[231753]: No targets found.
Jul 29 13:58:32 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:58:32 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:58:32 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4341b6-c2de-4cff-8b8b-02fee8898164]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[dea1a237-b82c-49ae-b9ff-de4546f69f58]: (4, ('tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)
Jul 29 13:58:32 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] iscsi session list stdout=tcp: [49] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf (non-flash)
Jul 29 13:58:32 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7ca01f7e20>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf'): ({'sdb'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Removing single pathed devices sdb {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[1375f589-e0d2-4a10-87e4-f061a089fbbc]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5291ae-273d-49bf-8594-911598498bc6]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Flushing IO for device /dev/sdb {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2672386c-263d-4ec9-8a9a-023522a8cbaf]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8acd57d7-1c77-4f21-a076-cb41832d5bb0]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] SCSI volumes sdb have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOc2f60817-bca8295762f6b1e6', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_c2f60817', '/dev/disk/by-id/scsi-26263613832393537') {{(pid=242780) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f5d301d-ffbb-4f3e-aa7d-d220612574e2]: (4, None) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5757f36-a7e8-4e3c-809f-d2ac2be9ecf4]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --logout" returned: 0 in 0.053s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fff8fe5-8492-4245-91ba-c87c5681bd1f]: (4, ('Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf, portal: 172.16.0.220,3260]\nLogout of [sid: 49, target: iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 49, target: iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf, portal: 172.16.0.220,3260]
Jul 29 13:58:32 user nova-compute[231753]: Logout of [sid: 49, target: iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf, portal: 172.16.0.220,3260] successful.
Jul 29 13:58:32 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:3be506b8-85e1-474c-8c6b-6f8ef82b95bf -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[956094db-42c5-4787-b8cb-05bbacbf5eaa]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.309s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] <== disconnect_volume: return (310ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:58:32 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Deleting instance files /opt/stack/data/nova/instances/a3f9ad53-db31-404a-8442-37cf53f11cbc_del
Jul 29 13:58:32 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Deletion of /opt/stack/data/nova/instances/a3f9ad53-db31-404a-8442-37cf53f11cbc_del complete
Jul 29 13:58:32 user nova-compute[231753]: INFO nova.compute.manager [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Took 1.17 seconds to destroy the instance on the hypervisor.
Jul 29 13:58:32 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:58:32 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:58:33 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:58:33 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Took 0.68 seconds to deallocate network for instance.
Jul 29 13:58:33 user nova-compute[231753]: DEBUG nova.compute.manager [req-48e91c5b-2212-42eb-9967-d43bf76a9a89 req-29c7a8ca-0e08-4791-8f33-bcdaea3f3f8a service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Received event network-vif-plugged-b6be4498-da79-4335-9f95-6a191a4ce127 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:58:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-48e91c5b-2212-42eb-9967-d43bf76a9a89 req-29c7a8ca-0e08-4791-8f33-bcdaea3f3f8a service nova] Acquiring lock "a3f9ad53-db31-404a-8442-37cf53f11cbc-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:58:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-48e91c5b-2212-42eb-9967-d43bf76a9a89 req-29c7a8ca-0e08-4791-8f33-bcdaea3f3f8a service nova] Lock "a3f9ad53-db31-404a-8442-37cf53f11cbc-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:58:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-48e91c5b-2212-42eb-9967-d43bf76a9a89 req-29c7a8ca-0e08-4791-8f33-bcdaea3f3f8a service nova] Lock "a3f9ad53-db31-404a-8442-37cf53f11cbc-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:58:33 user nova-compute[231753]: DEBUG nova.compute.manager [req-48e91c5b-2212-42eb-9967-d43bf76a9a89 req-29c7a8ca-0e08-4791-8f33-bcdaea3f3f8a service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] No waiting events found dispatching network-vif-plugged-b6be4498-da79-4335-9f95-6a191a4ce127 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:58:33 user nova-compute[231753]: WARNING nova.compute.manager [req-48e91c5b-2212-42eb-9967-d43bf76a9a89 req-29c7a8ca-0e08-4791-8f33-bcdaea3f3f8a service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Received unexpected event network-vif-plugged-b6be4498-da79-4335-9f95-6a191a4ce127 for instance with vm_state active and task_state deleting.
Jul 29 13:58:33 user nova-compute[231753]: DEBUG nova.compute.manager [req-48e91c5b-2212-42eb-9967-d43bf76a9a89 req-29c7a8ca-0e08-4791-8f33-bcdaea3f3f8a service nova] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Received event network-vif-deleted-b6be4498-da79-4335-9f95-6a191a4ce127 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:58:34 user nova-compute[231753]: INFO nova.compute.manager [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Took 0.77 seconds to detach 1 volumes for instance.
Jul 29 13:58:34 user nova-compute[231753]: DEBUG nova.compute.manager [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Deleting volume: 3be506b8-85e1-474c-8c6b-6f8ef82b95bf {{(pid=231753) _cleanup_volumes /opt/stack/nova/nova/compute/manager.py:3221}}
Jul 29 13:58:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:58:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:58:34 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:58:34 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:58:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.163s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:58:34 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Deleted allocations for instance a3f9ad53-db31-404a-8442-37cf53f11cbc
Jul 29 13:58:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-8216060b-e7b0-43d4-b99b-bfc694413c97 tempest-TestShelveInstance-108803446 tempest-TestShelveInstance-108803446-project-member] Lock "a3f9ad53-db31-404a-8442-37cf53f11cbc" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.022s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:58:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:39 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690639104.2061257, 73f72f78-9abf-4b04-a973-06affde57310 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:58:39 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 73f72f78-9abf-4b04-a973-06affde57310] VM Stopped (Lifecycle Event)
Jul 29 13:58:39 user nova-compute[231753]: DEBUG nova.compute.manager [None req-944f334e-61d6-4e35-80e2-09c48a24a62c None None] [instance: 73f72f78-9abf-4b04-a973-06affde57310] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:58:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "74e3894e-9c5e-410d-b122-2f733b779139" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:58:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "74e3894e-9c5e-410d-b122-2f733b779139" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:58:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:58:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:58:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:58:42 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:58:42 user nova-compute[231753]: INFO nova.compute.claims [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Claim successful on node user
Jul 29 13:58:43 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:58:43 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:58:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.274s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:58:43 user nova-compute[231753]: DEBUG nova.compute.manager [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:58:43 user nova-compute[231753]: DEBUG nova.compute.manager [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:58:43 user nova-compute[231753]: DEBUG nova.network.neutron [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:58:43 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:58:43 user nova-compute[231753]: DEBUG nova.compute.manager [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:58:43 user nova-compute[231753]: INFO nova.virt.block_device [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Booting with volume cdbefe05-ad5a-4372-8011-5253b3627f26 at /dev/vda
Jul 29 13:58:43 user nova-compute[231753]: DEBUG nova.policy [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd94a7ea0c19845b886e12c1689cf30a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45c92d3fe964066b9be87489b2c9f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:58:43 user nova-compute[231753]: DEBUG os_brick.utils [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:58:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:58:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:58:43 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b953cd9c-6066-4a43-83bd-cc50840d91d1]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:58:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:58:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:58:43 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3100b1c1-2693-4791-9d81-6ee17503d1c4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:58:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:58:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:58:43 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba42d4b0-bd77-4d3e-ab88-def5538f6600]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:58:43 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e32d81b-2982-4f00-91c5-ca884c6a9feb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:58:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:58:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:58:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:58:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:58:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:58:43 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:58:43 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b75d91ca-7baf-4333-9679-8cb8c8601d72]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:58:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:58:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:58:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:58:43 user nova-compute[231753]: DEBUG os_brick.utils [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] <== get_connector_properties: return (117ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:58:43 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Updating existing volume attachment record: 7066391b-2816-4c65-930d-7283b373cc64 {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:58:44 user nova-compute[231753]: DEBUG nova.network.neutron [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Successfully created port: e254ed91-f2a2-4bec-b192-21f7e544cc23 {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:58:45 user nova-compute[231753]: DEBUG nova.network.neutron [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Successfully updated port: e254ed91-f2a2-4bec-b192-21f7e544cc23 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:58:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "refresh_cache-74e3894e-9c5e-410d-b122-2f733b779139" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:58:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquired lock "refresh_cache-74e3894e-9c5e-410d-b122-2f733b779139" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:58:45 user nova-compute[231753]: DEBUG nova.network.neutron [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:58:45 user nova-compute[231753]: DEBUG nova.compute.manager [req-c0934df9-316b-45af-92cf-a83b69d118ac req-45606884-c202-400c-9311-ce00cadf51d3 service nova] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Received event network-changed-e254ed91-f2a2-4bec-b192-21f7e544cc23 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:58:45 user nova-compute[231753]: DEBUG nova.compute.manager [req-c0934df9-316b-45af-92cf-a83b69d118ac req-45606884-c202-400c-9311-ce00cadf51d3 service nova] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Refreshing instance network info cache due to event network-changed-e254ed91-f2a2-4bec-b192-21f7e544cc23. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:58:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c0934df9-316b-45af-92cf-a83b69d118ac req-45606884-c202-400c-9311-ce00cadf51d3 service nova] Acquiring lock "refresh_cache-74e3894e-9c5e-410d-b122-2f733b779139" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:58:45 user nova-compute[231753]: DEBUG nova.network.neutron [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:58:45 user nova-compute[231753]: DEBUG nova.network.neutron [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Updating instance_info_cache with network_info: [{"id": "e254ed91-f2a2-4bec-b192-21f7e544cc23", "address": "fa:16:3e:5f:33:c2", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape254ed91-f2", "ovs_interfaceid": "e254ed91-f2a2-4bec-b192-21f7e544cc23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:58:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Releasing lock "refresh_cache-74e3894e-9c5e-410d-b122-2f733b779139" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:58:45 user nova-compute[231753]: DEBUG nova.compute.manager [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Instance network_info: |[{"id": "e254ed91-f2a2-4bec-b192-21f7e544cc23", "address": "fa:16:3e:5f:33:c2", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape254ed91-f2", "ovs_interfaceid": "e254ed91-f2a2-4bec-b192-21f7e544cc23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:58:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c0934df9-316b-45af-92cf-a83b69d118ac req-45606884-c202-400c-9311-ce00cadf51d3 service nova] Acquired lock "refresh_cache-74e3894e-9c5e-410d-b122-2f733b779139" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:58:45 user nova-compute[231753]: DEBUG nova.network.neutron [req-c0934df9-316b-45af-92cf-a83b69d118ac req-45606884-c202-400c-9311-ce00cadf51d3 service nova] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Refreshing network info cache for port e254ed91-f2a2-4bec-b192-21f7e544cc23 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:58:46 user nova-compute[231753]: DEBUG nova.network.neutron [req-c0934df9-316b-45af-92cf-a83b69d118ac req-45606884-c202-400c-9311-ce00cadf51d3 service nova] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Updated VIF entry in instance network info cache for port e254ed91-f2a2-4bec-b192-21f7e544cc23. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:58:46 user nova-compute[231753]: DEBUG nova.network.neutron [req-c0934df9-316b-45af-92cf-a83b69d118ac req-45606884-c202-400c-9311-ce00cadf51d3 service nova] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Updating instance_info_cache with network_info: [{"id": "e254ed91-f2a2-4bec-b192-21f7e544cc23", "address": "fa:16:3e:5f:33:c2", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape254ed91-f2", "ovs_interfaceid": "e254ed91-f2a2-4bec-b192-21f7e544cc23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:58:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c0934df9-316b-45af-92cf-a83b69d118ac req-45606884-c202-400c-9311-ce00cadf51d3 service nova] Releasing lock "refresh_cache-74e3894e-9c5e-410d-b122-2f733b779139" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:58:47 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690639112.118508, a3f9ad53-db31-404a-8442-37cf53f11cbc => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:58:47 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] VM Stopped (Lifecycle Event)
Jul 29 13:58:47 user nova-compute[231753]: DEBUG nova.compute.manager [None req-0d728244-2cfa-4a29-bcf3-f56c62b4702c None None] [instance: a3f9ad53-db31-404a-8442-37cf53f11cbc] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:58:47 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG nova.compute.manager [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:58:50 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Creating image(s)
Jul 29 13:58:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Did not create local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Ensure instance console log exists: /opt/stack/data/nova/instances/74e3894e-9c5e-410d-b122-2f733b779139/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Start _get_guest_xml network_info=[{"id": "e254ed91-f2a2-4bec-b192-21f7e544cc23", "address": "fa:16:3e:5f:33:c2", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape254ed91-f2", "ovs_interfaceid": "e254ed91-f2a2-4bec-b192-21f7e544cc23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGMAFhqZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '74e3894e-9c5e-410d-b122-2f733b779139', 'attached_at': '', 'detached_at': '', 'volume_id': 'cdbefe05-ad5a-4372-8011-5253b3627f26', 'serial': 'cdbefe05-ad5a-4372-8011-5253b3627f26'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '7066391b-2816-4c65-930d-7283b373cc64', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:58:50 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:58:50 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:58:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGMAFhqZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:58:50 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:58:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:58:50 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:58:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:58:50 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:58:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[313afb5c-3f68-4299-b89e-50cfc3e2587b]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:58:50 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4c4f4cb-86c3-4f27-8988-461d345400f3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26] added
Jul 29 13:58:50 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.033s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2f47f5e-dba2-4e6d-87e2-1f97394578cd]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[13248d69-346e-480e-896b-7247f21d561d]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wGMAFhqZ {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wGMAFhqZ" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[28a875f3-a6c4-464a-af54-a75e99f9dfd3]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wGMAFhqZ'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0e07cd0-fbeb-4971-8622-9338c86a70c7]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1ca2140-c44d-4547-8089-1c41d6936047]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 29 13:58:50 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 29 13:58:50 user nova-compute[231753]:  {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:58:50 user nova-compute[231753]: WARNING os_brick.initiator.connectors.iscsi [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 29 13:58:50 user nova-compute[231753]: 
Jul 29 13:58:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --login" returned: 0 in 0.045s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ae57999-d842-4ffe-b88c-b7eefd7d0199]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26, portal: 172.16.0.220,3260]
Jul 29 13:58:50 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26, portal: 172.16.0.220,3260] successful.
Jul 29 13:58:50 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e2d75b-b553-4eed-9493-021bfff118d7]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d988ad21-d3b7-4360-acec-27a7a8ef8ab6]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 13:58:50 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 13:58:50 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] HCTL ('33', '-', '-', 0) found on session 51 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adff48b-5c4d-4b9c-a63d-56499f091be9]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Searching for a device in session 51 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:58:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGMAFhqZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:58:51 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.315s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:58:51 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] <== connect_volume: return (1317ms) {'type': 'block', 'scsi_wwn': '26530303236656431', 'path': '/dev/sdb'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:58:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530303236656431', 'path': '/dev/sdb'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:58:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:58:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-412240626',display_name='tempest-TestVolumeBootPattern-server-412240626',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-412240626',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtoigQ7m5duqzfsiAOyArrbvva1hS5wetlA/wlY5VxGp3gb7rI+IjO+yTaKkT8nB18YhdDg3ru+M38WK4CdhiGgmsEXaLAhkk+kUuZmxu7gpTgpEVOFzr1YWb8fNF9FBQ==',key_name='tempest-TestVolumeBootPattern-1166783581',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f45c92d3fe964066b9be87489b2c9f7e',ramdisk_id='',reservation_id='r-okorzf00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-434673895',owner_user_name='tempest-TestVolumeBootPattern-434673895-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:58:43Z,user_data=None,user_id='d94a7ea0c19845b886e12c1689cf30a8',uuid=74e3894e-9c5e-410d-b122-2f733b779139,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e254ed91-f2a2-4bec-b192-21f7e544cc23", "address": "fa:16:3e:5f:33:c2", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape254ed91-f2", "ovs_interfaceid": "e254ed91-f2a2-4bec-b192-21f7e544cc23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:58:51 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Converting VIF {"id": "e254ed91-f2a2-4bec-b192-21f7e544cc23", "address": "fa:16:3e:5f:33:c2", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape254ed91-f2", "ovs_interfaceid": "e254ed91-f2a2-4bec-b192-21f7e544cc23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:58:51 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:33:c2,bridge_name='br-int',has_traffic_filtering=True,id=e254ed91-f2a2-4bec-b192-21f7e544cc23,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape254ed91-f2') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:58:51 user nova-compute[231753]: DEBUG nova.objects.instance [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lazy-loading 'pci_devices' on Instance uuid 74e3894e-9c5e-410d-b122-2f733b779139 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:58:52 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:58:52 user nova-compute[231753]:   <uuid>74e3894e-9c5e-410d-b122-2f733b779139</uuid>
Jul 29 13:58:52 user nova-compute[231753]:   <name>instance-0000002d</name>
Jul 29 13:58:52 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:58:52 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:58:52 user nova-compute[231753]:   <metadata>
Jul 29 13:58:52 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:58:52 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:58:52 user nova-compute[231753]:       <nova:name>tempest-TestVolumeBootPattern-server-412240626</nova:name>
Jul 29 13:58:52 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:58:50</nova:creationTime>
Jul 29 13:58:52 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:58:52 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:58:52 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:58:52 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:58:52 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:58:52 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:58:52 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:58:52 user nova-compute[231753]:       <nova:owner>
Jul 29 13:58:52 user nova-compute[231753]:         <nova:user uuid="d94a7ea0c19845b886e12c1689cf30a8">tempest-TestVolumeBootPattern-434673895-project-member</nova:user>
Jul 29 13:58:52 user nova-compute[231753]:         <nova:project uuid="f45c92d3fe964066b9be87489b2c9f7e">tempest-TestVolumeBootPattern-434673895</nova:project>
Jul 29 13:58:52 user nova-compute[231753]:       </nova:owner>
Jul 29 13:58:52 user nova-compute[231753]:       <nova:ports>
Jul 29 13:58:52 user nova-compute[231753]:         <nova:port uuid="e254ed91-f2a2-4bec-b192-21f7e544cc23">
Jul 29 13:58:52 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.9" ipVersion="4"/>
Jul 29 13:58:52 user nova-compute[231753]:         </nova:port>
Jul 29 13:58:52 user nova-compute[231753]:       </nova:ports>
Jul 29 13:58:52 user nova-compute[231753]:     </nova:instance>
Jul 29 13:58:52 user nova-compute[231753]:   </metadata>
Jul 29 13:58:52 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:58:52 user nova-compute[231753]:     <system>
Jul 29 13:58:52 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:58:52 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:58:52 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:58:52 user nova-compute[231753]:       <entry name="serial">74e3894e-9c5e-410d-b122-2f733b779139</entry>
Jul 29 13:58:52 user nova-compute[231753]:       <entry name="uuid">74e3894e-9c5e-410d-b122-2f733b779139</entry>
Jul 29 13:58:52 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:58:52 user nova-compute[231753]:     </system>
Jul 29 13:58:52 user nova-compute[231753]:   </sysinfo>
Jul 29 13:58:52 user nova-compute[231753]:   <os>
Jul 29 13:58:52 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:58:52 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:58:52 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:58:52 user nova-compute[231753]:   </os>
Jul 29 13:58:52 user nova-compute[231753]:   <features>
Jul 29 13:58:52 user nova-compute[231753]:     <acpi/>
Jul 29 13:58:52 user nova-compute[231753]:     <apic/>
Jul 29 13:58:52 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:58:52 user nova-compute[231753]:   </features>
Jul 29 13:58:52 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:58:52 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:58:52 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:58:52 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:58:52 user nova-compute[231753]:   </clock>
Jul 29 13:58:52 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:58:52 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:58:52 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:58:52 user nova-compute[231753]:   </cpu>
Jul 29 13:58:52 user nova-compute[231753]:   <devices>
Jul 29 13:58:52 user nova-compute[231753]:     <disk type="block" device="disk">
Jul 29 13:58:52 user nova-compute[231753]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:58:52 user nova-compute[231753]:       <source dev="/dev/sdb"/>
Jul 29 13:58:52 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:58:52 user nova-compute[231753]:       <serial>cdbefe05-ad5a-4372-8011-5253b3627f26</serial>
Jul 29 13:58:52 user nova-compute[231753]:     </disk>
Jul 29 13:58:52 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:58:52 user nova-compute[231753]:       <mac address="fa:16:3e:5f:33:c2"/>
Jul 29 13:58:52 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:58:52 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:58:52 user nova-compute[231753]:       <target dev="tape254ed91-f2"/>
Jul 29 13:58:52 user nova-compute[231753]:     </interface>
Jul 29 13:58:52 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:58:52 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/74e3894e-9c5e-410d-b122-2f733b779139/console.log" append="off"/>
Jul 29 13:58:52 user nova-compute[231753]:     </serial>
Jul 29 13:58:52 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:58:52 user nova-compute[231753]:     <video>
Jul 29 13:58:52 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:58:52 user nova-compute[231753]:     </video>
Jul 29 13:58:52 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:58:52 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:58:52 user nova-compute[231753]:     </rng>
Jul 29 13:58:52 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:58:52 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:58:52 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:58:52 user nova-compute[231753]:     </memballoon>
Jul 29 13:58:52 user nova-compute[231753]:   </devices>
Jul 29 13:58:52 user nova-compute[231753]: </domain>
Jul 29 13:58:52 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:58:52 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:58:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-412240626',display_name='tempest-TestVolumeBootPattern-server-412240626',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-412240626',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtoigQ7m5duqzfsiAOyArrbvva1hS5wetlA/wlY5VxGp3gb7rI+IjO+yTaKkT8nB18YhdDg3ru+M38WK4CdhiGgmsEXaLAhkk+kUuZmxu7gpTgpEVOFzr1YWb8fNF9FBQ==',key_name='tempest-TestVolumeBootPattern-1166783581',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f45c92d3fe964066b9be87489b2c9f7e',ramdisk_id='',reservation_id='r-okorzf00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-434673895',owner_user_name='tempest-TestVolumeBootPattern-434673895-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:58:43Z,user_data=None,user_id='d94a7ea0c19845b886e12c1689cf30a8',uuid=74e3894e-9c5e-410d-b122-2f733b779139,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e254ed91-f2a2-4bec-b192-21f7e544cc23", "address": "fa:16:3e:5f:33:c2", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape254ed91-f2", "ovs_interfaceid": "e254ed91-f2a2-4bec-b192-21f7e544cc23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:58:52 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Converting VIF {"id": "e254ed91-f2a2-4bec-b192-21f7e544cc23", "address": "fa:16:3e:5f:33:c2", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape254ed91-f2", "ovs_interfaceid": "e254ed91-f2a2-4bec-b192-21f7e544cc23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:58:52 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:33:c2,bridge_name='br-int',has_traffic_filtering=True,id=e254ed91-f2a2-4bec-b192-21f7e544cc23,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape254ed91-f2') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:58:52 user nova-compute[231753]: DEBUG os_vif [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:33:c2,bridge_name='br-int',has_traffic_filtering=True,id=e254ed91-f2a2-4bec-b192-21f7e544cc23,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape254ed91-f2') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:58:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:58:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:58:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape254ed91-f2, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:58:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape254ed91-f2, col_values=(('external_ids', {'iface-id': 'e254ed91-f2a2-4bec-b192-21f7e544cc23', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5f:33:c2', 'vm-uuid': '74e3894e-9c5e-410d-b122-2f733b779139'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:58:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:58:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:52 user nova-compute[231753]: INFO os_vif [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:33:c2,bridge_name='br-int',has_traffic_filtering=True,id=e254ed91-f2a2-4bec-b192-21f7e544cc23,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape254ed91-f2')
Jul 29 13:58:52 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:58:52 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] No VIF found with MAC fa:16:3e:5f:33:c2, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:58:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:53 user nova-compute[231753]: DEBUG nova.compute.manager [req-0f2d0a44-3329-4759-8655-5164fc5670c4 req-3a2a3b70-11be-45cb-b25a-4fad856da5b7 service nova] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Received event network-vif-plugged-e254ed91-f2a2-4bec-b192-21f7e544cc23 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:58:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0f2d0a44-3329-4759-8655-5164fc5670c4 req-3a2a3b70-11be-45cb-b25a-4fad856da5b7 service nova] Acquiring lock "74e3894e-9c5e-410d-b122-2f733b779139-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:58:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0f2d0a44-3329-4759-8655-5164fc5670c4 req-3a2a3b70-11be-45cb-b25a-4fad856da5b7 service nova] Lock "74e3894e-9c5e-410d-b122-2f733b779139-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:58:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0f2d0a44-3329-4759-8655-5164fc5670c4 req-3a2a3b70-11be-45cb-b25a-4fad856da5b7 service nova] Lock "74e3894e-9c5e-410d-b122-2f733b779139-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:58:53 user nova-compute[231753]: DEBUG nova.compute.manager [req-0f2d0a44-3329-4759-8655-5164fc5670c4 req-3a2a3b70-11be-45cb-b25a-4fad856da5b7 service nova] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] No waiting events found dispatching network-vif-plugged-e254ed91-f2a2-4bec-b192-21f7e544cc23 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:58:53 user nova-compute[231753]: WARNING nova.compute.manager [req-0f2d0a44-3329-4759-8655-5164fc5670c4 req-3a2a3b70-11be-45cb-b25a-4fad856da5b7 service nova] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Received unexpected event network-vif-plugged-e254ed91-f2a2-4bec-b192-21f7e544cc23 for instance with vm_state building and task_state spawning.
Jul 29 13:58:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:55 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690639135.541128, 74e3894e-9c5e-410d-b122-2f733b779139 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:58:55 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] VM Resumed (Lifecycle Event)
Jul 29 13:58:55 user nova-compute[231753]: DEBUG nova.compute.manager [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:58:55 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:58:55 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Instance spawned successfully.
Jul 29 13:58:55 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:58:55 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:58:55 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:58:55 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:58:55 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:58:55 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:58:55 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:58:55 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:58:55 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:58:55 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:58:55 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690639135.5441546, 74e3894e-9c5e-410d-b122-2f733b779139 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:58:55 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] VM Started (Lifecycle Event)
Jul 29 13:58:55 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:58:55 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:58:55 user nova-compute[231753]: DEBUG nova.compute.manager [req-b8125e19-7e98-4dfa-9764-3d3a97460908 req-5a520b6a-5581-4462-a2b9-4cb90ed0a2a4 service nova] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Received event network-vif-plugged-e254ed91-f2a2-4bec-b192-21f7e544cc23 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:58:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b8125e19-7e98-4dfa-9764-3d3a97460908 req-5a520b6a-5581-4462-a2b9-4cb90ed0a2a4 service nova] Acquiring lock "74e3894e-9c5e-410d-b122-2f733b779139-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:58:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b8125e19-7e98-4dfa-9764-3d3a97460908 req-5a520b6a-5581-4462-a2b9-4cb90ed0a2a4 service nova] Lock "74e3894e-9c5e-410d-b122-2f733b779139-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:58:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b8125e19-7e98-4dfa-9764-3d3a97460908 req-5a520b6a-5581-4462-a2b9-4cb90ed0a2a4 service nova] Lock "74e3894e-9c5e-410d-b122-2f733b779139-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:58:55 user nova-compute[231753]: DEBUG nova.compute.manager [req-b8125e19-7e98-4dfa-9764-3d3a97460908 req-5a520b6a-5581-4462-a2b9-4cb90ed0a2a4 service nova] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] No waiting events found dispatching network-vif-plugged-e254ed91-f2a2-4bec-b192-21f7e544cc23 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:58:55 user nova-compute[231753]: WARNING nova.compute.manager [req-b8125e19-7e98-4dfa-9764-3d3a97460908 req-5a520b6a-5581-4462-a2b9-4cb90ed0a2a4 service nova] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Received unexpected event network-vif-plugged-e254ed91-f2a2-4bec-b192-21f7e544cc23 for instance with vm_state building and task_state spawning.
Jul 29 13:58:55 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:58:55 user nova-compute[231753]: INFO nova.compute.manager [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Took 5.07 seconds to spawn the instance on the hypervisor.
Jul 29 13:58:55 user nova-compute[231753]: DEBUG nova.compute.manager [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:58:55 user nova-compute[231753]: INFO nova.compute.manager [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Took 12.88 seconds to build instance.
Jul 29 13:58:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-89bfadca-79fe-43fa-aae5-2c0778f4dd64 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "74e3894e-9c5e-410d-b122-2f733b779139" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 12.971s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:58:57 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-53633fe3-7365-4f35-91bc-8721abe40377 tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Acquiring lock "3132d31d-7901-4001-bc19-7836f2ecfc70" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:58:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-53633fe3-7365-4f35-91bc-8721abe40377 tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Lock "3132d31d-7901-4001-bc19-7836f2ecfc70" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:58:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-53633fe3-7365-4f35-91bc-8721abe40377 tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Acquiring lock "3132d31d-7901-4001-bc19-7836f2ecfc70-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:58:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-53633fe3-7365-4f35-91bc-8721abe40377 tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Lock "3132d31d-7901-4001-bc19-7836f2ecfc70-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:58:57 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-53633fe3-7365-4f35-91bc-8721abe40377 tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Lock "3132d31d-7901-4001-bc19-7836f2ecfc70-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:58:57 user nova-compute[231753]: INFO nova.compute.manager [None req-53633fe3-7365-4f35-91bc-8721abe40377 tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Terminating instance
Jul 29 13:58:57 user nova-compute[231753]: DEBUG nova.compute.manager [None req-53633fe3-7365-4f35-91bc-8721abe40377 tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 13:58:57 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:58 user nova-compute[231753]: DEBUG nova.compute.manager [req-8db06934-1c1d-4602-b2ed-ca5bfabc7ebe req-8f48365e-df75-48e1-9bea-251c5694e243 service nova] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Received event network-vif-unplugged-fe5f0747-a1bf-4c90-a21d-817beed45cb0 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:58:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8db06934-1c1d-4602-b2ed-ca5bfabc7ebe req-8f48365e-df75-48e1-9bea-251c5694e243 service nova] Acquiring lock "3132d31d-7901-4001-bc19-7836f2ecfc70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:58:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8db06934-1c1d-4602-b2ed-ca5bfabc7ebe req-8f48365e-df75-48e1-9bea-251c5694e243 service nova] Lock "3132d31d-7901-4001-bc19-7836f2ecfc70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:58:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8db06934-1c1d-4602-b2ed-ca5bfabc7ebe req-8f48365e-df75-48e1-9bea-251c5694e243 service nova] Lock "3132d31d-7901-4001-bc19-7836f2ecfc70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:58:58 user nova-compute[231753]: DEBUG nova.compute.manager [req-8db06934-1c1d-4602-b2ed-ca5bfabc7ebe req-8f48365e-df75-48e1-9bea-251c5694e243 service nova] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] No waiting events found dispatching network-vif-unplugged-fe5f0747-a1bf-4c90-a21d-817beed45cb0 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:58:58 user nova-compute[231753]: DEBUG nova.compute.manager [req-8db06934-1c1d-4602-b2ed-ca5bfabc7ebe req-8f48365e-df75-48e1-9bea-251c5694e243 service nova] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Received event network-vif-unplugged-fe5f0747-a1bf-4c90-a21d-817beed45cb0 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 13:58:58 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Instance destroyed successfully.
Jul 29 13:58:58 user nova-compute[231753]: DEBUG nova.objects.instance [None req-53633fe3-7365-4f35-91bc-8721abe40377 tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Lazy-loading 'resources' on Instance uuid 3132d31d-7901-4001-bc19-7836f2ecfc70 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:58:58 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-53633fe3-7365-4f35-91bc-8721abe40377 tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:57:07Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesNegativeTest-instance-1679588816',display_name='tempest-VolumesNegativeTest-instance-1679588816',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesnegativetest-instance-1679588816',id=43,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:57:14Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='0d72c0cabd46471cb086a958a20cdb1c',ramdisk_id='',reservation_id='r-tvq2yzkc',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesNegativeTest-178110141',owner_user_name='tempest-VolumesNegativeTest-178110141-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:57:14Z,user_data=None,user_id='56465b2b917b4aa1abaf1bb352c54970',uuid=3132d31d-7901-4001-bc19-7836f2ecfc70,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fe5f0747-a1bf-4c90-a21d-817beed45cb0", "address": "fa:16:3e:f0:1a:24", "network": {"id": "51c31371-2b36-45dd-b627-b589d64051f8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c691c184cace4b549169d1b6e8985e5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe5f0747-a1", "ovs_interfaceid": "fe5f0747-a1bf-4c90-a21d-817beed45cb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 13:58:58 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-53633fe3-7365-4f35-91bc-8721abe40377 tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Converting VIF {"id": "fe5f0747-a1bf-4c90-a21d-817beed45cb0", "address": "fa:16:3e:f0:1a:24", "network": {"id": "51c31371-2b36-45dd-b627-b589d64051f8", "bridge": "br-int", "label": "shared", "subnets": [{"cidr": "192.168.233.0/24", "dns": [], "gateway": {"address": "192.168.233.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "192.168.233.228", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "192.168.233.1"}}], "meta": {"injected": false, "tenant_id": "c691c184cace4b549169d1b6e8985e5c", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapfe5f0747-a1", "ovs_interfaceid": "fe5f0747-a1bf-4c90-a21d-817beed45cb0", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:58:58 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-53633fe3-7365-4f35-91bc-8721abe40377 tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f0:1a:24,bridge_name='br-int',has_traffic_filtering=True,id=fe5f0747-a1bf-4c90-a21d-817beed45cb0,network=Network(51c31371-2b36-45dd-b627-b589d64051f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe5f0747-a1') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:58:58 user nova-compute[231753]: DEBUG os_vif [None req-53633fe3-7365-4f35-91bc-8721abe40377 tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:1a:24,bridge_name='br-int',has_traffic_filtering=True,id=fe5f0747-a1bf-4c90-a21d-817beed45cb0,network=Network(51c31371-2b36-45dd-b627-b589d64051f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe5f0747-a1') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 13:58:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfe5f0747-a1, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:58:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:58:58 user nova-compute[231753]: INFO os_vif [None req-53633fe3-7365-4f35-91bc-8721abe40377 tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f0:1a:24,bridge_name='br-int',has_traffic_filtering=True,id=fe5f0747-a1bf-4c90-a21d-817beed45cb0,network=Network(51c31371-2b36-45dd-b627-b589d64051f8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfe5f0747-a1')
Jul 29 13:58:58 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-53633fe3-7365-4f35-91bc-8721abe40377 tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Deleting instance files /opt/stack/data/nova/instances/3132d31d-7901-4001-bc19-7836f2ecfc70_del
Jul 29 13:58:58 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-53633fe3-7365-4f35-91bc-8721abe40377 tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Deletion of /opt/stack/data/nova/instances/3132d31d-7901-4001-bc19-7836f2ecfc70_del complete
Jul 29 13:58:58 user nova-compute[231753]: INFO nova.compute.manager [None req-53633fe3-7365-4f35-91bc-8721abe40377 tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Took 0.69 seconds to destroy the instance on the hypervisor.
Jul 29 13:58:58 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-53633fe3-7365-4f35-91bc-8721abe40377 tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 13:58:58 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 13:58:58 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 13:58:59 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:58:59 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Took 0.59 seconds to deallocate network for instance.
Jul 29 13:58:59 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-53633fe3-7365-4f35-91bc-8721abe40377 tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:58:59 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-53633fe3-7365-4f35-91bc-8721abe40377 tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:58:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:58:59 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-53633fe3-7365-4f35-91bc-8721abe40377 tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:58:59 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-53633fe3-7365-4f35-91bc-8721abe40377 tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:58:59 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-53633fe3-7365-4f35-91bc-8721abe40377 tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.170s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:58:59 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-53633fe3-7365-4f35-91bc-8721abe40377 tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Deleted allocations for instance 3132d31d-7901-4001-bc19-7836f2ecfc70
Jul 29 13:58:59 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-53633fe3-7365-4f35-91bc-8721abe40377 tempest-VolumesNegativeTest-178110141 tempest-VolumesNegativeTest-178110141-project-member] Lock "3132d31d-7901-4001-bc19-7836f2ecfc70" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.643s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:59:00 user nova-compute[231753]: DEBUG nova.compute.manager [req-515be2a9-8142-4f91-a9ea-6a39cc6e20be req-a2ffc408-256e-45eb-903a-095f44bdb59e service nova] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Received event network-vif-plugged-fe5f0747-a1bf-4c90-a21d-817beed45cb0 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:59:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-515be2a9-8142-4f91-a9ea-6a39cc6e20be req-a2ffc408-256e-45eb-903a-095f44bdb59e service nova] Acquiring lock "3132d31d-7901-4001-bc19-7836f2ecfc70-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:59:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-515be2a9-8142-4f91-a9ea-6a39cc6e20be req-a2ffc408-256e-45eb-903a-095f44bdb59e service nova] Lock "3132d31d-7901-4001-bc19-7836f2ecfc70-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:59:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-515be2a9-8142-4f91-a9ea-6a39cc6e20be req-a2ffc408-256e-45eb-903a-095f44bdb59e service nova] Lock "3132d31d-7901-4001-bc19-7836f2ecfc70-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:59:00 user nova-compute[231753]: DEBUG nova.compute.manager [req-515be2a9-8142-4f91-a9ea-6a39cc6e20be req-a2ffc408-256e-45eb-903a-095f44bdb59e service nova] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] No waiting events found dispatching network-vif-plugged-fe5f0747-a1bf-4c90-a21d-817beed45cb0 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:59:00 user nova-compute[231753]: WARNING nova.compute.manager [req-515be2a9-8142-4f91-a9ea-6a39cc6e20be req-a2ffc408-256e-45eb-903a-095f44bdb59e service nova] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Received unexpected event network-vif-plugged-fe5f0747-a1bf-4c90-a21d-817beed45cb0 for instance with vm_state deleted and task_state None.
Jul 29 13:59:00 user nova-compute[231753]: DEBUG nova.compute.manager [req-515be2a9-8142-4f91-a9ea-6a39cc6e20be req-a2ffc408-256e-45eb-903a-095f44bdb59e service nova] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Received event network-vif-deleted-fe5f0747-a1bf-4c90-a21d-817beed45cb0 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:59:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:08 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:59:08 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:08 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=231753) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 13:59:08 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 13:59:08 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 13:59:08 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:13 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690639138.5154831, 3132d31d-7901-4001-bc19-7836f2ecfc70 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:59:13 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] VM Stopped (Lifecycle Event)
Jul 29 13:59:13 user nova-compute[231753]: DEBUG nova.compute.manager [None req-03439fe3-1c11-43e0-87c8-b4a8b3eadc02 None None] [instance: 3132d31d-7901-4001-bc19-7836f2ecfc70] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:59:13 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:17 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:21 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:59:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:22 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:59:22 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 13:59:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "refresh_cache-8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:59:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquired lock "refresh_cache-8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:59:22 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Forcefully refreshing network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 13:59:23 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Updating instance_info_cache with network_info: [{"id": "eea8caab-510b-4b6d-bf98-d1149bd48f91", "address": "fa:16:3e:cf:43:1e", "network": {"id": "a10f7c69-0720-46b5-b252-6523dc61a6ca", "bridge": "br-int", "label": "tempest-TestStampPattern-1661615052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28da183a39e9413ebf7f0bc22ea1ae5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea8caab-51", "ovs_interfaceid": "eea8caab-510b-4b6d-bf98-d1149bd48f91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:59:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Releasing lock "refresh_cache-8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:59:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Updated the network info_cache for instance {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 13:59:23 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:59:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Cleaning up deleted instances with incomplete migration  {{(pid=231753) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 29 13:59:24 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:59:24 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:59:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:59:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:59:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:59:24 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 13:59:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:59:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:59:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:59:24 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:59:24 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 13:59:25 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:59:25 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:59:25 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=8327MB free_disk=25.17279815673828GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 13:59:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:59:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:59:25 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:59:25 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 74e3894e-9c5e-410d-b122-2f733b779139 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 13:59:25 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 13:59:25 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 13:59:25 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Refreshing inventories for resource provider 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 29 13:59:25 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Updating ProviderTree inventory for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 29 13:59:25 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Updating inventory in ProviderTree for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 29 13:59:25 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Refreshing aggregate associations for resource provider 222db5c7-e17f-4307-968d-4284bf5c19f4, aggregates: None {{(pid=231753) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 29 13:59:25 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Refreshing trait associations for resource provider 222db5c7-e17f-4307-968d-4284bf5c19f4, traits: HW_CPU_X86_SSSE3,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_VIRTIO {{(pid=231753) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 29 13:59:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:25 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:59:25 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:59:25 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 13:59:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.545s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:59:25 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:59:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:27 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:59:27 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:59:27 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:59:27 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 13:59:28 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:59:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:28 user nova-compute[231753]: DEBUG nova.compute.manager [req-0d491d5a-ede4-4372-825b-3125477d066a req-4bf461a2-b95b-4744-90cb-f1ab34b4ddbb service nova] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Received event network-changed-eea8caab-510b-4b6d-bf98-d1149bd48f91 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:59:28 user nova-compute[231753]: DEBUG nova.compute.manager [req-0d491d5a-ede4-4372-825b-3125477d066a req-4bf461a2-b95b-4744-90cb-f1ab34b4ddbb service nova] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Refreshing instance network info cache due to event network-changed-eea8caab-510b-4b6d-bf98-d1149bd48f91. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:59:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0d491d5a-ede4-4372-825b-3125477d066a req-4bf461a2-b95b-4744-90cb-f1ab34b4ddbb service nova] Acquiring lock "refresh_cache-8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:59:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0d491d5a-ede4-4372-825b-3125477d066a req-4bf461a2-b95b-4744-90cb-f1ab34b4ddbb service nova] Acquired lock "refresh_cache-8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:59:28 user nova-compute[231753]: DEBUG nova.network.neutron [req-0d491d5a-ede4-4372-825b-3125477d066a req-4bf461a2-b95b-4744-90cb-f1ab34b4ddbb service nova] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Refreshing network info cache for port eea8caab-510b-4b6d-bf98-d1149bd48f91 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:59:29 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:59:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Acquiring lock "8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:59:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:59:29 user nova-compute[231753]: DEBUG nova.objects.instance [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lazy-loading 'flavor' on Instance uuid 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:59:29 user nova-compute[231753]: DEBUG nova.network.neutron [req-0d491d5a-ede4-4372-825b-3125477d066a req-4bf461a2-b95b-4744-90cb-f1ab34b4ddbb service nova] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Updated VIF entry in instance network info cache for port eea8caab-510b-4b6d-bf98-d1149bd48f91. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:59:29 user nova-compute[231753]: DEBUG nova.network.neutron [req-0d491d5a-ede4-4372-825b-3125477d066a req-4bf461a2-b95b-4744-90cb-f1ab34b4ddbb service nova] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Updating instance_info_cache with network_info: [{"id": "eea8caab-510b-4b6d-bf98-d1149bd48f91", "address": "fa:16:3e:cf:43:1e", "network": {"id": "a10f7c69-0720-46b5-b252-6523dc61a6ca", "bridge": "br-int", "label": "tempest-TestStampPattern-1661615052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28da183a39e9413ebf7f0bc22ea1ae5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea8caab-51", "ovs_interfaceid": "eea8caab-510b-4b6d-bf98-d1149bd48f91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:59:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0d491d5a-ede4-4372-825b-3125477d066a req-4bf461a2-b95b-4744-90cb-f1ab34b4ddbb service nova] Releasing lock "refresh_cache-8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:59:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.052s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:59:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Acquiring lock "8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:59:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:59:29 user nova-compute[231753]: INFO nova.compute.manager [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Attaching volume 2fe62685-5be8-490e-bca1-bb093a073782 to /dev/vdb
Jul 29 13:59:29 user nova-compute[231753]: DEBUG os_brick.utils [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:59:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:59:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:59:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8f0cf6b-8213-4cd7-b6dc-98e2d7d0268a]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:59:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:59:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:59:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f932ee9-b6de-409a-a3c5-53f5874977b3]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:59:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:59:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:59:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[89aa0e9d-a091-4271-92cf-b500d7a15aa0]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:59:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[597460b3-88b2-4a26-bbdd-9387282c2fc6]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:59:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:59:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:59:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 13:59:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:59:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 13:59:29 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 13:59:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ed4c5e0-4d01-4e03-ad2e-5192740737d3]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:59:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 13:59:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 13:59:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 13:59:29 user nova-compute[231753]: DEBUG os_brick.utils [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:59:29 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Updating existing volume attachment record: 1403b34f-36e8-4358-b7e8-b9c10783fc07 {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 13:59:30 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:31 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:59:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Acquiring lock "fa284c5d-fe31-493c-a3ed-1a015219cd48" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:59:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lock "fa284c5d-fe31-493c-a3ed-1a015219cd48" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:59:36 user nova-compute[231753]: DEBUG nova.compute.manager [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 13:59:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:59:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:59:37 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 13:59:37 user nova-compute[231753]: INFO nova.compute.claims [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Claim successful on node user
Jul 29 13:59:37 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 13:59:37 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 13:59:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.252s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:59:37 user nova-compute[231753]: DEBUG nova.compute.manager [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 13:59:37 user nova-compute[231753]: DEBUG nova.compute.manager [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 13:59:37 user nova-compute[231753]: DEBUG nova.network.neutron [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 13:59:37 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 13:59:37 user nova-compute[231753]: DEBUG nova.compute.manager [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 13:59:37 user nova-compute[231753]: DEBUG nova.compute.manager [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 13:59:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 13:59:37 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Creating image(s)
Jul 29 13:59:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Acquiring lock "/opt/stack/data/nova/instances/fa284c5d-fe31-493c-a3ed-1a015219cd48/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:59:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lock "/opt/stack/data/nova/instances/fa284c5d-fe31-493c-a3ed-1a015219cd48/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:59:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lock "/opt/stack/data/nova/instances/fa284c5d-fe31-493c-a3ed-1a015219cd48/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.006s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:59:37 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:59:37 user nova-compute[231753]: DEBUG nova.policy [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '044799f22df449fb82aeef584dcf72e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd77abd6fc41499a1071d21320227d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 13:59:37 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.139s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:59:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:59:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:59:37 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:59:37 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.131s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:59:37 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/fa284c5d-fe31-493c-a3ed-1a015219cd48/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:59:37 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/fa284c5d-fe31-493c-a3ed-1a015219cd48/disk 1073741824" returned: 0 in 0.055s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:59:37 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.193s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:59:37 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:59:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.129s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:59:38 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Checking if we can resize image /opt/stack/data/nova/instances/fa284c5d-fe31-493c-a3ed-1a015219cd48/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 13:59:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa284c5d-fe31-493c-a3ed-1a015219cd48/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:59:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa284c5d-fe31-493c-a3ed-1a015219cd48/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:59:38 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Cannot resize image /opt/stack/data/nova/instances/fa284c5d-fe31-493c-a3ed-1a015219cd48/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 13:59:38 user nova-compute[231753]: DEBUG nova.objects.instance [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lazy-loading 'migration_context' on Instance uuid fa284c5d-fe31-493c-a3ed-1a015219cd48 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:59:38 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 13:59:38 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Ensure instance console log exists: /opt/stack/data/nova/instances/fa284c5d-fe31-493c-a3ed-1a015219cd48/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 13:59:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:59:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:59:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:59:38 user nova-compute[231753]: DEBUG nova.network.neutron [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Successfully created port: cb4d540c-5827-40aa-b326-bceba6df9833 {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 13:59:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:38 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 13:59:38 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oZhragFu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:59:38 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:59:38 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:59:38 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:59:38 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:59:38 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:59:38 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:59:38 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 13:59:38 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782 -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b84c9089-b767-4834-8564-65d9df1e16c5]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 13:59:39 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782 -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a9f43a-16e6-4d56-bce4-2d5f50ccc8a3]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782] added
Jul 29 13:59:39 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[42f83b3a-2caf-415e-9a2b-857b98799ae1]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c2e4f36-ecaa-494a-ae58-32463097d76c]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oZhragFu {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.network.neutron [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Successfully updated port: cb4d540c-5827-40aa-b326-bceba6df9833 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v oZhragFu" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b097feca-709e-49ba-87a7-2aceab0dcea0]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'oZhragFu'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Acquiring lock "refresh_cache-fa284c5d-fe31-493c-a3ed-1a015219cd48" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Acquired lock "refresh_cache-fa284c5d-fe31-493c-a3ed-1a015219cd48" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.network.neutron [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b59406-1208-4cfc-aeb3-e38e351b7933]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[aba96847-e753-41b5-b508-6c15ddc4651c]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 13:59:39 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 13:59:39 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782 -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.network.neutron [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.compute.manager [req-738a39bb-d593-471f-be2f-fe67e69db5de req-508f223b-8a9b-4629-91a5-957364dbb56b service nova] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Received event network-changed-cb4d540c-5827-40aa-b326-bceba6df9833 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.compute.manager [req-738a39bb-d593-471f-be2f-fe67e69db5de req-508f223b-8a9b-4629-91a5-957364dbb56b service nova] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Refreshing instance network info cache due to event network-changed-cb4d540c-5827-40aa-b326-bceba6df9833. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-738a39bb-d593-471f-be2f-fe67e69db5de req-508f223b-8a9b-4629-91a5-957364dbb56b service nova] Acquiring lock "refresh_cache-fa284c5d-fe31-493c-a3ed-1a015219cd48" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782 -p 172.16.0.220:3260 --login" returned: 0 in 0.056s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b0b0820-eb75-41b8-9945-a60435eef250]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782, portal: 172.16.0.220,3260]
Jul 29 13:59:39 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782, portal: 172.16.0.220,3260] successful.
Jul 29 13:59:39 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e78ebe0-1c01-4316-8f34-4cdefe2a969d]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8f14031-a879-4d45-be5a-09d29bbe3470]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 13:59:39 user nova-compute[231753]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782 (non-flash)
Jul 29 13:59:39 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 13:59:39 user nova-compute[231753]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782 (non-flash)
Jul 29 13:59:39 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.295s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] HCTL ('34', '-', '-', 0) found on session 52 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ef4d2f-df78-4c29-881a-55ac8689dd87]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: None {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.network.neutron [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Updating instance_info_cache with network_info: [{"id": "cb4d540c-5827-40aa-b326-bceba6df9833", "address": "fa:16:3e:ee:f2:66", "network": {"id": "2ddc9999-9ee3-464c-9f09-409be4323fa8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413085584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bd77abd6fc41499a1071d21320227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4d540c-58", "ovs_interfaceid": "cb4d540c-5827-40aa-b326-bceba6df9833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Releasing lock "refresh_cache-fa284c5d-fe31-493c-a3ed-1a015219cd48" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.compute.manager [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Instance network_info: |[{"id": "cb4d540c-5827-40aa-b326-bceba6df9833", "address": "fa:16:3e:ee:f2:66", "network": {"id": "2ddc9999-9ee3-464c-9f09-409be4323fa8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413085584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bd77abd6fc41499a1071d21320227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4d540c-58", "ovs_interfaceid": "cb4d540c-5827-40aa-b326-bceba6df9833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-738a39bb-d593-471f-be2f-fe67e69db5de req-508f223b-8a9b-4629-91a5-957364dbb56b service nova] Acquired lock "refresh_cache-fa284c5d-fe31-493c-a3ed-1a015219cd48" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.network.neutron [req-738a39bb-d593-471f-be2f-fe67e69db5de req-508f223b-8a9b-4629-91a5-957364dbb56b service nova] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Refreshing network info cache for port cb4d540c-5827-40aa-b326-bceba6df9833 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Start _get_guest_xml network_info=[{"id": "cb4d540c-5827-40aa-b326-bceba6df9833", "address": "fa:16:3e:ee:f2:66", "network": {"id": "2ddc9999-9ee3-464c-9f09-409be4323fa8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413085584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bd77abd6fc41499a1071d21320227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4d540c-58", "ovs_interfaceid": "cb4d540c-5827-40aa-b326-bceba6df9833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 13:59:39 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:59:39 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:59:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-542054533',display_name='tempest-VolumesActionsTest-instance-542054533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-542054533',id=46,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05bd77abd6fc41499a1071d21320227d',ramdisk_id='',reservation_id='r-y1nle4dp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1523708427',owner_user_name='tempest-VolumesActionsTest-1523708427-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:59:37Z,user_data=None,user_id='044799f22df449fb82aeef584dcf72e6',uuid=fa284c5d-fe31-493c-a3ed-1a015219cd48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb4d540c-5827-40aa-b326-bceba6df9833", "address": "fa:16:3e:ee:f2:66", "network": {"id": "2ddc9999-9ee3-464c-9f09-409be4323fa8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413085584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bd77abd6fc41499a1071d21320227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4d540c-58", "ovs_interfaceid": "cb4d540c-5827-40aa-b326-bceba6df9833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Converting VIF {"id": "cb4d540c-5827-40aa-b326-bceba6df9833", "address": "fa:16:3e:ee:f2:66", "network": {"id": "2ddc9999-9ee3-464c-9f09-409be4323fa8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413085584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bd77abd6fc41499a1071d21320227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4d540c-58", "ovs_interfaceid": "cb4d540c-5827-40aa-b326-bceba6df9833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:f2:66,bridge_name='br-int',has_traffic_filtering=True,id=cb4d540c-5827-40aa-b326-bceba6df9833,network=Network(2ddc9999-9ee3-464c-9f09-409be4323fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb4d540c-58') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.objects.instance [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lazy-loading 'pci_devices' on Instance uuid fa284c5d-fe31-493c-a3ed-1a015219cd48 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] End _get_guest_xml xml=<domain type="kvm">
Jul 29 13:59:39 user nova-compute[231753]:   <uuid>fa284c5d-fe31-493c-a3ed-1a015219cd48</uuid>
Jul 29 13:59:39 user nova-compute[231753]:   <name>instance-0000002e</name>
Jul 29 13:59:39 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 13:59:39 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 13:59:39 user nova-compute[231753]:   <metadata>
Jul 29 13:59:39 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 13:59:39 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 13:59:39 user nova-compute[231753]:       <nova:name>tempest-VolumesActionsTest-instance-542054533</nova:name>
Jul 29 13:59:39 user nova-compute[231753]:       <nova:creationTime>2023-07-29 13:59:39</nova:creationTime>
Jul 29 13:59:39 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 13:59:39 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 13:59:39 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 13:59:39 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 13:59:39 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 13:59:39 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 13:59:39 user nova-compute[231753]:       </nova:flavor>
Jul 29 13:59:39 user nova-compute[231753]:       <nova:owner>
Jul 29 13:59:39 user nova-compute[231753]:         <nova:user uuid="044799f22df449fb82aeef584dcf72e6">tempest-VolumesActionsTest-1523708427-project-member</nova:user>
Jul 29 13:59:39 user nova-compute[231753]:         <nova:project uuid="05bd77abd6fc41499a1071d21320227d">tempest-VolumesActionsTest-1523708427</nova:project>
Jul 29 13:59:39 user nova-compute[231753]:       </nova:owner>
Jul 29 13:59:39 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 13:59:39 user nova-compute[231753]:       <nova:ports>
Jul 29 13:59:39 user nova-compute[231753]:         <nova:port uuid="cb4d540c-5827-40aa-b326-bceba6df9833">
Jul 29 13:59:39 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.7" ipVersion="4"/>
Jul 29 13:59:39 user nova-compute[231753]:         </nova:port>
Jul 29 13:59:39 user nova-compute[231753]:       </nova:ports>
Jul 29 13:59:39 user nova-compute[231753]:     </nova:instance>
Jul 29 13:59:39 user nova-compute[231753]:   </metadata>
Jul 29 13:59:39 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 13:59:39 user nova-compute[231753]:     <system>
Jul 29 13:59:39 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 13:59:39 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 13:59:39 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 13:59:39 user nova-compute[231753]:       <entry name="serial">fa284c5d-fe31-493c-a3ed-1a015219cd48</entry>
Jul 29 13:59:39 user nova-compute[231753]:       <entry name="uuid">fa284c5d-fe31-493c-a3ed-1a015219cd48</entry>
Jul 29 13:59:39 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 13:59:39 user nova-compute[231753]:     </system>
Jul 29 13:59:39 user nova-compute[231753]:   </sysinfo>
Jul 29 13:59:39 user nova-compute[231753]:   <os>
Jul 29 13:59:39 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 13:59:39 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 13:59:39 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 13:59:39 user nova-compute[231753]:   </os>
Jul 29 13:59:39 user nova-compute[231753]:   <features>
Jul 29 13:59:39 user nova-compute[231753]:     <acpi/>
Jul 29 13:59:39 user nova-compute[231753]:     <apic/>
Jul 29 13:59:39 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 13:59:39 user nova-compute[231753]:   </features>
Jul 29 13:59:39 user nova-compute[231753]:   <clock offset="utc">
Jul 29 13:59:39 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 13:59:39 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 13:59:39 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 13:59:39 user nova-compute[231753]:   </clock>
Jul 29 13:59:39 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 13:59:39 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 13:59:39 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 13:59:39 user nova-compute[231753]:   </cpu>
Jul 29 13:59:39 user nova-compute[231753]:   <devices>
Jul 29 13:59:39 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 13:59:39 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 13:59:39 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/fa284c5d-fe31-493c-a3ed-1a015219cd48/disk"/>
Jul 29 13:59:39 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 13:59:39 user nova-compute[231753]:     </disk>
Jul 29 13:59:39 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 13:59:39 user nova-compute[231753]:       <mac address="fa:16:3e:ee:f2:66"/>
Jul 29 13:59:39 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:59:39 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 13:59:39 user nova-compute[231753]:       <target dev="tapcb4d540c-58"/>
Jul 29 13:59:39 user nova-compute[231753]:     </interface>
Jul 29 13:59:39 user nova-compute[231753]:     <serial type="pty">
Jul 29 13:59:39 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/fa284c5d-fe31-493c-a3ed-1a015219cd48/console.log" append="off"/>
Jul 29 13:59:39 user nova-compute[231753]:     </serial>
Jul 29 13:59:39 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 13:59:39 user nova-compute[231753]:     <video>
Jul 29 13:59:39 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 13:59:39 user nova-compute[231753]:     </video>
Jul 29 13:59:39 user nova-compute[231753]:     <rng model="virtio">
Jul 29 13:59:39 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 13:59:39 user nova-compute[231753]:     </rng>
Jul 29 13:59:39 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 13:59:39 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 13:59:39 user nova-compute[231753]:       <stats period="10"/>
Jul 29 13:59:39 user nova-compute[231753]:     </memballoon>
Jul 29 13:59:39 user nova-compute[231753]:   </devices>
Jul 29 13:59:39 user nova-compute[231753]: </domain>
Jul 29 13:59:39 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:59:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-542054533',display_name='tempest-VolumesActionsTest-instance-542054533',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-542054533',id=46,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05bd77abd6fc41499a1071d21320227d',ramdisk_id='',reservation_id='r-y1nle4dp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1523708427',owner_user_name='tempest-VolumesActionsTest-1523708427-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T13:59:37Z,user_data=None,user_id='044799f22df449fb82aeef584dcf72e6',uuid=fa284c5d-fe31-493c-a3ed-1a015219cd48,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "cb4d540c-5827-40aa-b326-bceba6df9833", "address": "fa:16:3e:ee:f2:66", "network": {"id": "2ddc9999-9ee3-464c-9f09-409be4323fa8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413085584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bd77abd6fc41499a1071d21320227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4d540c-58", "ovs_interfaceid": "cb4d540c-5827-40aa-b326-bceba6df9833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Converting VIF {"id": "cb4d540c-5827-40aa-b326-bceba6df9833", "address": "fa:16:3e:ee:f2:66", "network": {"id": "2ddc9999-9ee3-464c-9f09-409be4323fa8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413085584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bd77abd6fc41499a1071d21320227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4d540c-58", "ovs_interfaceid": "cb4d540c-5827-40aa-b326-bceba6df9833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:f2:66,bridge_name='br-int',has_traffic_filtering=True,id=cb4d540c-5827-40aa-b326-bceba6df9833,network=Network(2ddc9999-9ee3-464c-9f09-409be4323fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb4d540c-58') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG os_vif [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:f2:66,bridge_name='br-int',has_traffic_filtering=True,id=cb4d540c-5827-40aa-b326-bceba6df9833,network=Network(2ddc9999-9ee3-464c-9f09-409be4323fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb4d540c-58') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapcb4d540c-58, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapcb4d540c-58, col_values=(('external_ids', {'iface-id': 'cb4d540c-5827-40aa-b326-bceba6df9833', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ee:f2:66', 'vm-uuid': 'fa284c5d-fe31-493c-a3ed-1a015219cd48'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:39 user nova-compute[231753]: INFO os_vif [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:f2:66,bridge_name='br-int',has_traffic_filtering=True,id=cb4d540c-5827-40aa-b326-bceba6df9833,network=Network(2ddc9999-9ee3-464c-9f09-409be4323fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb4d540c-58')
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] No VIF found with MAC fa:16:3e:ee:f2:66, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.network.neutron [req-738a39bb-d593-471f-be2f-fe67e69db5de req-508f223b-8a9b-4629-91a5-957364dbb56b service nova] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Updated VIF entry in instance network info cache for port cb4d540c-5827-40aa-b326-bceba6df9833. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG nova.network.neutron [req-738a39bb-d593-471f-be2f-fe67e69db5de req-508f223b-8a9b-4629-91a5-957364dbb56b service nova] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Updating instance_info_cache with network_info: [{"id": "cb4d540c-5827-40aa-b326-bceba6df9833", "address": "fa:16:3e:ee:f2:66", "network": {"id": "2ddc9999-9ee3-464c-9f09-409be4323fa8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413085584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bd77abd6fc41499a1071d21320227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4d540c-58", "ovs_interfaceid": "cb4d540c-5827-40aa-b326-bceba6df9833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 13:59:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-738a39bb-d593-471f-be2f-fe67e69db5de req-508f223b-8a9b-4629-91a5-957364dbb56b service nova] Releasing lock "refresh_cache-fa284c5d-fe31-493c-a3ed-1a015219cd48" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 13:59:40 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Searching for a device in session 52 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 13:59:40 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oZhragFu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 13:59:40 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.331s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:59:40 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] <== connect_volume: return (1333ms) {'type': 'block', 'scsi_wwn': '26335316239343065', 'path': '/dev/sdc'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:59:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26335316239343065', 'path': '/dev/sdc'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 13:59:40 user nova-compute[231753]: DEBUG nova.objects.instance [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lazy-loading 'flavor' on Instance uuid 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:59:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 13:59:40 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:59:40 user nova-compute[231753]:   <source dev="/dev/sdc"/>
Jul 29 13:59:40 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:59:40 user nova-compute[231753]:   <serial>2fe62685-5be8-490e-bca1-bb093a073782</serial>
Jul 29 13:59:40 user nova-compute[231753]: </disk>
Jul 29 13:59:40 user nova-compute[231753]:  {{(pid=231753) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 13:59:41 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:59:41 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] No BDM found with device name vdb, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 13:59:41 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] No VIF found with MAC fa:16:3e:cf:43:1e, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 13:59:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4f380de3-de75-4ad1-9918-72966762b2ec tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 11.643s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:59:41 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:41 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:41 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:41 user nova-compute[231753]: DEBUG nova.compute.manager [req-b57828c0-6c1f-436e-9257-b48aaa1ce5c3 req-ca3a2323-2267-4a55-b788-628453c69a11 service nova] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Received event network-vif-plugged-cb4d540c-5827-40aa-b326-bceba6df9833 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:59:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b57828c0-6c1f-436e-9257-b48aaa1ce5c3 req-ca3a2323-2267-4a55-b788-628453c69a11 service nova] Acquiring lock "fa284c5d-fe31-493c-a3ed-1a015219cd48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:59:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b57828c0-6c1f-436e-9257-b48aaa1ce5c3 req-ca3a2323-2267-4a55-b788-628453c69a11 service nova] Lock "fa284c5d-fe31-493c-a3ed-1a015219cd48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:59:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b57828c0-6c1f-436e-9257-b48aaa1ce5c3 req-ca3a2323-2267-4a55-b788-628453c69a11 service nova] Lock "fa284c5d-fe31-493c-a3ed-1a015219cd48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:59:41 user nova-compute[231753]: DEBUG nova.compute.manager [req-b57828c0-6c1f-436e-9257-b48aaa1ce5c3 req-ca3a2323-2267-4a55-b788-628453c69a11 service nova] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] No waiting events found dispatching network-vif-plugged-cb4d540c-5827-40aa-b326-bceba6df9833 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:59:41 user nova-compute[231753]: WARNING nova.compute.manager [req-b57828c0-6c1f-436e-9257-b48aaa1ce5c3 req-ca3a2323-2267-4a55-b788-628453c69a11 service nova] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Received unexpected event network-vif-plugged-cb4d540c-5827-40aa-b326-bceba6df9833 for instance with vm_state building and task_state spawning.
Jul 29 13:59:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:42 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:59:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Cleaning up deleted instances {{(pid=231753) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 29 13:59:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] There are 0 instances to clean {{(pid=231753) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 29 13:59:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2cba7442-d820-4c68-9024-66e8ca917678 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Acquiring lock "8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:59:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2cba7442-d820-4c68-9024-66e8ca917678 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:59:42 user nova-compute[231753]: INFO nova.compute.manager [None req-2cba7442-d820-4c68-9024-66e8ca917678 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Detaching volume 2fe62685-5be8-490e-bca1-bb093a073782
Jul 29 13:59:43 user nova-compute[231753]: INFO nova.virt.block_device [None req-2cba7442-d820-4c68-9024-66e8ca917678 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Attempting to driver detach volume 2fe62685-5be8-490e-bca1-bb093a073782 from mountpoint /dev/vdb
Jul 29 13:59:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2cba7442-d820-4c68-9024-66e8ca917678 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Attempting to detach device vdb from instance 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8 from the persistent domain config. {{(pid=231753) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-2cba7442-d820-4c68-9024-66e8ca917678 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:59:43 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:59:43 user nova-compute[231753]:   <source dev="/dev/sdc"/>
Jul 29 13:59:43 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:59:43 user nova-compute[231753]:   <serial>2fe62685-5be8-490e-bca1-bb093a073782</serial>
Jul 29 13:59:43 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 13:59:43 user nova-compute[231753]: </disk>
Jul 29 13:59:43 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:59:43 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-2cba7442-d820-4c68-9024-66e8ca917678 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Successfully detached device vdb from instance 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8 from the persistent domain config.
Jul 29 13:59:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2cba7442-d820-4c68-9024-66e8ca917678 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8 from the live domain config. {{(pid=231753) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-2cba7442-d820-4c68-9024-66e8ca917678 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 13:59:43 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 13:59:43 user nova-compute[231753]:   <source dev="/dev/sdc"/>
Jul 29 13:59:43 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 13:59:43 user nova-compute[231753]:   <serial>2fe62685-5be8-490e-bca1-bb093a073782</serial>
Jul 29 13:59:43 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 13:59:43 user nova-compute[231753]: </disk>
Jul 29 13:59:43 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Received event <DeviceRemovedEvent: 1690639183.5465496, 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=231753) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2cba7442-d820-4c68-9024-66e8ca917678 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8 {{(pid=231753) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 13:59:43 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-2cba7442-d820-4c68-9024-66e8ca917678 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Successfully detached device vdb from instance 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8 from the live domain config.
Jul 29 13:59:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cba7442-d820-4c68-9024-66e8ca917678 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cba7442-d820-4c68-9024-66e8ca917678 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'oZhragFu', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 13:59:43 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-2cba7442-d820-4c68-9024-66e8ca917678 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 13:59:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-2cba7442-d820-4c68-9024-66e8ca917678 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-2cba7442-d820-4c68-9024-66e8ca917678 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7775fcb-23cc-4873-961e-ff8e7544072c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cba7442-d820-4c68-9024-66e8ca917678 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 13:59:43 user nova-compute[231753]: No targets found.
Jul 29 13:59:43 user nova-compute[231753]: iSNS:
Jul 29 13:59:43 user nova-compute[231753]: No targets found.
Jul 29 13:59:43 user nova-compute[231753]: STATIC:
Jul 29 13:59:43 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26
Jul 29 13:59:43 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:59:43 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:59:43 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782
Jul 29 13:59:43 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 13:59:43 user nova-compute[231753]:                 Iface Name: default
Jul 29 13:59:43 user nova-compute[231753]: FIRMWARE:
Jul 29 13:59:43 user nova-compute[231753]: No targets found.
Jul 29 13:59:43 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cba7442-d820-4c68-9024-66e8ca917678 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 13:59:43 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 13:59:43 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cba7442-d820-4c68-9024-66e8ca917678 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[60a02b62-a559-425c-90ec-a032eabc2d00]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690639183.6121893, fa284c5d-fe31-493c-a3ed-1a015219cd48 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:59:43 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] VM Resumed (Lifecycle Event)
Jul 29 13:59:43 user nova-compute[231753]: DEBUG nova.compute.manager [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 13:59:43 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Instance spawned successfully.
Jul 29 13:59:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e54b97b9-f064-429b-865c-759e2d799947]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)\ntcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cba7442-d820-4c68-9024-66e8ca917678 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 13:59:43 user nova-compute[231753]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782 (non-flash)
Jul 29 13:59:43 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cba7442-d820-4c68-9024-66e8ca917678 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 13:59:43 user nova-compute[231753]: tcp: [52] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782 (non-flash)
Jul 29 13:59:43 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cba7442-d820-4c68-9024-66e8ca917678 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c9828f910>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782'): ({'sdc'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-2cba7442-d820-4c68-9024-66e8ca917678 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Removing single pathed devices sdc {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG nova.compute.manager [req-3fc4b656-324a-4f95-b523-dc78fcb6a334 req-1b059369-a73f-47a5-975f-6c5d24a26b8d service nova] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Received event network-vif-plugged-cb4d540c-5827-40aa-b326-bceba6df9833 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3fc4b656-324a-4f95-b523-dc78fcb6a334 req-1b059369-a73f-47a5-975f-6c5d24a26b8d service nova] Acquiring lock "fa284c5d-fe31-493c-a3ed-1a015219cd48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3fc4b656-324a-4f95-b523-dc78fcb6a334 req-1b059369-a73f-47a5-975f-6c5d24a26b8d service nova] Lock "fa284c5d-fe31-493c-a3ed-1a015219cd48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3fc4b656-324a-4f95-b523-dc78fcb6a334 req-1b059369-a73f-47a5-975f-6c5d24a26b8d service nova] Lock "fa284c5d-fe31-493c-a3ed-1a015219cd48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG nova.compute.manager [req-3fc4b656-324a-4f95-b523-dc78fcb6a334 req-1b059369-a73f-47a5-975f-6c5d24a26b8d service nova] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] No waiting events found dispatching network-vif-plugged-cb4d540c-5827-40aa-b326-bceba6df9833 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 13:59:43 user nova-compute[231753]: WARNING nova.compute.manager [req-3fc4b656-324a-4f95-b523-dc78fcb6a334 req-1b059369-a73f-47a5-975f-6c5d24a26b8d service nova] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Received unexpected event network-vif-plugged-cb4d540c-5827-40aa-b326-bceba6df9833 for instance with vm_state building and task_state spawning.
Jul 29 13:59:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d386d772-a732-4970-86b3-d8f29908d5a7]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:59:43 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:59:43 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690639183.6148577, fa284c5d-fe31-493c-a3ed-1a015219cd48 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 13:59:43 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] VM Started (Lifecycle Event)
Jul 29 13:59:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f98b60f2-62ae-4e2d-a974-65cf695c1b2f]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-2cba7442-d820-4c68-9024-66e8ca917678 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Flushing IO for device /dev/sdc {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf99cd9-86ba-4973-b125-3d806e3c1b9d]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-2cba7442-d820-4c68-9024-66e8ca917678 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:59:43 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 13:59:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.041s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0599368c-55d6-4cbc-a63c-82896fa384e9]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-2cba7442-d820-4c68-9024-66e8ca917678 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-2cba7442-d820-4c68-9024-66e8ca917678 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] SCSI volumes sdc have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cba7442-d820-4c68-9024-66e8ca917678 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:59:43 user nova-compute[231753]: INFO nova.compute.manager [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Took 6.24 seconds to spawn the instance on the hypervisor.
Jul 29 13:59:43 user nova-compute[231753]: DEBUG nova.compute.manager [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5bceb9-e6e4-4587-8777-d1111593d56b]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cba7442-d820-4c68-9024-66e8ca917678 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782 -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782 -p 172.16.0.220:3260 --logout" returned: 0 in 0.064s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0822c99e-c625-4801-8f13-845267b1f478]: (4, ('Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782, portal: 172.16.0.220,3260]\nLogout of [sid: 52, target: iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cba7442-d820-4c68-9024-66e8ca917678 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 52, target: iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782, portal: 172.16.0.220,3260]
Jul 29 13:59:43 user nova-compute[231753]: Logout of [sid: 52, target: iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782, portal: 172.16.0.220,3260] successful.
Jul 29 13:59:43 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:59:43 user nova-compute[231753]: INFO nova.compute.manager [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Took 6.84 seconds to build instance.
Jul 29 13:59:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782 -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:2fe62685-5be8-490e-bca1-bb093a073782 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0964c5d1-18d9-4ada-8700-78854171eb07]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cba7442-d820-4c68-9024-66e8ca917678 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-2cba7442-d820-4c68-9024-66e8ca917678 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.320s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2cba7442-d820-4c68-9024-66e8ca917678 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] <== disconnect_volume: return (320ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2cba7442-d820-4c68-9024-66e8ca917678 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 13:59:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-af8b6b97-a580-4eee-8cb8-dee87b891e45 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lock "fa284c5d-fe31-493c-a3ed-1a015219cd48" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.960s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:59:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:44 user nova-compute[231753]: DEBUG nova.objects.instance [None req-2cba7442-d820-4c68-9024-66e8ca917678 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lazy-loading 'flavor' on Instance uuid 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 13:59:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2cba7442-d820-4c68-9024-66e8ca917678 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.865s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 13:59:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:59:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:59:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 13:59:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=231753) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 13:59:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 13:59:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 13:59:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 13:59:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:00 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._sync_power_states {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:00:00 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Triggering sync for uuid 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8 {{(pid=231753) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 14:00:00 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Triggering sync for uuid 74e3894e-9c5e-410d-b122-2f733b779139 {{(pid=231753) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 14:00:00 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Triggering sync for uuid fa284c5d-fe31-493c-a3ed-1a015219cd48 {{(pid=231753) _sync_power_states /opt/stack/nova/nova/compute/manager.py:10252}}
Jul 29 14:00:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:00:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:00:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "74e3894e-9c5e-410d-b122-2f733b779139" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:00:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "74e3894e-9c5e-410d-b122-2f733b779139" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:00:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "fa284c5d-fe31-493c-a3ed-1a015219cd48" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:00:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "fa284c5d-fe31-493c-a3ed-1a015219cd48" acquired by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:00:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "74e3894e-9c5e-410d-b122-2f733b779139" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.035s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:00:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:00:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "fa284c5d-fe31-493c-a3ed-1a015219cd48" "released" by "nova.compute.manager.ComputeManager._sync_power_states.<locals>._sync.<locals>.query_driver_power_state_and_sync" :: held 0.037s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:00:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:06 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:13 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Acquiring lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:00:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:00:17 user nova-compute[231753]: DEBUG nova.compute.manager [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:00:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:00:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:00:17 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:00:17 user nova-compute[231753]: INFO nova.compute.claims [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Claim successful on node user
Jul 29 14:00:17 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:00:17 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:00:17 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.266s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:00:17 user nova-compute[231753]: DEBUG nova.compute.manager [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:00:18 user nova-compute[231753]: DEBUG nova.compute.manager [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:00:18 user nova-compute[231753]: DEBUG nova.network.neutron [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:00:18 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:00:18 user nova-compute[231753]: DEBUG nova.compute.manager [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:00:18 user nova-compute[231753]: DEBUG nova.policy [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '712c035f5bd24704be4a428557fe3694', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4c63557bedc94739802fe008139488ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:00:18 user nova-compute[231753]: DEBUG nova.compute.manager [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:00:18 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:00:18 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Creating image(s)
Jul 29 14:00:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Acquiring lock "/opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:00:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "/opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:00:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "/opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.005s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:00:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:00:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.132s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:00:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:00:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:00:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:00:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.139s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:00:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:00:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk 1073741824" returned: 0 in 0.057s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:00:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.203s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:00:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:00:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.137s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:00:18 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Checking if we can resize image /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 14:00:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:00:18 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:00:18 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Cannot resize image /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 14:00:18 user nova-compute[231753]: DEBUG nova.objects.instance [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lazy-loading 'migration_context' on Instance uuid 441fd0df-b5a0-498f-8d02-eb1db2f45b4c {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:00:18 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:00:18 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Ensure instance console log exists: /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:00:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:00:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:00:18 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:00:18 user nova-compute[231753]: DEBUG nova.network.neutron [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Successfully created port: e65ce885-2848-4c59-b069-2d3fffab8131 {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:00:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:19 user nova-compute[231753]: DEBUG nova.network.neutron [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Successfully updated port: e65ce885-2848-4c59-b069-2d3fffab8131 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:00:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Acquiring lock "refresh_cache-441fd0df-b5a0-498f-8d02-eb1db2f45b4c" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:00:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Acquired lock "refresh_cache-441fd0df-b5a0-498f-8d02-eb1db2f45b4c" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:00:19 user nova-compute[231753]: DEBUG nova.network.neutron [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:00:19 user nova-compute[231753]: DEBUG nova.network.neutron [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:00:19 user nova-compute[231753]: DEBUG nova.compute.manager [req-f729ad30-cfb1-4312-943b-c1570bcd13b1 req-f64ff117-d976-44b7-9de4-37c710cd0e98 service nova] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Received event network-changed-e65ce885-2848-4c59-b069-2d3fffab8131 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:00:19 user nova-compute[231753]: DEBUG nova.compute.manager [req-f729ad30-cfb1-4312-943b-c1570bcd13b1 req-f64ff117-d976-44b7-9de4-37c710cd0e98 service nova] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Refreshing instance network info cache due to event network-changed-e65ce885-2848-4c59-b069-2d3fffab8131. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:00:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-f729ad30-cfb1-4312-943b-c1570bcd13b1 req-f64ff117-d976-44b7-9de4-37c710cd0e98 service nova] Acquiring lock "refresh_cache-441fd0df-b5a0-498f-8d02-eb1db2f45b4c" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG nova.network.neutron [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Updating instance_info_cache with network_info: [{"id": "e65ce885-2848-4c59-b069-2d3fffab8131", "address": "fa:16:3e:8a:ab:14", "network": {"id": "e850e031-78cb-4491-bc2e-1558870dee53", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1563208818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c63557bedc94739802fe008139488ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65ce885-28", "ovs_interfaceid": "e65ce885-2848-4c59-b069-2d3fffab8131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Releasing lock "refresh_cache-441fd0df-b5a0-498f-8d02-eb1db2f45b4c" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG nova.compute.manager [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Instance network_info: |[{"id": "e65ce885-2848-4c59-b069-2d3fffab8131", "address": "fa:16:3e:8a:ab:14", "network": {"id": "e850e031-78cb-4491-bc2e-1558870dee53", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1563208818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c63557bedc94739802fe008139488ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65ce885-28", "ovs_interfaceid": "e65ce885-2848-4c59-b069-2d3fffab8131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-f729ad30-cfb1-4312-943b-c1570bcd13b1 req-f64ff117-d976-44b7-9de4-37c710cd0e98 service nova] Acquired lock "refresh_cache-441fd0df-b5a0-498f-8d02-eb1db2f45b4c" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG nova.network.neutron [req-f729ad30-cfb1-4312-943b-c1570bcd13b1 req-f64ff117-d976-44b7-9de4-37c710cd0e98 service nova] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Refreshing network info cache for port e65ce885-2848-4c59-b069-2d3fffab8131 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Start _get_guest_xml network_info=[{"id": "e65ce885-2848-4c59-b069-2d3fffab8131", "address": "fa:16:3e:8a:ab:14", "network": {"id": "e850e031-78cb-4491-bc2e-1558870dee53", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1563208818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c63557bedc94739802fe008139488ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65ce885-28", "ovs_interfaceid": "e65ce885-2848-4c59-b069-2d3fffab8131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:00:20 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:00:20 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:00:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:00:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-85259245',display_name='tempest-SnapshotDataIntegrityTests-server-85259245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-85259245',id=47,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6esz6S9abxI5rgKmwF/BDFhehRMXLrLc+7SStVHQeajZfoIXuWLPSNKYmH3peINRO44ZM78Au8AOSE2ojF+1oz/3Dw7M5GyRNH2nw7cnlN40dhnyCd8wIvRG+T92CXgg==',key_name='tempest-keypair-470384698',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c63557bedc94739802fe008139488ba',ramdisk_id='',reservation_id='r-qeo48rej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-327483512',owner_user_name='tempest-SnapshotDataIntegrityTests-327483512-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:00:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='712c035f5bd24704be4a428557fe3694',uuid=441fd0df-b5a0-498f-8d02-eb1db2f45b4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e65ce885-2848-4c59-b069-2d3fffab8131", "address": "fa:16:3e:8a:ab:14", "network": {"id": "e850e031-78cb-4491-bc2e-1558870dee53", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1563208818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c63557bedc94739802fe008139488ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65ce885-28", "ovs_interfaceid": "e65ce885-2848-4c59-b069-2d3fffab8131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Converting VIF {"id": "e65ce885-2848-4c59-b069-2d3fffab8131", "address": "fa:16:3e:8a:ab:14", "network": {"id": "e850e031-78cb-4491-bc2e-1558870dee53", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1563208818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c63557bedc94739802fe008139488ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65ce885-28", "ovs_interfaceid": "e65ce885-2848-4c59-b069-2d3fffab8131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:ab:14,bridge_name='br-int',has_traffic_filtering=True,id=e65ce885-2848-4c59-b069-2d3fffab8131,network=Network(e850e031-78cb-4491-bc2e-1558870dee53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape65ce885-28') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG nova.objects.instance [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lazy-loading 'pci_devices' on Instance uuid 441fd0df-b5a0-498f-8d02-eb1db2f45b4c {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:00:20 user nova-compute[231753]:   <uuid>441fd0df-b5a0-498f-8d02-eb1db2f45b4c</uuid>
Jul 29 14:00:20 user nova-compute[231753]:   <name>instance-0000002f</name>
Jul 29 14:00:20 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 14:00:20 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 14:00:20 user nova-compute[231753]:   <metadata>
Jul 29 14:00:20 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:00:20 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 14:00:20 user nova-compute[231753]:       <nova:name>tempest-SnapshotDataIntegrityTests-server-85259245</nova:name>
Jul 29 14:00:20 user nova-compute[231753]:       <nova:creationTime>2023-07-29 14:00:20</nova:creationTime>
Jul 29 14:00:20 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 14:00:20 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 14:00:20 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 14:00:20 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 14:00:20 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:00:20 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:00:20 user nova-compute[231753]:       </nova:flavor>
Jul 29 14:00:20 user nova-compute[231753]:       <nova:owner>
Jul 29 14:00:20 user nova-compute[231753]:         <nova:user uuid="712c035f5bd24704be4a428557fe3694">tempest-SnapshotDataIntegrityTests-327483512-project-member</nova:user>
Jul 29 14:00:20 user nova-compute[231753]:         <nova:project uuid="4c63557bedc94739802fe008139488ba">tempest-SnapshotDataIntegrityTests-327483512</nova:project>
Jul 29 14:00:20 user nova-compute[231753]:       </nova:owner>
Jul 29 14:00:20 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 14:00:20 user nova-compute[231753]:       <nova:ports>
Jul 29 14:00:20 user nova-compute[231753]:         <nova:port uuid="e65ce885-2848-4c59-b069-2d3fffab8131">
Jul 29 14:00:20 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 29 14:00:20 user nova-compute[231753]:         </nova:port>
Jul 29 14:00:20 user nova-compute[231753]:       </nova:ports>
Jul 29 14:00:20 user nova-compute[231753]:     </nova:instance>
Jul 29 14:00:20 user nova-compute[231753]:   </metadata>
Jul 29 14:00:20 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 14:00:20 user nova-compute[231753]:     <system>
Jul 29 14:00:20 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:00:20 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:00:20 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 14:00:20 user nova-compute[231753]:       <entry name="serial">441fd0df-b5a0-498f-8d02-eb1db2f45b4c</entry>
Jul 29 14:00:20 user nova-compute[231753]:       <entry name="uuid">441fd0df-b5a0-498f-8d02-eb1db2f45b4c</entry>
Jul 29 14:00:20 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:00:20 user nova-compute[231753]:     </system>
Jul 29 14:00:20 user nova-compute[231753]:   </sysinfo>
Jul 29 14:00:20 user nova-compute[231753]:   <os>
Jul 29 14:00:20 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:00:20 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 14:00:20 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 14:00:20 user nova-compute[231753]:   </os>
Jul 29 14:00:20 user nova-compute[231753]:   <features>
Jul 29 14:00:20 user nova-compute[231753]:     <acpi/>
Jul 29 14:00:20 user nova-compute[231753]:     <apic/>
Jul 29 14:00:20 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 14:00:20 user nova-compute[231753]:   </features>
Jul 29 14:00:20 user nova-compute[231753]:   <clock offset="utc">
Jul 29 14:00:20 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:00:20 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:00:20 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 14:00:20 user nova-compute[231753]:   </clock>
Jul 29 14:00:20 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 14:00:20 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 14:00:20 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:00:20 user nova-compute[231753]:   </cpu>
Jul 29 14:00:20 user nova-compute[231753]:   <devices>
Jul 29 14:00:20 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 14:00:20 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:00:20 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk"/>
Jul 29 14:00:20 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 14:00:20 user nova-compute[231753]:     </disk>
Jul 29 14:00:20 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 14:00:20 user nova-compute[231753]:       <mac address="fa:16:3e:8a:ab:14"/>
Jul 29 14:00:20 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 14:00:20 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 14:00:20 user nova-compute[231753]:       <target dev="tape65ce885-28"/>
Jul 29 14:00:20 user nova-compute[231753]:     </interface>
Jul 29 14:00:20 user nova-compute[231753]:     <serial type="pty">
Jul 29 14:00:20 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/console.log" append="off"/>
Jul 29 14:00:20 user nova-compute[231753]:     </serial>
Jul 29 14:00:20 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:00:20 user nova-compute[231753]:     <video>
Jul 29 14:00:20 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 14:00:20 user nova-compute[231753]:     </video>
Jul 29 14:00:20 user nova-compute[231753]:     <rng model="virtio">
Jul 29 14:00:20 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:00:20 user nova-compute[231753]:     </rng>
Jul 29 14:00:20 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:00:20 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 14:00:20 user nova-compute[231753]:       <stats period="10"/>
Jul 29 14:00:20 user nova-compute[231753]:     </memballoon>
Jul 29 14:00:20 user nova-compute[231753]:   </devices>
Jul 29 14:00:20 user nova-compute[231753]: </domain>
Jul 29 14:00:20 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:00:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-85259245',display_name='tempest-SnapshotDataIntegrityTests-server-85259245',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-85259245',id=47,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6esz6S9abxI5rgKmwF/BDFhehRMXLrLc+7SStVHQeajZfoIXuWLPSNKYmH3peINRO44ZM78Au8AOSE2ojF+1oz/3Dw7M5GyRNH2nw7cnlN40dhnyCd8wIvRG+T92CXgg==',key_name='tempest-keypair-470384698',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4c63557bedc94739802fe008139488ba',ramdisk_id='',reservation_id='r-qeo48rej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-SnapshotDataIntegrityTests-327483512',owner_user_name='tempest-SnapshotDataIntegrityTests-327483512-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:00:18Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='712c035f5bd24704be4a428557fe3694',uuid=441fd0df-b5a0-498f-8d02-eb1db2f45b4c,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "e65ce885-2848-4c59-b069-2d3fffab8131", "address": "fa:16:3e:8a:ab:14", "network": {"id": "e850e031-78cb-4491-bc2e-1558870dee53", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1563208818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c63557bedc94739802fe008139488ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65ce885-28", "ovs_interfaceid": "e65ce885-2848-4c59-b069-2d3fffab8131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Converting VIF {"id": "e65ce885-2848-4c59-b069-2d3fffab8131", "address": "fa:16:3e:8a:ab:14", "network": {"id": "e850e031-78cb-4491-bc2e-1558870dee53", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1563208818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c63557bedc94739802fe008139488ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65ce885-28", "ovs_interfaceid": "e65ce885-2848-4c59-b069-2d3fffab8131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:8a:ab:14,bridge_name='br-int',has_traffic_filtering=True,id=e65ce885-2848-4c59-b069-2d3fffab8131,network=Network(e850e031-78cb-4491-bc2e-1558870dee53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape65ce885-28') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG os_vif [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:ab:14,bridge_name='br-int',has_traffic_filtering=True,id=e65ce885-2848-4c59-b069-2d3fffab8131,network=Network(e850e031-78cb-4491-bc2e-1558870dee53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape65ce885-28') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tape65ce885-28, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tape65ce885-28, col_values=(('external_ids', {'iface-id': 'e65ce885-2848-4c59-b069-2d3fffab8131', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:8a:ab:14', 'vm-uuid': '441fd0df-b5a0-498f-8d02-eb1db2f45b4c'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:20 user nova-compute[231753]: INFO os_vif [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:8a:ab:14,bridge_name='br-int',has_traffic_filtering=True,id=e65ce885-2848-4c59-b069-2d3fffab8131,network=Network(e850e031-78cb-4491-bc2e-1558870dee53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape65ce885-28')
Jul 29 14:00:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] No VIF found with MAC fa:16:3e:8a:ab:14, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG nova.network.neutron [req-f729ad30-cfb1-4312-943b-c1570bcd13b1 req-f64ff117-d976-44b7-9de4-37c710cd0e98 service nova] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Updated VIF entry in instance network info cache for port e65ce885-2848-4c59-b069-2d3fffab8131. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG nova.network.neutron [req-f729ad30-cfb1-4312-943b-c1570bcd13b1 req-f64ff117-d976-44b7-9de4-37c710cd0e98 service nova] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Updating instance_info_cache with network_info: [{"id": "e65ce885-2848-4c59-b069-2d3fffab8131", "address": "fa:16:3e:8a:ab:14", "network": {"id": "e850e031-78cb-4491-bc2e-1558870dee53", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1563208818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c63557bedc94739802fe008139488ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65ce885-28", "ovs_interfaceid": "e65ce885-2848-4c59-b069-2d3fffab8131", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:00:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-f729ad30-cfb1-4312-943b-c1570bcd13b1 req-f64ff117-d976-44b7-9de4-37c710cd0e98 service nova] Releasing lock "refresh_cache-441fd0df-b5a0-498f-8d02-eb1db2f45b4c" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:00:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:21 user nova-compute[231753]: DEBUG nova.compute.manager [req-3801c3cc-4dee-4050-b967-1ee21d0e8778 req-1569017f-2c38-43de-a018-c5eb63fd2cf2 service nova] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Received event network-vif-plugged-e65ce885-2848-4c59-b069-2d3fffab8131 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:00:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3801c3cc-4dee-4050-b967-1ee21d0e8778 req-1569017f-2c38-43de-a018-c5eb63fd2cf2 service nova] Acquiring lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:00:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3801c3cc-4dee-4050-b967-1ee21d0e8778 req-1569017f-2c38-43de-a018-c5eb63fd2cf2 service nova] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:00:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3801c3cc-4dee-4050-b967-1ee21d0e8778 req-1569017f-2c38-43de-a018-c5eb63fd2cf2 service nova] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:00:21 user nova-compute[231753]: DEBUG nova.compute.manager [req-3801c3cc-4dee-4050-b967-1ee21d0e8778 req-1569017f-2c38-43de-a018-c5eb63fd2cf2 service nova] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] No waiting events found dispatching network-vif-plugged-e65ce885-2848-4c59-b069-2d3fffab8131 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:00:21 user nova-compute[231753]: WARNING nova.compute.manager [req-3801c3cc-4dee-4050-b967-1ee21d0e8778 req-1569017f-2c38-43de-a018-c5eb63fd2cf2 service nova] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Received unexpected event network-vif-plugged-e65ce885-2848-4c59-b069-2d3fffab8131 for instance with vm_state building and task_state spawning.
Jul 29 14:00:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:22 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:00:23 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690639223.784708, 441fd0df-b5a0-498f-8d02-eb1db2f45b4c => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:00:23 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] VM Resumed (Lifecycle Event)
Jul 29 14:00:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:00:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:00:23 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Instance spawned successfully.
Jul 29 14:00:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:00:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:00:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:00:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:00:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:00:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:00:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:00:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:00:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:00:23 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:00:23 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690639223.787278, 441fd0df-b5a0-498f-8d02-eb1db2f45b4c => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:00:23 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] VM Started (Lifecycle Event)
Jul 29 14:00:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:00:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:00:23 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:00:23 user nova-compute[231753]: INFO nova.compute.manager [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Took 5.71 seconds to spawn the instance on the hypervisor.
Jul 29 14:00:23 user nova-compute[231753]: DEBUG nova.compute.manager [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:00:23 user nova-compute[231753]: DEBUG nova.compute.manager [req-1b915ace-e0ad-49a8-99e6-9abf98135993 req-59f2dce7-bb64-4999-98f5-79f5b344da3f service nova] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Received event network-vif-plugged-e65ce885-2848-4c59-b069-2d3fffab8131 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:00:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-1b915ace-e0ad-49a8-99e6-9abf98135993 req-59f2dce7-bb64-4999-98f5-79f5b344da3f service nova] Acquiring lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:00:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-1b915ace-e0ad-49a8-99e6-9abf98135993 req-59f2dce7-bb64-4999-98f5-79f5b344da3f service nova] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:00:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-1b915ace-e0ad-49a8-99e6-9abf98135993 req-59f2dce7-bb64-4999-98f5-79f5b344da3f service nova] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:00:23 user nova-compute[231753]: DEBUG nova.compute.manager [req-1b915ace-e0ad-49a8-99e6-9abf98135993 req-59f2dce7-bb64-4999-98f5-79f5b344da3f service nova] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] No waiting events found dispatching network-vif-plugged-e65ce885-2848-4c59-b069-2d3fffab8131 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:00:23 user nova-compute[231753]: WARNING nova.compute.manager [req-1b915ace-e0ad-49a8-99e6-9abf98135993 req-59f2dce7-bb64-4999-98f5-79f5b344da3f service nova] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Received unexpected event network-vif-plugged-e65ce885-2848-4c59-b069-2d3fffab8131 for instance with vm_state building and task_state spawning.
Jul 29 14:00:23 user nova-compute[231753]: INFO nova.compute.manager [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Took 6.28 seconds to build instance.
Jul 29 14:00:24 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-38aca1fb-b915-47fe-a52b-c33a70356a10 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.369s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:00:24 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:00:24 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 14:00:24 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Didn't find any instances for network info cache update. {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 29 14:00:24 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:00:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:26 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:00:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:00:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:00:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:00:26 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 14:00:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:00:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk --force-share --output=json" returned: 0 in 0.143s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:00:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:00:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk --force-share --output=json" returned: 0 in 0.183s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:00:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa284c5d-fe31-493c-a3ed-1a015219cd48/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:00:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa284c5d-fe31-493c-a3ed-1a015219cd48/disk --force-share --output=json" returned: 0 in 0.146s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:00:26 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa284c5d-fe31-493c-a3ed-1a015219cd48/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:00:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa284c5d-fe31-493c-a3ed-1a015219cd48/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:00:27 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:00:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:00:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:00:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:00:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:00:27 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:00:27 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:00:27 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=8243MB free_disk=25.13143539428711GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 14:00:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:00:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:00:27 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:00:27 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 74e3894e-9c5e-410d-b122-2f733b779139 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:00:27 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance fa284c5d-fe31-493c-a3ed-1a015219cd48 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:00:27 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 441fd0df-b5a0-498f-8d02-eb1db2f45b4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:00:27 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 14:00:27 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=3GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 14:00:28 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:00:28 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:00:28 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 14:00:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.280s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:00:29 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:00:29 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 14:00:29 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:00:29 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:00:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:30 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:00:30 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:31 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:00:35 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:35 user nova-compute[231753]: DEBUG nova.compute.manager [req-5c0e4694-1305-4a99-9855-94655c852bbf req-79db9040-a0d8-4eb6-b7b3-2b2578b3d0a6 service nova] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Received event network-changed-e254ed91-f2a2-4bec-b192-21f7e544cc23 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:00:35 user nova-compute[231753]: DEBUG nova.compute.manager [req-5c0e4694-1305-4a99-9855-94655c852bbf req-79db9040-a0d8-4eb6-b7b3-2b2578b3d0a6 service nova] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Refreshing instance network info cache due to event network-changed-e254ed91-f2a2-4bec-b192-21f7e544cc23. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:00:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5c0e4694-1305-4a99-9855-94655c852bbf req-79db9040-a0d8-4eb6-b7b3-2b2578b3d0a6 service nova] Acquiring lock "refresh_cache-74e3894e-9c5e-410d-b122-2f733b779139" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:00:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5c0e4694-1305-4a99-9855-94655c852bbf req-79db9040-a0d8-4eb6-b7b3-2b2578b3d0a6 service nova] Acquired lock "refresh_cache-74e3894e-9c5e-410d-b122-2f733b779139" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:00:35 user nova-compute[231753]: DEBUG nova.network.neutron [req-5c0e4694-1305-4a99-9855-94655c852bbf req-79db9040-a0d8-4eb6-b7b3-2b2578b3d0a6 service nova] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Refreshing network info cache for port e254ed91-f2a2-4bec-b192-21f7e544cc23 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:00:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "74e3894e-9c5e-410d-b122-2f733b779139" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:00:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "74e3894e-9c5e-410d-b122-2f733b779139" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:00:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "74e3894e-9c5e-410d-b122-2f733b779139-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:00:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "74e3894e-9c5e-410d-b122-2f733b779139-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:00:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "74e3894e-9c5e-410d-b122-2f733b779139-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:00:35 user nova-compute[231753]: INFO nova.compute.manager [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Terminating instance
Jul 29 14:00:35 user nova-compute[231753]: DEBUG nova.compute.manager [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 14:00:35 user nova-compute[231753]: DEBUG nova.network.neutron [req-5c0e4694-1305-4a99-9855-94655c852bbf req-79db9040-a0d8-4eb6-b7b3-2b2578b3d0a6 service nova] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Updated VIF entry in instance network info cache for port e254ed91-f2a2-4bec-b192-21f7e544cc23. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:00:35 user nova-compute[231753]: DEBUG nova.network.neutron [req-5c0e4694-1305-4a99-9855-94655c852bbf req-79db9040-a0d8-4eb6-b7b3-2b2578b3d0a6 service nova] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Updating instance_info_cache with network_info: [{"id": "e254ed91-f2a2-4bec-b192-21f7e544cc23", "address": "fa:16:3e:5f:33:c2", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.10", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape254ed91-f2", "ovs_interfaceid": "e254ed91-f2a2-4bec-b192-21f7e544cc23", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5c0e4694-1305-4a99-9855-94655c852bbf req-79db9040-a0d8-4eb6-b7b3-2b2578b3d0a6 service nova] Releasing lock "refresh_cache-74e3894e-9c5e-410d-b122-2f733b779139" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG nova.compute.manager [req-6e3666b1-333d-4992-b635-b2c34c1ba4f4 req-d27ce008-1378-495d-9a82-9fa6ce732df5 service nova] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Received event network-vif-unplugged-e254ed91-f2a2-4bec-b192-21f7e544cc23 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6e3666b1-333d-4992-b635-b2c34c1ba4f4 req-d27ce008-1378-495d-9a82-9fa6ce732df5 service nova] Acquiring lock "74e3894e-9c5e-410d-b122-2f733b779139-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6e3666b1-333d-4992-b635-b2c34c1ba4f4 req-d27ce008-1378-495d-9a82-9fa6ce732df5 service nova] Lock "74e3894e-9c5e-410d-b122-2f733b779139-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6e3666b1-333d-4992-b635-b2c34c1ba4f4 req-d27ce008-1378-495d-9a82-9fa6ce732df5 service nova] Lock "74e3894e-9c5e-410d-b122-2f733b779139-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG nova.compute.manager [req-6e3666b1-333d-4992-b635-b2c34c1ba4f4 req-d27ce008-1378-495d-9a82-9fa6ce732df5 service nova] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] No waiting events found dispatching network-vif-unplugged-e254ed91-f2a2-4bec-b192-21f7e544cc23 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG nova.compute.manager [req-6e3666b1-333d-4992-b635-b2c34c1ba4f4 req-d27ce008-1378-495d-9a82-9fa6ce732df5 service nova] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Received event network-vif-unplugged-e254ed91-f2a2-4bec-b192-21f7e544cc23 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:36 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Instance destroyed successfully.
Jul 29 14:00:36 user nova-compute[231753]: DEBUG nova.objects.instance [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lazy-loading 'resources' on Instance uuid 74e3894e-9c5e-410d-b122-2f733b779139 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:58:42Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-412240626',display_name='tempest-TestVolumeBootPattern-server-412240626',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-412240626',id=45,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtoigQ7m5duqzfsiAOyArrbvva1hS5wetlA/wlY5VxGp3gb7rI+IjO+yTaKkT8nB18YhdDg3ru+M38WK4CdhiGgmsEXaLAhkk+kUuZmxu7gpTgpEVOFzr1YWb8fNF9FBQ==',key_name='tempest-TestVolumeBootPattern-1166783581',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:58:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f45c92d3fe964066b9be87489b2c9f7e',ramdisk_id='',reservation_id='r-okorzf00',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-434673895',owner_user_name='tempest-TestVolumeBootPattern-434673895-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:58:56Z,user_data=None,user_id='d94a7ea0c19845b886e12c1689cf30a8',uuid=74e3894e-9c5e-410d-b122-2f733b779139,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e254ed91-f2a2-4bec-b192-21f7e544cc23", "address": "fa:16:3e:5f:33:c2", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape254ed91-f2", "ovs_interfaceid": "e254ed91-f2a2-4bec-b192-21f7e544cc23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Converting VIF {"id": "e254ed91-f2a2-4bec-b192-21f7e544cc23", "address": "fa:16:3e:5f:33:c2", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape254ed91-f2", "ovs_interfaceid": "e254ed91-f2a2-4bec-b192-21f7e544cc23", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5f:33:c2,bridge_name='br-int',has_traffic_filtering=True,id=e254ed91-f2a2-4bec-b192-21f7e544cc23,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape254ed91-f2') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG os_vif [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:33:c2,bridge_name='br-int',has_traffic_filtering=True,id=e254ed91-f2a2-4bec-b192-21f7e544cc23,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape254ed91-f2') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape254ed91-f2, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:36 user nova-compute[231753]: INFO os_vif [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5f:33:c2,bridge_name='br-int',has_traffic_filtering=True,id=e254ed91-f2a2-4bec-b192-21f7e544cc23,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape254ed91-f2')
Jul 29 14:00:36 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGMAFhqZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:00:36 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:00:36 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f815d42c-2988-4725-845b-49b6476eab09]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 14:00:36 user nova-compute[231753]: No targets found.
Jul 29 14:00:36 user nova-compute[231753]: iSNS:
Jul 29 14:00:36 user nova-compute[231753]: No targets found.
Jul 29 14:00:36 user nova-compute[231753]: STATIC:
Jul 29 14:00:36 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26
Jul 29 14:00:36 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 14:00:36 user nova-compute[231753]:                 Iface Name: default
Jul 29 14:00:36 user nova-compute[231753]: FIRMWARE:
Jul 29 14:00:36 user nova-compute[231753]: No targets found.
Jul 29 14:00:36 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 14:00:36 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 14:00:36 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b505dec5-3846-4d32-be31-ef5c23ec1183]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ec21ed1-2118-4a9d-b75d-93eeff38a9c5]: (4, ('tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:00:36 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsi session list stdout=tcp: [51] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:00:36 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c802d3640>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26'): ({'sdb'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Removing single pathed devices sdb {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6245a9eb-2723-4992-a7bd-fdfdf23155c3]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[404cf2ab-774c-47d1-9837-49fae10ad131]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Flushing IO for device /dev/sdb {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b4badd6-421f-417e-b3a5-31017e68de7e]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:00:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:00:37 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.039s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:00:37 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8574a2-1991-4869-87de-27e57804036a]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:00:37 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:00:37 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] SCSI volumes sdb have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:00:37 user nova-compute[231753]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-1SCST_BIOe2b4334e-e0026ed1f27c676e', '/dev/disk/by-id/scsi-26530303236656431', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_e2b4334e') {{(pid=242780) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 29 14:00:37 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f658274-8f5e-4257-bbaf-d91cc632d827]: (4, None) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:00:37 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:00:37 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:00:37 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:00:37 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6ae6fce-e460-4e7e-a3b7-0d8a59a54f8e]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:00:37 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:00:37 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:00:37 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --logout" returned: 0 in 0.063s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:00:37 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbee0452-afee-4821-a090-9cda278f9b62]: (4, ('Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26, portal: 172.16.0.220,3260]\nLogout of [sid: 51, target: iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:00:37 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 51, target: iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26, portal: 172.16.0.220,3260]
Jul 29 14:00:37 user nova-compute[231753]: Logout of [sid: 51, target: iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26, portal: 172.16.0.220,3260] successful.
Jul 29 14:00:37 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:00:37 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:00:37 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:00:37 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[123ef1d5-6639-42e8-9161-478aa9b09db4]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:00:37 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:00:37 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.324s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:00:37 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] <== disconnect_volume: return (326ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:00:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:00:37 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Deleting instance files /opt/stack/data/nova/instances/74e3894e-9c5e-410d-b122-2f733b779139_del
Jul 29 14:00:37 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Deletion of /opt/stack/data/nova/instances/74e3894e-9c5e-410d-b122-2f733b779139_del complete
Jul 29 14:00:37 user nova-compute[231753]: INFO nova.compute.manager [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Took 1.25 seconds to destroy the instance on the hypervisor.
Jul 29 14:00:37 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 14:00:37 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 14:00:37 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 14:00:38 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:00:38 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Took 0.90 seconds to deallocate network for instance.
Jul 29 14:00:38 user nova-compute[231753]: DEBUG nova.compute.manager [req-5a0107b7-6ff5-4aa5-ae98-7f983c826716 req-79ae1d80-7d08-477d-b7ad-bbcb0422330a service nova] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Received event network-vif-plugged-e254ed91-f2a2-4bec-b192-21f7e544cc23 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:00:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5a0107b7-6ff5-4aa5-ae98-7f983c826716 req-79ae1d80-7d08-477d-b7ad-bbcb0422330a service nova] Acquiring lock "74e3894e-9c5e-410d-b122-2f733b779139-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:00:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5a0107b7-6ff5-4aa5-ae98-7f983c826716 req-79ae1d80-7d08-477d-b7ad-bbcb0422330a service nova] Lock "74e3894e-9c5e-410d-b122-2f733b779139-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:00:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5a0107b7-6ff5-4aa5-ae98-7f983c826716 req-79ae1d80-7d08-477d-b7ad-bbcb0422330a service nova] Lock "74e3894e-9c5e-410d-b122-2f733b779139-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:00:38 user nova-compute[231753]: DEBUG nova.compute.manager [req-5a0107b7-6ff5-4aa5-ae98-7f983c826716 req-79ae1d80-7d08-477d-b7ad-bbcb0422330a service nova] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] No waiting events found dispatching network-vif-plugged-e254ed91-f2a2-4bec-b192-21f7e544cc23 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:00:38 user nova-compute[231753]: WARNING nova.compute.manager [req-5a0107b7-6ff5-4aa5-ae98-7f983c826716 req-79ae1d80-7d08-477d-b7ad-bbcb0422330a service nova] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Received unexpected event network-vif-plugged-e254ed91-f2a2-4bec-b192-21f7e544cc23 for instance with vm_state active and task_state deleting.
Jul 29 14:00:38 user nova-compute[231753]: DEBUG nova.compute.manager [req-5a0107b7-6ff5-4aa5-ae98-7f983c826716 req-79ae1d80-7d08-477d-b7ad-bbcb0422330a service nova] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Received event network-vif-deleted-e254ed91-f2a2-4bec-b192-21f7e544cc23 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:00:38 user nova-compute[231753]: INFO nova.compute.manager [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Took 0.72 seconds to detach 1 volumes for instance.
Jul 29 14:00:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:00:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:00:39 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:00:39 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:00:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.192s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:00:39 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Deleted allocations for instance 74e3894e-9c5e-410d-b122-2f733b779139
Jul 29 14:00:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-991ecfd9-d7c0-40f4-9104-f23b1d546ae6 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "74e3894e-9c5e-410d-b122-2f733b779139" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 3.230s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:00:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:39 user nova-compute[231753]: DEBUG nova.compute.manager [None req-15de92e8-767d-4175-899a-008bde608e97 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:00:39 user nova-compute[231753]: INFO nova.compute.manager [None req-15de92e8-767d-4175-899a-008bde608e97 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] instance snapshotting
Jul 29 14:00:39 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-15de92e8-767d-4175-899a-008bde608e97 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Beginning live snapshot process
Jul 29 14:00:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-15de92e8-767d-4175-899a-008bde608e97 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk --force-share --output=json -f qcow2 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:00:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-15de92e8-767d-4175-899a-008bde608e97 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk --force-share --output=json -f qcow2" returned: 0 in 0.131s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:00:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-15de92e8-767d-4175-899a-008bde608e97 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk --force-share --output=json -f qcow2 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:00:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-15de92e8-767d-4175-899a-008bde608e97 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk --force-share --output=json -f qcow2" returned: 0 in 0.130s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:00:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-15de92e8-767d-4175-899a-008bde608e97 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:00:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-15de92e8-767d-4175-899a-008bde608e97 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.140s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:00:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-15de92e8-767d-4175-899a-008bde608e97 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpq7pqdz39/20cb84a5756a499c915af402f991d293.delta 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:00:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-15de92e8-767d-4175-899a-008bde608e97 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpq7pqdz39/20cb84a5756a499c915af402f991d293.delta 1073741824" returned: 0 in 0.051s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:00:40 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-15de92e8-767d-4175-899a-008bde608e97 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Quiescing instance not available: QEMU guest agent is not enabled.
Jul 29 14:00:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-15de92e8-767d-4175-899a-008bde608e97 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] COPY block job progress, current cursor: 0 final cursor: 75563008 {{(pid=231753) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 14:00:41 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-15de92e8-767d-4175-899a-008bde608e97 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] COPY block job progress, current cursor: 25231360 final cursor: 75563008 {{(pid=231753) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 14:00:41 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:41 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-15de92e8-767d-4175-899a-008bde608e97 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] COPY block job progress, current cursor: 75563008 final cursor: 75563008 {{(pid=231753) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:846}}
Jul 29 14:00:41 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-15de92e8-767d-4175-899a-008bde608e97 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Skipping quiescing instance: QEMU guest agent is not enabled.
Jul 29 14:00:41 user nova-compute[231753]: DEBUG nova.privsep.utils [None req-15de92e8-767d-4175-899a-008bde608e97 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=231753) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 29 14:00:41 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-15de92e8-767d-4175-899a-008bde608e97 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpq7pqdz39/20cb84a5756a499c915af402f991d293.delta /opt/stack/data/nova/instances/snapshots/tmpq7pqdz39/20cb84a5756a499c915af402f991d293 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:00:42 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-15de92e8-767d-4175-899a-008bde608e97 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpq7pqdz39/20cb84a5756a499c915af402f991d293.delta /opt/stack/data/nova/instances/snapshots/tmpq7pqdz39/20cb84a5756a499c915af402f991d293" returned: 0 in 0.613s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:00:42 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-15de92e8-767d-4175-899a-008bde608e97 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Snapshot extracted, beginning image upload
Jul 29 14:00:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:44 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-15de92e8-767d-4175-899a-008bde608e97 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Snapshot image upload complete
Jul 29 14:00:44 user nova-compute[231753]: INFO nova.compute.manager [None req-15de92e8-767d-4175-899a-008bde608e97 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Took 5.43 seconds to snapshot the instance on the hypervisor.
Jul 29 14:00:46 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Acquiring lock "4db109e2-0918-42d4-9b19-4a0c72a08370" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:00:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "4db109e2-0918-42d4-9b19-4a0c72a08370" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:00:47 user nova-compute[231753]: DEBUG nova.compute.manager [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:00:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:00:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:00:47 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:00:47 user nova-compute[231753]: INFO nova.compute.claims [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Claim successful on node user
Jul 29 14:00:47 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:00:47 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:00:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.324s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:00:47 user nova-compute[231753]: DEBUG nova.compute.manager [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:00:47 user nova-compute[231753]: DEBUG nova.compute.manager [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:00:47 user nova-compute[231753]: DEBUG nova.network.neutron [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:00:47 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:00:47 user nova-compute[231753]: DEBUG nova.compute.manager [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:00:48 user nova-compute[231753]: DEBUG nova.compute.manager [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:00:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:00:48 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Creating image(s)
Jul 29 14:00:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Acquiring lock "/opt/stack/data/nova/instances/4db109e2-0918-42d4-9b19-4a0c72a08370/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:00:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "/opt/stack/data/nova/instances/4db109e2-0918-42d4-9b19-4a0c72a08370/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:00:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "/opt/stack/data/nova/instances/4db109e2-0918-42d4-9b19-4a0c72a08370/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.007s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:00:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Acquiring lock "cbff7603eea91e689a2e72db13e209de79677a17" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:00:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "cbff7603eea91e689a2e72db13e209de79677a17" acquired by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:00:48 user nova-compute[231753]: DEBUG nova.policy [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'fe8dbee1098a44418ba739f073503497', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '28da183a39e9413ebf7f0bc22ea1ae5d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:00:48 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbff7603eea91e689a2e72db13e209de79677a17.part --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:00:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbff7603eea91e689a2e72db13e209de79677a17.part --force-share --output=json" returned: 0 in 0.173s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:00:49 user nova-compute[231753]: DEBUG nova.virt.images [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] 5ada5696-44e9-4176-8af1-bdda4a22791d was qcow2, converting to raw {{(pid=231753) fetch_to_raw /opt/stack/nova/nova/virt/images.py:165}}
Jul 29 14:00:49 user nova-compute[231753]: DEBUG nova.privsep.utils [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=231753) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}}
Jul 29 14:00:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cbff7603eea91e689a2e72db13e209de79677a17.part /opt/stack/data/nova/instances/_base/cbff7603eea91e689a2e72db13e209de79677a17.converted {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:00:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:49 user nova-compute[231753]: DEBUG nova.network.neutron [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Successfully created port: 3b1ceda0-41f5-4ce0-b4f8-948252b2af4c {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:00:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/cbff7603eea91e689a2e72db13e209de79677a17.part /opt/stack/data/nova/instances/_base/cbff7603eea91e689a2e72db13e209de79677a17.converted" returned: 0 in 0.667s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:00:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbff7603eea91e689a2e72db13e209de79677a17.converted --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:00:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbff7603eea91e689a2e72db13e209de79677a17.converted --force-share --output=json" returned: 0 in 0.141s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:00:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "cbff7603eea91e689a2e72db13e209de79677a17" "released" by "nova.virt.libvirt.imagebackend.Image.cache.<locals>.fetch_func_sync" :: held 1.896s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:00:49 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbff7603eea91e689a2e72db13e209de79677a17 --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:00:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbff7603eea91e689a2e72db13e209de79677a17 --force-share --output=json" returned: 0 in 0.165s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:00:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Acquiring lock "cbff7603eea91e689a2e72db13e209de79677a17" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:00:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "cbff7603eea91e689a2e72db13e209de79677a17" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:00:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbff7603eea91e689a2e72db13e209de79677a17 --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:00:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbff7603eea91e689a2e72db13e209de79677a17 --force-share --output=json" returned: 0 in 0.153s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:00:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbff7603eea91e689a2e72db13e209de79677a17,backing_fmt=raw /opt/stack/data/nova/instances/4db109e2-0918-42d4-9b19-4a0c72a08370/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:00:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/cbff7603eea91e689a2e72db13e209de79677a17,backing_fmt=raw /opt/stack/data/nova/instances/4db109e2-0918-42d4-9b19-4a0c72a08370/disk 1073741824" returned: 0 in 0.110s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:00:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "cbff7603eea91e689a2e72db13e209de79677a17" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.271s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:00:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbff7603eea91e689a2e72db13e209de79677a17 --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:00:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/cbff7603eea91e689a2e72db13e209de79677a17 --force-share --output=json" returned: 0 in 0.141s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:00:50 user nova-compute[231753]: DEBUG nova.objects.instance [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lazy-loading 'migration_context' on Instance uuid 4db109e2-0918-42d4-9b19-4a0c72a08370 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:00:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:00:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Ensure instance console log exists: /opt/stack/data/nova/instances/4db109e2-0918-42d4-9b19-4a0c72a08370/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:00:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:00:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:00:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.network.neutron [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Successfully updated port: 3b1ceda0-41f5-4ce0-b4f8-948252b2af4c {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Acquiring lock "refresh_cache-4db109e2-0918-42d4-9b19-4a0c72a08370" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Acquired lock "refresh_cache-4db109e2-0918-42d4-9b19-4a0c72a08370" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.network.neutron [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.compute.manager [req-3f214975-70b1-4b0c-ad6f-3a6efe8abfda req-3d20b82b-e993-4bfd-91ed-55d2d7f73c65 service nova] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Received event network-changed-3b1ceda0-41f5-4ce0-b4f8-948252b2af4c {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.compute.manager [req-3f214975-70b1-4b0c-ad6f-3a6efe8abfda req-3d20b82b-e993-4bfd-91ed-55d2d7f73c65 service nova] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Refreshing instance network info cache due to event network-changed-3b1ceda0-41f5-4ce0-b4f8-948252b2af4c. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3f214975-70b1-4b0c-ad6f-3a6efe8abfda req-3d20b82b-e993-4bfd-91ed-55d2d7f73c65 service nova] Acquiring lock "refresh_cache-4db109e2-0918-42d4-9b19-4a0c72a08370" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.network.neutron [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.network.neutron [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Updating instance_info_cache with network_info: [{"id": "3b1ceda0-41f5-4ce0-b4f8-948252b2af4c", "address": "fa:16:3e:ce:b9:59", "network": {"id": "a10f7c69-0720-46b5-b252-6523dc61a6ca", "bridge": "br-int", "label": "tempest-TestStampPattern-1661615052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28da183a39e9413ebf7f0bc22ea1ae5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1ceda0-41", "ovs_interfaceid": "3b1ceda0-41f5-4ce0-b4f8-948252b2af4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Releasing lock "refresh_cache-4db109e2-0918-42d4-9b19-4a0c72a08370" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.compute.manager [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Instance network_info: |[{"id": "3b1ceda0-41f5-4ce0-b4f8-948252b2af4c", "address": "fa:16:3e:ce:b9:59", "network": {"id": "a10f7c69-0720-46b5-b252-6523dc61a6ca", "bridge": "br-int", "label": "tempest-TestStampPattern-1661615052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28da183a39e9413ebf7f0bc22ea1ae5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1ceda0-41", "ovs_interfaceid": "3b1ceda0-41f5-4ce0-b4f8-948252b2af4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3f214975-70b1-4b0c-ad6f-3a6efe8abfda req-3d20b82b-e993-4bfd-91ed-55d2d7f73c65 service nova] Acquired lock "refresh_cache-4db109e2-0918-42d4-9b19-4a0c72a08370" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.network.neutron [req-3f214975-70b1-4b0c-ad6f-3a6efe8abfda req-3d20b82b-e993-4bfd-91ed-55d2d7f73c65 service nova] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Refreshing network info cache for port 3b1ceda0-41f5-4ce0-b4f8-948252b2af4c {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Start _get_guest_xml network_info=[{"id": "3b1ceda0-41f5-4ce0-b4f8-948252b2af4c", "address": "fa:16:3e:ce:b9:59", "network": {"id": "a10f7c69-0720-46b5-b252-6523dc61a6ca", "bridge": "br-int", "label": "tempest-TestStampPattern-1661615052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28da183a39e9413ebf7f0bc22ea1ae5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1ceda0-41", "ovs_interfaceid": "3b1ceda0-41f5-4ce0-b4f8-948252b2af4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='35c0f365b4a98b11ed390507d30137b3',container_format='bare',created_at=2023-07-29T14:00:39Z,direct_url=<?>,disk_format='qcow2',id=5ada5696-44e9-4176-8af1-bdda4a22791d,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-676998311',owner='28da183a39e9413ebf7f0bc22ea1ae5d',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-29T14:00:45Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': '5ada5696-44e9-4176-8af1-bdda4a22791d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:00:51 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:00:51 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='35c0f365b4a98b11ed390507d30137b3',container_format='bare',created_at=2023-07-29T14:00:39Z,direct_url=<?>,disk_format='qcow2',id=5ada5696-44e9-4176-8af1-bdda4a22791d,min_disk=1,min_ram=0,name='tempest-TestStampPatternsnapshot-676998311',owner='28da183a39e9413ebf7f0bc22ea1ae5d',properties=ImageMetaProps,protected=<?>,size=52363264,status='active',tags=<?>,updated_at=2023-07-29T14:00:45Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:00:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2065518186',display_name='tempest-TestStampPattern-server-2065518186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2065518186',id=48,image_ref='5ada5696-44e9-4176-8af1-bdda4a22791d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJ0UCuB1s/FcIxNR+PeaL27O4FLCSRuPA3sNGjkAYL2ft4zG9hnQn3p/NaR8N5IEf65ITJPm24CQQ3JghZ9yGOSsBJ6AidP6UmfWpGZKzXSpLz9fY7+5vRgRPmfh/cMFA==',key_name='tempest-TestStampPattern-2343879',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28da183a39e9413ebf7f0bc22ea1ae5d',ramdisk_id='',reservation_id='r-2z0i9pmu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='8e8d1ee0-4906-4411-a1fd-c5997a22b5e8',image_min_disk='1',image_min_ram='0',image_owner_id='28da183a39e9413ebf7f0bc22ea1ae5d',image_owner_project_name='tempest-TestStampPattern-442563326',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-442563326-project-member',image_user_id='fe8dbee1098a44418ba739f073503497',network_allocated='True',owner_project_name='tempest-TestStampPattern-442563326',owner_user_name='tempest-TestStampPattern-442563326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:00:48Z,user_data=None,user_id='fe8dbee1098a44418ba739f073503497',uuid=4db109e2-0918-42d4-9b19-4a0c72a08370,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b1ceda0-41f5-4ce0-b4f8-948252b2af4c", "address": "fa:16:3e:ce:b9:59", "network": {"id": "a10f7c69-0720-46b5-b252-6523dc61a6ca", "bridge": "br-int", "label": "tempest-TestStampPattern-1661615052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28da183a39e9413ebf7f0bc22ea1ae5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1ceda0-41", "ovs_interfaceid": "3b1ceda0-41f5-4ce0-b4f8-948252b2af4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Converting VIF {"id": "3b1ceda0-41f5-4ce0-b4f8-948252b2af4c", "address": "fa:16:3e:ce:b9:59", "network": {"id": "a10f7c69-0720-46b5-b252-6523dc61a6ca", "bridge": "br-int", "label": "tempest-TestStampPattern-1661615052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28da183a39e9413ebf7f0bc22ea1ae5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1ceda0-41", "ovs_interfaceid": "3b1ceda0-41f5-4ce0-b4f8-948252b2af4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:b9:59,bridge_name='br-int',has_traffic_filtering=True,id=3b1ceda0-41f5-4ce0-b4f8-948252b2af4c,network=Network(a10f7c69-0720-46b5-b252-6523dc61a6ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b1ceda0-41') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.objects.instance [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lazy-loading 'pci_devices' on Instance uuid 4db109e2-0918-42d4-9b19-4a0c72a08370 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:00:51 user nova-compute[231753]:   <uuid>4db109e2-0918-42d4-9b19-4a0c72a08370</uuid>
Jul 29 14:00:51 user nova-compute[231753]:   <name>instance-00000030</name>
Jul 29 14:00:51 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 14:00:51 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 14:00:51 user nova-compute[231753]:   <metadata>
Jul 29 14:00:51 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:00:51 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 14:00:51 user nova-compute[231753]:       <nova:name>tempest-TestStampPattern-server-2065518186</nova:name>
Jul 29 14:00:51 user nova-compute[231753]:       <nova:creationTime>2023-07-29 14:00:51</nova:creationTime>
Jul 29 14:00:51 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 14:00:51 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 14:00:51 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 14:00:51 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 14:00:51 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:00:51 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:00:51 user nova-compute[231753]:       </nova:flavor>
Jul 29 14:00:51 user nova-compute[231753]:       <nova:owner>
Jul 29 14:00:51 user nova-compute[231753]:         <nova:user uuid="fe8dbee1098a44418ba739f073503497">tempest-TestStampPattern-442563326-project-member</nova:user>
Jul 29 14:00:51 user nova-compute[231753]:         <nova:project uuid="28da183a39e9413ebf7f0bc22ea1ae5d">tempest-TestStampPattern-442563326</nova:project>
Jul 29 14:00:51 user nova-compute[231753]:       </nova:owner>
Jul 29 14:00:51 user nova-compute[231753]:       <nova:root type="image" uuid="5ada5696-44e9-4176-8af1-bdda4a22791d"/>
Jul 29 14:00:51 user nova-compute[231753]:       <nova:ports>
Jul 29 14:00:51 user nova-compute[231753]:         <nova:port uuid="3b1ceda0-41f5-4ce0-b4f8-948252b2af4c">
Jul 29 14:00:51 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.11" ipVersion="4"/>
Jul 29 14:00:51 user nova-compute[231753]:         </nova:port>
Jul 29 14:00:51 user nova-compute[231753]:       </nova:ports>
Jul 29 14:00:51 user nova-compute[231753]:     </nova:instance>
Jul 29 14:00:51 user nova-compute[231753]:   </metadata>
Jul 29 14:00:51 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 14:00:51 user nova-compute[231753]:     <system>
Jul 29 14:00:51 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:00:51 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:00:51 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 14:00:51 user nova-compute[231753]:       <entry name="serial">4db109e2-0918-42d4-9b19-4a0c72a08370</entry>
Jul 29 14:00:51 user nova-compute[231753]:       <entry name="uuid">4db109e2-0918-42d4-9b19-4a0c72a08370</entry>
Jul 29 14:00:51 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:00:51 user nova-compute[231753]:     </system>
Jul 29 14:00:51 user nova-compute[231753]:   </sysinfo>
Jul 29 14:00:51 user nova-compute[231753]:   <os>
Jul 29 14:00:51 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:00:51 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 14:00:51 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 14:00:51 user nova-compute[231753]:   </os>
Jul 29 14:00:51 user nova-compute[231753]:   <features>
Jul 29 14:00:51 user nova-compute[231753]:     <acpi/>
Jul 29 14:00:51 user nova-compute[231753]:     <apic/>
Jul 29 14:00:51 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 14:00:51 user nova-compute[231753]:   </features>
Jul 29 14:00:51 user nova-compute[231753]:   <clock offset="utc">
Jul 29 14:00:51 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:00:51 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:00:51 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 14:00:51 user nova-compute[231753]:   </clock>
Jul 29 14:00:51 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 14:00:51 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 14:00:51 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:00:51 user nova-compute[231753]:   </cpu>
Jul 29 14:00:51 user nova-compute[231753]:   <devices>
Jul 29 14:00:51 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 14:00:51 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:00:51 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/4db109e2-0918-42d4-9b19-4a0c72a08370/disk"/>
Jul 29 14:00:51 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 14:00:51 user nova-compute[231753]:     </disk>
Jul 29 14:00:51 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 14:00:51 user nova-compute[231753]:       <mac address="fa:16:3e:ce:b9:59"/>
Jul 29 14:00:51 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 14:00:51 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 14:00:51 user nova-compute[231753]:       <target dev="tap3b1ceda0-41"/>
Jul 29 14:00:51 user nova-compute[231753]:     </interface>
Jul 29 14:00:51 user nova-compute[231753]:     <serial type="pty">
Jul 29 14:00:51 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/4db109e2-0918-42d4-9b19-4a0c72a08370/console.log" append="off"/>
Jul 29 14:00:51 user nova-compute[231753]:     </serial>
Jul 29 14:00:51 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:00:51 user nova-compute[231753]:     <video>
Jul 29 14:00:51 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 14:00:51 user nova-compute[231753]:     </video>
Jul 29 14:00:51 user nova-compute[231753]:     <rng model="virtio">
Jul 29 14:00:51 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:00:51 user nova-compute[231753]:     </rng>
Jul 29 14:00:51 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:00:51 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 14:00:51 user nova-compute[231753]:       <stats period="10"/>
Jul 29 14:00:51 user nova-compute[231753]:     </memballoon>
Jul 29 14:00:51 user nova-compute[231753]:   </devices>
Jul 29 14:00:51 user nova-compute[231753]: </domain>
Jul 29 14:00:51 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:00:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestStampPattern-server-2065518186',display_name='tempest-TestStampPattern-server-2065518186',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2065518186',id=48,image_ref='5ada5696-44e9-4176-8af1-bdda4a22791d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJ0UCuB1s/FcIxNR+PeaL27O4FLCSRuPA3sNGjkAYL2ft4zG9hnQn3p/NaR8N5IEf65ITJPm24CQQ3JghZ9yGOSsBJ6AidP6UmfWpGZKzXSpLz9fY7+5vRgRPmfh/cMFA==',key_name='tempest-TestStampPattern-2343879',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='28da183a39e9413ebf7f0bc22ea1ae5d',ramdisk_id='',reservation_id='r-2z0i9pmu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='8e8d1ee0-4906-4411-a1fd-c5997a22b5e8',image_min_disk='1',image_min_ram='0',image_owner_id='28da183a39e9413ebf7f0bc22ea1ae5d',image_owner_project_name='tempest-TestStampPattern-442563326',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-442563326-project-member',image_user_id='fe8dbee1098a44418ba739f073503497',network_allocated='True',owner_project_name='tempest-TestStampPattern-442563326',owner_user_name='tempest-TestStampPattern-442563326-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:00:48Z,user_data=None,user_id='fe8dbee1098a44418ba739f073503497',uuid=4db109e2-0918-42d4-9b19-4a0c72a08370,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "3b1ceda0-41f5-4ce0-b4f8-948252b2af4c", "address": "fa:16:3e:ce:b9:59", "network": {"id": "a10f7c69-0720-46b5-b252-6523dc61a6ca", "bridge": "br-int", "label": "tempest-TestStampPattern-1661615052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28da183a39e9413ebf7f0bc22ea1ae5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1ceda0-41", "ovs_interfaceid": "3b1ceda0-41f5-4ce0-b4f8-948252b2af4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Converting VIF {"id": "3b1ceda0-41f5-4ce0-b4f8-948252b2af4c", "address": "fa:16:3e:ce:b9:59", "network": {"id": "a10f7c69-0720-46b5-b252-6523dc61a6ca", "bridge": "br-int", "label": "tempest-TestStampPattern-1661615052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28da183a39e9413ebf7f0bc22ea1ae5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1ceda0-41", "ovs_interfaceid": "3b1ceda0-41f5-4ce0-b4f8-948252b2af4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ce:b9:59,bridge_name='br-int',has_traffic_filtering=True,id=3b1ceda0-41f5-4ce0-b4f8-948252b2af4c,network=Network(a10f7c69-0720-46b5-b252-6523dc61a6ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b1ceda0-41') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG os_vif [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:b9:59,bridge_name='br-int',has_traffic_filtering=True,id=3b1ceda0-41f5-4ce0-b4f8-948252b2af4c,network=Network(a10f7c69-0720-46b5-b252-6523dc61a6ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b1ceda0-41') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3b1ceda0-41, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap3b1ceda0-41, col_values=(('external_ids', {'iface-id': '3b1ceda0-41f5-4ce0-b4f8-948252b2af4c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ce:b9:59', 'vm-uuid': '4db109e2-0918-42d4-9b19-4a0c72a08370'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:51 user nova-compute[231753]: INFO os_vif [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ce:b9:59,bridge_name='br-int',has_traffic_filtering=True,id=3b1ceda0-41f5-4ce0-b4f8-948252b2af4c,network=Network(a10f7c69-0720-46b5-b252-6523dc61a6ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b1ceda0-41')
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690639236.7210336, 74e3894e-9c5e-410d-b122-2f733b779139 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:00:51 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] VM Stopped (Lifecycle Event)
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] No VIF found with MAC fa:16:3e:ce:b9:59, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.compute.manager [None req-b1f76eb7-559d-4b00-8971-e268110e7f3c None None] [instance: 74e3894e-9c5e-410d-b122-2f733b779139] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.network.neutron [req-3f214975-70b1-4b0c-ad6f-3a6efe8abfda req-3d20b82b-e993-4bfd-91ed-55d2d7f73c65 service nova] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Updated VIF entry in instance network info cache for port 3b1ceda0-41f5-4ce0-b4f8-948252b2af4c. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:00:51 user nova-compute[231753]: DEBUG nova.network.neutron [req-3f214975-70b1-4b0c-ad6f-3a6efe8abfda req-3d20b82b-e993-4bfd-91ed-55d2d7f73c65 service nova] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Updating instance_info_cache with network_info: [{"id": "3b1ceda0-41f5-4ce0-b4f8-948252b2af4c", "address": "fa:16:3e:ce:b9:59", "network": {"id": "a10f7c69-0720-46b5-b252-6523dc61a6ca", "bridge": "br-int", "label": "tempest-TestStampPattern-1661615052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28da183a39e9413ebf7f0bc22ea1ae5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1ceda0-41", "ovs_interfaceid": "3b1ceda0-41f5-4ce0-b4f8-948252b2af4c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:00:52 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3f214975-70b1-4b0c-ad6f-3a6efe8abfda req-3d20b82b-e993-4bfd-91ed-55d2d7f73c65 service nova] Releasing lock "refresh_cache-4db109e2-0918-42d4-9b19-4a0c72a08370" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:00:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:53 user nova-compute[231753]: DEBUG nova.compute.manager [req-0ddf5a70-d1d0-4a1f-90fe-44eff9abf609 req-9ff3ea0b-0891-4c3e-a7a0-ac23df9da04f service nova] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Received event network-vif-plugged-3b1ceda0-41f5-4ce0-b4f8-948252b2af4c {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:00:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0ddf5a70-d1d0-4a1f-90fe-44eff9abf609 req-9ff3ea0b-0891-4c3e-a7a0-ac23df9da04f service nova] Acquiring lock "4db109e2-0918-42d4-9b19-4a0c72a08370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:00:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0ddf5a70-d1d0-4a1f-90fe-44eff9abf609 req-9ff3ea0b-0891-4c3e-a7a0-ac23df9da04f service nova] Lock "4db109e2-0918-42d4-9b19-4a0c72a08370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:00:53 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0ddf5a70-d1d0-4a1f-90fe-44eff9abf609 req-9ff3ea0b-0891-4c3e-a7a0-ac23df9da04f service nova] Lock "4db109e2-0918-42d4-9b19-4a0c72a08370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:00:53 user nova-compute[231753]: DEBUG nova.compute.manager [req-0ddf5a70-d1d0-4a1f-90fe-44eff9abf609 req-9ff3ea0b-0891-4c3e-a7a0-ac23df9da04f service nova] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] No waiting events found dispatching network-vif-plugged-3b1ceda0-41f5-4ce0-b4f8-948252b2af4c {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:00:53 user nova-compute[231753]: WARNING nova.compute.manager [req-0ddf5a70-d1d0-4a1f-90fe-44eff9abf609 req-9ff3ea0b-0891-4c3e-a7a0-ac23df9da04f service nova] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Received unexpected event network-vif-plugged-3b1ceda0-41f5-4ce0-b4f8-948252b2af4c for instance with vm_state building and task_state spawning.
Jul 29 14:00:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:00:55 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690639255.1642087, 4db109e2-0918-42d4-9b19-4a0c72a08370 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:00:55 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] VM Resumed (Lifecycle Event)
Jul 29 14:00:55 user nova-compute[231753]: DEBUG nova.compute.manager [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:00:55 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:00:55 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Instance spawned successfully.
Jul 29 14:00:55 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:00:55 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:00:55 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:00:55 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:00:55 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:00:55 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:00:55 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690639255.1655867, 4db109e2-0918-42d4-9b19-4a0c72a08370 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:00:55 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] VM Started (Lifecycle Event)
Jul 29 14:00:55 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:00:55 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:00:55 user nova-compute[231753]: INFO nova.compute.manager [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Took 7.24 seconds to spawn the instance on the hypervisor.
Jul 29 14:00:55 user nova-compute[231753]: DEBUG nova.compute.manager [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:00:55 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:00:55 user nova-compute[231753]: DEBUG nova.compute.manager [req-c77f12b6-4311-4258-9377-6a37d7169749 req-f9887725-a74d-4016-856c-66a249d59f4a service nova] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Received event network-vif-plugged-3b1ceda0-41f5-4ce0-b4f8-948252b2af4c {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:00:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c77f12b6-4311-4258-9377-6a37d7169749 req-f9887725-a74d-4016-856c-66a249d59f4a service nova] Acquiring lock "4db109e2-0918-42d4-9b19-4a0c72a08370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:00:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c77f12b6-4311-4258-9377-6a37d7169749 req-f9887725-a74d-4016-856c-66a249d59f4a service nova] Lock "4db109e2-0918-42d4-9b19-4a0c72a08370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:00:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c77f12b6-4311-4258-9377-6a37d7169749 req-f9887725-a74d-4016-856c-66a249d59f4a service nova] Lock "4db109e2-0918-42d4-9b19-4a0c72a08370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:00:55 user nova-compute[231753]: DEBUG nova.compute.manager [req-c77f12b6-4311-4258-9377-6a37d7169749 req-f9887725-a74d-4016-856c-66a249d59f4a service nova] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] No waiting events found dispatching network-vif-plugged-3b1ceda0-41f5-4ce0-b4f8-948252b2af4c {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:00:55 user nova-compute[231753]: WARNING nova.compute.manager [req-c77f12b6-4311-4258-9377-6a37d7169749 req-f9887725-a74d-4016-856c-66a249d59f4a service nova] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Received unexpected event network-vif-plugged-3b1ceda0-41f5-4ce0-b4f8-948252b2af4c for instance with vm_state building and task_state spawning.
Jul 29 14:00:55 user nova-compute[231753]: INFO nova.compute.manager [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Took 7.90 seconds to build instance.
Jul 29 14:00:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-4034dffa-c407-441f-82c0-7299a01a5803 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "4db109e2-0918-42d4-9b19-4a0c72a08370" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 7.994s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:00:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:01 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:01:01 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:01 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=231753) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 14:01:01 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 14:01:01 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 14:01:01 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:06 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:01:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:11 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:22 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:01:24 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:01:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:26 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:01:26 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 14:01:26 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Rebuilding the list of instances to heal {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 14:01:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "refresh_cache-8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:01:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquired lock "refresh_cache-8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:01:26 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Forcefully refreshing network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 14:01:26 user nova-compute[231753]: DEBUG nova.objects.instance [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lazy-loading 'info_cache' on Instance uuid 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:01:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:27 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Updating instance_info_cache with network_info: [{"id": "eea8caab-510b-4b6d-bf98-d1149bd48f91", "address": "fa:16:3e:cf:43:1e", "network": {"id": "a10f7c69-0720-46b5-b252-6523dc61a6ca", "bridge": "br-int", "label": "tempest-TestStampPattern-1661615052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28da183a39e9413ebf7f0bc22ea1ae5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea8caab-51", "ovs_interfaceid": "eea8caab-510b-4b6d-bf98-d1149bd48f91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:01:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Releasing lock "refresh_cache-8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:01:27 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Updated the network info_cache for instance {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 14:01:27 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:01:27 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:01:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:01:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:01:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:01:27 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 14:01:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:01:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-3f93b609-21c8-4d5f-b45b-8ca2d8d6f7bc tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Acquiring lock "fa284c5d-fe31-493c-a3ed-1a015219cd48" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:01:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-3f93b609-21c8-4d5f-b45b-8ca2d8d6f7bc tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lock "fa284c5d-fe31-493c-a3ed-1a015219cd48" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:01:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-3f93b609-21c8-4d5f-b45b-8ca2d8d6f7bc tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Acquiring lock "fa284c5d-fe31-493c-a3ed-1a015219cd48-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:01:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-3f93b609-21c8-4d5f-b45b-8ca2d8d6f7bc tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lock "fa284c5d-fe31-493c-a3ed-1a015219cd48-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:01:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-3f93b609-21c8-4d5f-b45b-8ca2d8d6f7bc tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lock "fa284c5d-fe31-493c-a3ed-1a015219cd48-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:01:27 user nova-compute[231753]: INFO nova.compute.manager [None req-3f93b609-21c8-4d5f-b45b-8ca2d8d6f7bc tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Terminating instance
Jul 29 14:01:27 user nova-compute[231753]: DEBUG nova.compute.manager [None req-3f93b609-21c8-4d5f-b45b-8ca2d8d6f7bc tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 14:01:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk --force-share --output=json" returned: 0 in 0.187s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:01:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:01:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:27 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk --force-share --output=json" returned: 0 in 0.156s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:01:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "6bc5023f-6d34-4edc-b189-47d40e58122f" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:01:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "6bc5023f-6d34-4edc-b189-47d40e58122f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:01:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-82839dc4-721f-4305-9613-bac092ba5b55 req-14652f3f-a5ca-4558-adfc-f25801168459 service nova] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Received event network-vif-unplugged-cb4d540c-5827-40aa-b326-bceba6df9833 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:01:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-82839dc4-721f-4305-9613-bac092ba5b55 req-14652f3f-a5ca-4558-adfc-f25801168459 service nova] Acquiring lock "fa284c5d-fe31-493c-a3ed-1a015219cd48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:01:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-82839dc4-721f-4305-9613-bac092ba5b55 req-14652f3f-a5ca-4558-adfc-f25801168459 service nova] Lock "fa284c5d-fe31-493c-a3ed-1a015219cd48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:01:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-82839dc4-721f-4305-9613-bac092ba5b55 req-14652f3f-a5ca-4558-adfc-f25801168459 service nova] Lock "fa284c5d-fe31-493c-a3ed-1a015219cd48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:01:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-82839dc4-721f-4305-9613-bac092ba5b55 req-14652f3f-a5ca-4558-adfc-f25801168459 service nova] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] No waiting events found dispatching network-vif-unplugged-cb4d540c-5827-40aa-b326-bceba6df9833 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:01:27 user nova-compute[231753]: DEBUG nova.compute.manager [req-82839dc4-721f-4305-9613-bac092ba5b55 req-14652f3f-a5ca-4558-adfc-f25801168459 service nova] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Received event network-vif-unplugged-cb4d540c-5827-40aa-b326-bceba6df9833 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:01:27 user nova-compute[231753]: DEBUG nova.compute.manager [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:01:27 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa284c5d-fe31-493c-a3ed-1a015219cd48/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.003s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:01:28 user nova-compute[231753]: INFO nova.compute.claims [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Claim successful on node user
Jul 29 14:01:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa284c5d-fe31-493c-a3ed-1a015219cd48/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa284c5d-fe31-493c-a3ed-1a015219cd48/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/fa284c5d-fe31-493c-a3ed-1a015219cd48/disk --force-share --output=json" returned: 0 in 0.152s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db109e2-0918-42d4-9b19-4a0c72a08370/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:01:28 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Instance destroyed successfully.
Jul 29 14:01:28 user nova-compute[231753]: DEBUG nova.objects.instance [None req-3f93b609-21c8-4d5f-b45b-8ca2d8d6f7bc tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lazy-loading 'resources' on Instance uuid fa284c5d-fe31-493c-a3ed-1a015219cd48 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-3f93b609-21c8-4d5f-b45b-8ca2d8d6f7bc tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:59:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-542054533',display_name='tempest-VolumesActionsTest-instance-542054533',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-542054533',id=46,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:59:43Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05bd77abd6fc41499a1071d21320227d',ramdisk_id='',reservation_id='r-y1nle4dp',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1523708427',owner_user_name='tempest-VolumesActionsTest-1523708427-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T13:59:44Z,user_data=None,user_id='044799f22df449fb82aeef584dcf72e6',uuid=fa284c5d-fe31-493c-a3ed-1a015219cd48,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "cb4d540c-5827-40aa-b326-bceba6df9833", "address": "fa:16:3e:ee:f2:66", "network": {"id": "2ddc9999-9ee3-464c-9f09-409be4323fa8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413085584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bd77abd6fc41499a1071d21320227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4d540c-58", "ovs_interfaceid": "cb4d540c-5827-40aa-b326-bceba6df9833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-3f93b609-21c8-4d5f-b45b-8ca2d8d6f7bc tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Converting VIF {"id": "cb4d540c-5827-40aa-b326-bceba6df9833", "address": "fa:16:3e:ee:f2:66", "network": {"id": "2ddc9999-9ee3-464c-9f09-409be4323fa8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413085584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bd77abd6fc41499a1071d21320227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapcb4d540c-58", "ovs_interfaceid": "cb4d540c-5827-40aa-b326-bceba6df9833", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-3f93b609-21c8-4d5f-b45b-8ca2d8d6f7bc tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ee:f2:66,bridge_name='br-int',has_traffic_filtering=True,id=cb4d540c-5827-40aa-b326-bceba6df9833,network=Network(2ddc9999-9ee3-464c-9f09-409be4323fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb4d540c-58') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG os_vif [None req-3f93b609-21c8-4d5f-b45b-8ca2d8d6f7bc tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:f2:66,bridge_name='br-int',has_traffic_filtering=True,id=cb4d540c-5827-40aa-b326-bceba6df9833,network=Network(2ddc9999-9ee3-464c-9f09-409be4323fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb4d540c-58') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapcb4d540c-58, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:01:28 user nova-compute[231753]: INFO os_vif [None req-3f93b609-21c8-4d5f-b45b-8ca2d8d6f7bc tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ee:f2:66,bridge_name='br-int',has_traffic_filtering=True,id=cb4d540c-5827-40aa-b326-bceba6df9833,network=Network(2ddc9999-9ee3-464c-9f09-409be4323fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapcb4d540c-58')
Jul 29 14:01:28 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-3f93b609-21c8-4d5f-b45b-8ca2d8d6f7bc tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Deleting instance files /opt/stack/data/nova/instances/fa284c5d-fe31-493c-a3ed-1a015219cd48_del
Jul 29 14:01:28 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-3f93b609-21c8-4d5f-b45b-8ca2d8d6f7bc tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Deletion of /opt/stack/data/nova/instances/fa284c5d-fe31-493c-a3ed-1a015219cd48_del complete
Jul 29 14:01:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.416s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG nova.compute.manager [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db109e2-0918-42d4-9b19-4a0c72a08370/disk --force-share --output=json" returned: 0 in 0.157s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db109e2-0918-42d4-9b19-4a0c72a08370/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG nova.compute.manager [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG nova.network.neutron [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:01:28 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:01:28 user nova-compute[231753]: INFO nova.compute.manager [None req-3f93b609-21c8-4d5f-b45b-8ca2d8d6f7bc tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Took 0.99 seconds to destroy the instance on the hypervisor.
Jul 29 14:01:28 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-3f93b609-21c8-4d5f-b45b-8ca2d8d6f7bc tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG nova.compute.manager [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:01:28 user nova-compute[231753]: INFO nova.virt.block_device [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Booting with volume cdbefe05-ad5a-4372-8011-5253b3627f26 at /dev/vda
Jul 29 14:01:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db109e2-0918-42d4-9b19-4a0c72a08370/disk --force-share --output=json" returned: 0 in 0.162s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG nova.policy [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd94a7ea0c19845b886e12c1689cf30a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45c92d3fe964066b9be87489b2c9f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG os_brick.utils [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e1ac006-0023-4b5a-8dc9-467d4930e681]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31f7592-46c2-4d8a-9735-3f1f21f04cf7]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[36770891-a3df-409f-8454-1f2efd6167d3]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0e713c-e83f-4316-88f2-837888cc95ae]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk --force-share --output=json" returned: 0 in 0.172s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:01:28 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:01:28 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[12b9a4b1-f39d-45e3-b932-fa3bcc2ec894]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG os_brick.utils [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] <== get_connector_properties: return (165ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Updating existing volume attachment record: 7bccb876-71c8-4662-b7a7-1bf861b70b9a {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:01:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG nova.compute.manager [req-a1b818f5-85d1-4433-a254-1348c7c8545f req-005e21df-21f7-452f-9da7-09a07f131998 service nova] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Received event network-vif-deleted-cb4d540c-5827-40aa-b326-bceba6df9833 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:01:29 user nova-compute[231753]: INFO nova.compute.manager [req-a1b818f5-85d1-4433-a254-1348c7c8545f req-005e21df-21f7-452f-9da7-09a07f131998 service nova] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Neutron deleted interface cb4d540c-5827-40aa-b326-bceba6df9833; detaching it from the instance and deleting it from the info cache
Jul 29 14:01:29 user nova-compute[231753]: DEBUG nova.network.neutron [req-a1b818f5-85d1-4433-a254-1348c7c8545f req-005e21df-21f7-452f-9da7-09a07f131998 service nova] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:01:29 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:01:29 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:01:29 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=8162MB free_disk=24.956878662109375GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:01:29 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Took 0.87 seconds to deallocate network for instance.
Jul 29 14:01:29 user nova-compute[231753]: DEBUG nova.compute.manager [req-a1b818f5-85d1-4433-a254-1348c7c8545f req-005e21df-21f7-452f-9da7-09a07f131998 service nova] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Detach interface failed, port_id=cb4d540c-5827-40aa-b326-bceba6df9833, reason: Instance fa284c5d-fe31-493c-a3ed-1a015219cd48 could not be found. {{(pid=231753) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:10866}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-3f93b609-21c8-4d5f-b45b-8ca2d8d6f7bc tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance fa284c5d-fe31-493c-a3ed-1a015219cd48 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 441fd0df-b5a0-498f-8d02-eb1db2f45b4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 4db109e2-0918-42d4-9b19-4a0c72a08370 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 6bc5023f-6d34-4edc-b189-47d40e58122f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG nova.network.neutron [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Successfully created port: d3fc41a6-4687-4c01-b262-4c09c02345ff {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.326s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-3f93b609-21c8-4d5f-b45b-8ca2d8d6f7bc tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.244s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-3f93b609-21c8-4d5f-b45b-8ca2d8d6f7bc tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG nova.compute.manager [req-c742298f-e465-432e-81ee-91d7aa528469 req-f064889e-80e1-4307-965b-4a670ed8d8e4 service nova] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Received event network-vif-plugged-cb4d540c-5827-40aa-b326-bceba6df9833 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c742298f-e465-432e-81ee-91d7aa528469 req-f064889e-80e1-4307-965b-4a670ed8d8e4 service nova] Acquiring lock "fa284c5d-fe31-493c-a3ed-1a015219cd48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c742298f-e465-432e-81ee-91d7aa528469 req-f064889e-80e1-4307-965b-4a670ed8d8e4 service nova] Lock "fa284c5d-fe31-493c-a3ed-1a015219cd48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c742298f-e465-432e-81ee-91d7aa528469 req-f064889e-80e1-4307-965b-4a670ed8d8e4 service nova] Lock "fa284c5d-fe31-493c-a3ed-1a015219cd48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG nova.compute.manager [req-c742298f-e465-432e-81ee-91d7aa528469 req-f064889e-80e1-4307-965b-4a670ed8d8e4 service nova] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] No waiting events found dispatching network-vif-plugged-cb4d540c-5827-40aa-b326-bceba6df9833 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:01:29 user nova-compute[231753]: WARNING nova.compute.manager [req-c742298f-e465-432e-81ee-91d7aa528469 req-f064889e-80e1-4307-965b-4a670ed8d8e4 service nova] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Received unexpected event network-vif-plugged-cb4d540c-5827-40aa-b326-bceba6df9833 for instance with vm_state deleted and task_state None.
Jul 29 14:01:29 user nova-compute[231753]: DEBUG nova.compute.manager [req-c742298f-e465-432e-81ee-91d7aa528469 req-f064889e-80e1-4307-965b-4a670ed8d8e4 service nova] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Received event network-vif-plugged-cb4d540c-5827-40aa-b326-bceba6df9833 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c742298f-e465-432e-81ee-91d7aa528469 req-f064889e-80e1-4307-965b-4a670ed8d8e4 service nova] Acquiring lock "fa284c5d-fe31-493c-a3ed-1a015219cd48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c742298f-e465-432e-81ee-91d7aa528469 req-f064889e-80e1-4307-965b-4a670ed8d8e4 service nova] Lock "fa284c5d-fe31-493c-a3ed-1a015219cd48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c742298f-e465-432e-81ee-91d7aa528469 req-f064889e-80e1-4307-965b-4a670ed8d8e4 service nova] Lock "fa284c5d-fe31-493c-a3ed-1a015219cd48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG nova.compute.manager [req-c742298f-e465-432e-81ee-91d7aa528469 req-f064889e-80e1-4307-965b-4a670ed8d8e4 service nova] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] No waiting events found dispatching network-vif-plugged-cb4d540c-5827-40aa-b326-bceba6df9833 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:01:29 user nova-compute[231753]: WARNING nova.compute.manager [req-c742298f-e465-432e-81ee-91d7aa528469 req-f064889e-80e1-4307-965b-4a670ed8d8e4 service nova] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Received unexpected event network-vif-plugged-cb4d540c-5827-40aa-b326-bceba6df9833 for instance with vm_state deleted and task_state None.
Jul 29 14:01:29 user nova-compute[231753]: DEBUG nova.compute.manager [req-c742298f-e465-432e-81ee-91d7aa528469 req-f064889e-80e1-4307-965b-4a670ed8d8e4 service nova] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Received event network-vif-plugged-cb4d540c-5827-40aa-b326-bceba6df9833 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c742298f-e465-432e-81ee-91d7aa528469 req-f064889e-80e1-4307-965b-4a670ed8d8e4 service nova] Acquiring lock "fa284c5d-fe31-493c-a3ed-1a015219cd48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c742298f-e465-432e-81ee-91d7aa528469 req-f064889e-80e1-4307-965b-4a670ed8d8e4 service nova] Lock "fa284c5d-fe31-493c-a3ed-1a015219cd48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c742298f-e465-432e-81ee-91d7aa528469 req-f064889e-80e1-4307-965b-4a670ed8d8e4 service nova] Lock "fa284c5d-fe31-493c-a3ed-1a015219cd48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG nova.compute.manager [req-c742298f-e465-432e-81ee-91d7aa528469 req-f064889e-80e1-4307-965b-4a670ed8d8e4 service nova] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] No waiting events found dispatching network-vif-plugged-cb4d540c-5827-40aa-b326-bceba6df9833 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:01:29 user nova-compute[231753]: WARNING nova.compute.manager [req-c742298f-e465-432e-81ee-91d7aa528469 req-f064889e-80e1-4307-965b-4a670ed8d8e4 service nova] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Received unexpected event network-vif-plugged-cb4d540c-5827-40aa-b326-bceba6df9833 for instance with vm_state deleted and task_state None.
Jul 29 14:01:29 user nova-compute[231753]: DEBUG nova.compute.manager [req-c742298f-e465-432e-81ee-91d7aa528469 req-f064889e-80e1-4307-965b-4a670ed8d8e4 service nova] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Received event network-vif-plugged-cb4d540c-5827-40aa-b326-bceba6df9833 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c742298f-e465-432e-81ee-91d7aa528469 req-f064889e-80e1-4307-965b-4a670ed8d8e4 service nova] Acquiring lock "fa284c5d-fe31-493c-a3ed-1a015219cd48-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c742298f-e465-432e-81ee-91d7aa528469 req-f064889e-80e1-4307-965b-4a670ed8d8e4 service nova] Lock "fa284c5d-fe31-493c-a3ed-1a015219cd48-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c742298f-e465-432e-81ee-91d7aa528469 req-f064889e-80e1-4307-965b-4a670ed8d8e4 service nova] Lock "fa284c5d-fe31-493c-a3ed-1a015219cd48-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG nova.compute.manager [req-c742298f-e465-432e-81ee-91d7aa528469 req-f064889e-80e1-4307-965b-4a670ed8d8e4 service nova] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] No waiting events found dispatching network-vif-plugged-cb4d540c-5827-40aa-b326-bceba6df9833 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:01:29 user nova-compute[231753]: WARNING nova.compute.manager [req-c742298f-e465-432e-81ee-91d7aa528469 req-f064889e-80e1-4307-965b-4a670ed8d8e4 service nova] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Received unexpected event network-vif-plugged-cb4d540c-5827-40aa-b326-bceba6df9833 for instance with vm_state deleted and task_state None.
Jul 29 14:01:29 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-3f93b609-21c8-4d5f-b45b-8ca2d8d6f7bc tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:01:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-3f93b609-21c8-4d5f-b45b-8ca2d8d6f7bc tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.217s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:01:30 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-3f93b609-21c8-4d5f-b45b-8ca2d8d6f7bc tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Deleted allocations for instance fa284c5d-fe31-493c-a3ed-1a015219cd48
Jul 29 14:01:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-3f93b609-21c8-4d5f-b45b-8ca2d8d6f7bc tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lock "fa284c5d-fe31-493c-a3ed-1a015219cd48" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.547s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:01:30 user nova-compute[231753]: DEBUG nova.network.neutron [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Successfully updated port: d3fc41a6-4687-4c01-b262-4c09c02345ff {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:01:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "refresh_cache-6bc5023f-6d34-4edc-b189-47d40e58122f" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:01:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquired lock "refresh_cache-6bc5023f-6d34-4edc-b189-47d40e58122f" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:01:30 user nova-compute[231753]: DEBUG nova.network.neutron [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:01:30 user nova-compute[231753]: DEBUG nova.compute.manager [req-bc05a54d-c396-418a-b260-20e6fa202f14 req-9ceca6b0-d2de-44ea-8bd7-9891faaa960f service nova] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Received event network-changed-d3fc41a6-4687-4c01-b262-4c09c02345ff {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:01:30 user nova-compute[231753]: DEBUG nova.compute.manager [req-bc05a54d-c396-418a-b260-20e6fa202f14 req-9ceca6b0-d2de-44ea-8bd7-9891faaa960f service nova] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Refreshing instance network info cache due to event network-changed-d3fc41a6-4687-4c01-b262-4c09c02345ff. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:01:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bc05a54d-c396-418a-b260-20e6fa202f14 req-9ceca6b0-d2de-44ea-8bd7-9891faaa960f service nova] Acquiring lock "refresh_cache-6bc5023f-6d34-4edc-b189-47d40e58122f" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:01:30 user nova-compute[231753]: DEBUG nova.network.neutron [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:01:30 user nova-compute[231753]: DEBUG nova.network.neutron [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Updating instance_info_cache with network_info: [{"id": "d3fc41a6-4687-4c01-b262-4c09c02345ff", "address": "fa:16:3e:b1:c8:f9", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3fc41a6-46", "ovs_interfaceid": "d3fc41a6-4687-4c01-b262-4c09c02345ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:01:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Releasing lock "refresh_cache-6bc5023f-6d34-4edc-b189-47d40e58122f" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:01:30 user nova-compute[231753]: DEBUG nova.compute.manager [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Instance network_info: |[{"id": "d3fc41a6-4687-4c01-b262-4c09c02345ff", "address": "fa:16:3e:b1:c8:f9", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3fc41a6-46", "ovs_interfaceid": "d3fc41a6-4687-4c01-b262-4c09c02345ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:01:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bc05a54d-c396-418a-b260-20e6fa202f14 req-9ceca6b0-d2de-44ea-8bd7-9891faaa960f service nova] Acquired lock "refresh_cache-6bc5023f-6d34-4edc-b189-47d40e58122f" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:01:30 user nova-compute[231753]: DEBUG nova.network.neutron [req-bc05a54d-c396-418a-b260-20e6fa202f14 req-9ceca6b0-d2de-44ea-8bd7-9891faaa960f service nova] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Refreshing network info cache for port d3fc41a6-4687-4c01-b262-4c09c02345ff {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:01:31 user nova-compute[231753]: DEBUG nova.network.neutron [req-bc05a54d-c396-418a-b260-20e6fa202f14 req-9ceca6b0-d2de-44ea-8bd7-9891faaa960f service nova] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Updated VIF entry in instance network info cache for port d3fc41a6-4687-4c01-b262-4c09c02345ff. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:01:31 user nova-compute[231753]: DEBUG nova.network.neutron [req-bc05a54d-c396-418a-b260-20e6fa202f14 req-9ceca6b0-d2de-44ea-8bd7-9891faaa960f service nova] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Updating instance_info_cache with network_info: [{"id": "d3fc41a6-4687-4c01-b262-4c09c02345ff", "address": "fa:16:3e:b1:c8:f9", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3fc41a6-46", "ovs_interfaceid": "d3fc41a6-4687-4c01-b262-4c09c02345ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:01:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bc05a54d-c396-418a-b260-20e6fa202f14 req-9ceca6b0-d2de-44ea-8bd7-9891faaa960f service nova] Releasing lock "refresh_cache-6bc5023f-6d34-4edc-b189-47d40e58122f" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:01:31 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:01:31 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:01:31 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:01:31 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:01:31 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 14:01:32 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:01:33 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG nova.compute.manager [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:01:35 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Creating image(s)
Jul 29 14:01:35 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Did not create local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Ensure instance console log exists: /opt/stack/data/nova/instances/6bc5023f-6d34-4edc-b189-47d40e58122f/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Start _get_guest_xml network_info=[{"id": "d3fc41a6-4687-4c01-b262-4c09c02345ff", "address": "fa:16:3e:b1:c8:f9", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3fc41a6-46", "ovs_interfaceid": "d3fc41a6-4687-4c01-b262-4c09c02345ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGMAFhqZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '6bc5023f-6d34-4edc-b189-47d40e58122f', 'attached_at': '', 'detached_at': '', 'volume_id': 'cdbefe05-ad5a-4372-8011-5253b3627f26', 'serial': 'cdbefe05-ad5a-4372-8011-5253b3627f26'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '7bccb876-71c8-4662-b7a7-1bf861b70b9a', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:01:35 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:01:35 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:01:35 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGMAFhqZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:01:35 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:01:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:01:35 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:01:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:01:35 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:01:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6f08a2-cc05-4375-acd3-2de62d0be417]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:01:35 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[78b8d628-1a2f-4b37-a562-8909f7c3a0bc]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26] added
Jul 29 14:01:35 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[86e07b14-1846-40f8-b28a-fc8d4efdfdf3]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[24b18918-a89c-41d0-9064-fc006592992c]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wGMAFhqZ {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v wGMAFhqZ" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3b79070-8889-413c-9070-076437d2ab37]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'wGMAFhqZ'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.031s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e3f6bf6-9493-4c13-98a2-36d1c79a8ef3]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 21 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[75340fe1-6d1e-438f-b202-87c082c7f4b8]: (4, ('', 'iscsiadm: No active sessions.\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions.
Jul 29 14:01:35 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:01:35 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions.
Jul 29 14:01:35 user nova-compute[231753]:  {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:01:35 user nova-compute[231753]: WARNING os_brick.initiator.connectors.iscsi [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions.
Jul 29 14:01:35 user nova-compute[231753]: 
Jul 29 14:01:35 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:01:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --login" returned: 0 in 0.207s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:01:36 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfd1628-d959-49b5-a1f3-a3f06d9a70c5]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:01:36 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26, portal: 172.16.0.220,3260]
Jul 29 14:01:36 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26, portal: 172.16.0.220,3260] successful.
Jul 29 14:01:36 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:01:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:01:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:01:36 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5aa5f9da-ad92-4826-a745-88a72ec2042c]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:01:36 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:01:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:01:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:01:36 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[13a5386f-54bc-465a-a9d8-10ea009214f7]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:01:36 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:01:36 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:01:36 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:01:36 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:01:36 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.445s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:01:36 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:01:36 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] HCTL ('33', '-', '-', 0) found on session 53 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:01:36 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Scanning host 33 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:01:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host33/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:01:36 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host33/scan" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:01:36 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa1fdcff-e260-4dff-8486-9ee56e7a2101]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:01:36 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: None {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:01:37 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Searching for a device in session 53 and hctl ['33', '*', '*', 0] yield: sdb {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:01:37 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Connected to sdb using {'target_iqn': 'iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGMAFhqZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:01:37 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.474s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:01:37 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] <== connect_volume: return (1475ms) {'type': 'block', 'scsi_wwn': '26530303236656431', 'path': '/dev/sdb'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:01:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26530303236656431', 'path': '/dev/sdb'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:01:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:01:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-478082754',display_name='tempest-TestVolumeBootPattern-server-478082754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-478082754',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtoigQ7m5duqzfsiAOyArrbvva1hS5wetlA/wlY5VxGp3gb7rI+IjO+yTaKkT8nB18YhdDg3ru+M38WK4CdhiGgmsEXaLAhkk+kUuZmxu7gpTgpEVOFzr1YWb8fNF9FBQ==',key_name='tempest-TestVolumeBootPattern-1166783581',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f45c92d3fe964066b9be87489b2c9f7e',ramdisk_id='',reservation_id='r-zgkwws2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-434673895',owner_user_name='tempest-TestVolumeBootPattern-434673895-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:01:29Z,user_data=None,user_id='d94a7ea0c19845b886e12c1689cf30a8',uuid=6bc5023f-6d34-4edc-b189-47d40e58122f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3fc41a6-4687-4c01-b262-4c09c02345ff", "address": "fa:16:3e:b1:c8:f9", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3fc41a6-46", "ovs_interfaceid": "d3fc41a6-4687-4c01-b262-4c09c02345ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:01:37 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Converting VIF {"id": "d3fc41a6-4687-4c01-b262-4c09c02345ff", "address": "fa:16:3e:b1:c8:f9", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3fc41a6-46", "ovs_interfaceid": "d3fc41a6-4687-4c01-b262-4c09c02345ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:01:37 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:c8:f9,bridge_name='br-int',has_traffic_filtering=True,id=d3fc41a6-4687-4c01-b262-4c09c02345ff,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3fc41a6-46') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:01:37 user nova-compute[231753]: DEBUG nova.objects.instance [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lazy-loading 'pci_devices' on Instance uuid 6bc5023f-6d34-4edc-b189-47d40e58122f {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:01:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:01:37 user nova-compute[231753]:   <uuid>6bc5023f-6d34-4edc-b189-47d40e58122f</uuid>
Jul 29 14:01:37 user nova-compute[231753]:   <name>instance-00000031</name>
Jul 29 14:01:37 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 14:01:37 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 14:01:37 user nova-compute[231753]:   <metadata>
Jul 29 14:01:37 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:01:37 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 14:01:37 user nova-compute[231753]:       <nova:name>tempest-TestVolumeBootPattern-server-478082754</nova:name>
Jul 29 14:01:37 user nova-compute[231753]:       <nova:creationTime>2023-07-29 14:01:35</nova:creationTime>
Jul 29 14:01:37 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 14:01:37 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 14:01:37 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 14:01:37 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 14:01:37 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:01:37 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:01:37 user nova-compute[231753]:       </nova:flavor>
Jul 29 14:01:37 user nova-compute[231753]:       <nova:owner>
Jul 29 14:01:37 user nova-compute[231753]:         <nova:user uuid="d94a7ea0c19845b886e12c1689cf30a8">tempest-TestVolumeBootPattern-434673895-project-member</nova:user>
Jul 29 14:01:37 user nova-compute[231753]:         <nova:project uuid="f45c92d3fe964066b9be87489b2c9f7e">tempest-TestVolumeBootPattern-434673895</nova:project>
Jul 29 14:01:37 user nova-compute[231753]:       </nova:owner>
Jul 29 14:01:37 user nova-compute[231753]:       <nova:ports>
Jul 29 14:01:37 user nova-compute[231753]:         <nova:port uuid="d3fc41a6-4687-4c01-b262-4c09c02345ff">
Jul 29 14:01:37 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 29 14:01:37 user nova-compute[231753]:         </nova:port>
Jul 29 14:01:37 user nova-compute[231753]:       </nova:ports>
Jul 29 14:01:37 user nova-compute[231753]:     </nova:instance>
Jul 29 14:01:37 user nova-compute[231753]:   </metadata>
Jul 29 14:01:37 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 14:01:37 user nova-compute[231753]:     <system>
Jul 29 14:01:37 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:01:37 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:01:37 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 14:01:37 user nova-compute[231753]:       <entry name="serial">6bc5023f-6d34-4edc-b189-47d40e58122f</entry>
Jul 29 14:01:37 user nova-compute[231753]:       <entry name="uuid">6bc5023f-6d34-4edc-b189-47d40e58122f</entry>
Jul 29 14:01:37 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:01:37 user nova-compute[231753]:     </system>
Jul 29 14:01:37 user nova-compute[231753]:   </sysinfo>
Jul 29 14:01:37 user nova-compute[231753]:   <os>
Jul 29 14:01:37 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:01:37 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 14:01:37 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 14:01:37 user nova-compute[231753]:   </os>
Jul 29 14:01:37 user nova-compute[231753]:   <features>
Jul 29 14:01:37 user nova-compute[231753]:     <acpi/>
Jul 29 14:01:37 user nova-compute[231753]:     <apic/>
Jul 29 14:01:37 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 14:01:37 user nova-compute[231753]:   </features>
Jul 29 14:01:37 user nova-compute[231753]:   <clock offset="utc">
Jul 29 14:01:37 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:01:37 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:01:37 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 14:01:37 user nova-compute[231753]:   </clock>
Jul 29 14:01:37 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 14:01:37 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 14:01:37 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:01:37 user nova-compute[231753]:   </cpu>
Jul 29 14:01:37 user nova-compute[231753]:   <devices>
Jul 29 14:01:37 user nova-compute[231753]:     <disk type="block" device="disk">
Jul 29 14:01:37 user nova-compute[231753]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:01:37 user nova-compute[231753]:       <source dev="/dev/sdb"/>
Jul 29 14:01:37 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 14:01:37 user nova-compute[231753]:       <serial>cdbefe05-ad5a-4372-8011-5253b3627f26</serial>
Jul 29 14:01:37 user nova-compute[231753]:     </disk>
Jul 29 14:01:37 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 14:01:37 user nova-compute[231753]:       <mac address="fa:16:3e:b1:c8:f9"/>
Jul 29 14:01:37 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 14:01:37 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 14:01:37 user nova-compute[231753]:       <target dev="tapd3fc41a6-46"/>
Jul 29 14:01:37 user nova-compute[231753]:     </interface>
Jul 29 14:01:37 user nova-compute[231753]:     <serial type="pty">
Jul 29 14:01:37 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/6bc5023f-6d34-4edc-b189-47d40e58122f/console.log" append="off"/>
Jul 29 14:01:37 user nova-compute[231753]:     </serial>
Jul 29 14:01:37 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:01:37 user nova-compute[231753]:     <video>
Jul 29 14:01:37 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 14:01:37 user nova-compute[231753]:     </video>
Jul 29 14:01:37 user nova-compute[231753]:     <rng model="virtio">
Jul 29 14:01:37 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:01:37 user nova-compute[231753]:     </rng>
Jul 29 14:01:37 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:01:37 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 14:01:37 user nova-compute[231753]:       <stats period="10"/>
Jul 29 14:01:37 user nova-compute[231753]:     </memballoon>
Jul 29 14:01:37 user nova-compute[231753]:   </devices>
Jul 29 14:01:37 user nova-compute[231753]: </domain>
Jul 29 14:01:37 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:01:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:01:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-478082754',display_name='tempest-TestVolumeBootPattern-server-478082754',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-478082754',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtoigQ7m5duqzfsiAOyArrbvva1hS5wetlA/wlY5VxGp3gb7rI+IjO+yTaKkT8nB18YhdDg3ru+M38WK4CdhiGgmsEXaLAhkk+kUuZmxu7gpTgpEVOFzr1YWb8fNF9FBQ==',key_name='tempest-TestVolumeBootPattern-1166783581',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f45c92d3fe964066b9be87489b2c9f7e',ramdisk_id='',reservation_id='r-zgkwws2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-434673895',owner_user_name='tempest-TestVolumeBootPattern-434673895-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:01:29Z,user_data=None,user_id='d94a7ea0c19845b886e12c1689cf30a8',uuid=6bc5023f-6d34-4edc-b189-47d40e58122f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d3fc41a6-4687-4c01-b262-4c09c02345ff", "address": "fa:16:3e:b1:c8:f9", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3fc41a6-46", "ovs_interfaceid": "d3fc41a6-4687-4c01-b262-4c09c02345ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:01:37 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Converting VIF {"id": "d3fc41a6-4687-4c01-b262-4c09c02345ff", "address": "fa:16:3e:b1:c8:f9", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3fc41a6-46", "ovs_interfaceid": "d3fc41a6-4687-4c01-b262-4c09c02345ff", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:01:37 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b1:c8:f9,bridge_name='br-int',has_traffic_filtering=True,id=d3fc41a6-4687-4c01-b262-4c09c02345ff,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3fc41a6-46') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:01:37 user nova-compute[231753]: DEBUG os_vif [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:c8:f9,bridge_name='br-int',has_traffic_filtering=True,id=d3fc41a6-4687-4c01-b262-4c09c02345ff,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3fc41a6-46') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:01:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:01:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:01:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd3fc41a6-46, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:01:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd3fc41a6-46, col_values=(('external_ids', {'iface-id': 'd3fc41a6-4687-4c01-b262-4c09c02345ff', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b1:c8:f9', 'vm-uuid': '6bc5023f-6d34-4edc-b189-47d40e58122f'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:01:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:01:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:37 user nova-compute[231753]: INFO os_vif [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b1:c8:f9,bridge_name='br-int',has_traffic_filtering=True,id=d3fc41a6-4687-4c01-b262-4c09c02345ff,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3fc41a6-46')
Jul 29 14:01:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:01:37 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] No VIF found with MAC fa:16:3e:b1:c8:f9, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:01:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:39 user nova-compute[231753]: DEBUG nova.compute.manager [req-eca9b045-1aa6-4775-bfbb-5979e6866851 req-b4f1d195-dd59-45a3-9c79-37a410d703d5 service nova] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Received event network-vif-plugged-d3fc41a6-4687-4c01-b262-4c09c02345ff {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:01:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-eca9b045-1aa6-4775-bfbb-5979e6866851 req-b4f1d195-dd59-45a3-9c79-37a410d703d5 service nova] Acquiring lock "6bc5023f-6d34-4edc-b189-47d40e58122f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:01:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-eca9b045-1aa6-4775-bfbb-5979e6866851 req-b4f1d195-dd59-45a3-9c79-37a410d703d5 service nova] Lock "6bc5023f-6d34-4edc-b189-47d40e58122f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:01:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-eca9b045-1aa6-4775-bfbb-5979e6866851 req-b4f1d195-dd59-45a3-9c79-37a410d703d5 service nova] Lock "6bc5023f-6d34-4edc-b189-47d40e58122f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:01:39 user nova-compute[231753]: DEBUG nova.compute.manager [req-eca9b045-1aa6-4775-bfbb-5979e6866851 req-b4f1d195-dd59-45a3-9c79-37a410d703d5 service nova] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] No waiting events found dispatching network-vif-plugged-d3fc41a6-4687-4c01-b262-4c09c02345ff {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:01:39 user nova-compute[231753]: WARNING nova.compute.manager [req-eca9b045-1aa6-4775-bfbb-5979e6866851 req-b4f1d195-dd59-45a3-9c79-37a410d703d5 service nova] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Received unexpected event network-vif-plugged-d3fc41a6-4687-4c01-b262-4c09c02345ff for instance with vm_state building and task_state spawning.
Jul 29 14:01:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:40 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690639300.736885, 6bc5023f-6d34-4edc-b189-47d40e58122f => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:01:40 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] VM Resumed (Lifecycle Event)
Jul 29 14:01:40 user nova-compute[231753]: DEBUG nova.compute.manager [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:01:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:01:40 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Instance spawned successfully.
Jul 29 14:01:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:01:40 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:01:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:01:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:01:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:01:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:01:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:01:40 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:01:40 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:01:40 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:01:40 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690639300.7399478, 6bc5023f-6d34-4edc-b189-47d40e58122f => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:01:40 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] VM Started (Lifecycle Event)
Jul 29 14:01:40 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:01:40 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:01:40 user nova-compute[231753]: INFO nova.compute.manager [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Took 5.15 seconds to spawn the instance on the hypervisor.
Jul 29 14:01:40 user nova-compute[231753]: DEBUG nova.compute.manager [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:01:40 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:01:40 user nova-compute[231753]: INFO nova.compute.manager [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Took 13.00 seconds to build instance.
Jul 29 14:01:40 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-76c673f6-8843-4758-bd53-143f2e6d27c3 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "6bc5023f-6d34-4edc-b189-47d40e58122f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 13.116s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:01:41 user nova-compute[231753]: DEBUG nova.compute.manager [req-3699fb17-d1b6-49a6-8daa-0895fdb40564 req-6c421314-c0e2-4be0-a8d5-e02a9a0f511a service nova] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Received event network-vif-plugged-d3fc41a6-4687-4c01-b262-4c09c02345ff {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:01:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3699fb17-d1b6-49a6-8daa-0895fdb40564 req-6c421314-c0e2-4be0-a8d5-e02a9a0f511a service nova] Acquiring lock "6bc5023f-6d34-4edc-b189-47d40e58122f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:01:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3699fb17-d1b6-49a6-8daa-0895fdb40564 req-6c421314-c0e2-4be0-a8d5-e02a9a0f511a service nova] Lock "6bc5023f-6d34-4edc-b189-47d40e58122f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:01:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3699fb17-d1b6-49a6-8daa-0895fdb40564 req-6c421314-c0e2-4be0-a8d5-e02a9a0f511a service nova] Lock "6bc5023f-6d34-4edc-b189-47d40e58122f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:01:41 user nova-compute[231753]: DEBUG nova.compute.manager [req-3699fb17-d1b6-49a6-8daa-0895fdb40564 req-6c421314-c0e2-4be0-a8d5-e02a9a0f511a service nova] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] No waiting events found dispatching network-vif-plugged-d3fc41a6-4687-4c01-b262-4c09c02345ff {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:01:41 user nova-compute[231753]: WARNING nova.compute.manager [req-3699fb17-d1b6-49a6-8daa-0895fdb40564 req-6c421314-c0e2-4be0-a8d5-e02a9a0f511a service nova] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Received unexpected event network-vif-plugged-d3fc41a6-4687-4c01-b262-4c09c02345ff for instance with vm_state active and task_state None.
Jul 29 14:01:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:43 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690639288.3244412, fa284c5d-fe31-493c-a3ed-1a015219cd48 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:01:43 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] VM Stopped (Lifecycle Event)
Jul 29 14:01:43 user nova-compute[231753]: DEBUG nova.compute.manager [None req-f963ac83-1f9d-43cf-a8a1-4afb529cecda None None] [instance: fa284c5d-fe31-493c-a3ed-1a015219cd48] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:01:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:47 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:01:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:01:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5003 ms, sending inactivity probe {{(pid=231753) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 14:01:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 14:01:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 14:01:52 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:57 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:01:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:02:02 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:02:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:02:07 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:02:08 user nova-compute[231753]: DEBUG nova.compute.manager [req-b2ef12cf-fd65-48a5-b113-13b9118ae3be req-429295c5-6e2d-4887-a7c2-a17eedeacf4c service nova] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Received event network-changed-e65ce885-2848-4c59-b069-2d3fffab8131 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:02:08 user nova-compute[231753]: DEBUG nova.compute.manager [req-b2ef12cf-fd65-48a5-b113-13b9118ae3be req-429295c5-6e2d-4887-a7c2-a17eedeacf4c service nova] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Refreshing instance network info cache due to event network-changed-e65ce885-2848-4c59-b069-2d3fffab8131. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:02:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b2ef12cf-fd65-48a5-b113-13b9118ae3be req-429295c5-6e2d-4887-a7c2-a17eedeacf4c service nova] Acquiring lock "refresh_cache-441fd0df-b5a0-498f-8d02-eb1db2f45b4c" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:02:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b2ef12cf-fd65-48a5-b113-13b9118ae3be req-429295c5-6e2d-4887-a7c2-a17eedeacf4c service nova] Acquired lock "refresh_cache-441fd0df-b5a0-498f-8d02-eb1db2f45b4c" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:02:08 user nova-compute[231753]: DEBUG nova.network.neutron [req-b2ef12cf-fd65-48a5-b113-13b9118ae3be req-429295c5-6e2d-4887-a7c2-a17eedeacf4c service nova] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Refreshing network info cache for port e65ce885-2848-4c59-b069-2d3fffab8131 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:02:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:02:09 user nova-compute[231753]: DEBUG nova.network.neutron [req-b2ef12cf-fd65-48a5-b113-13b9118ae3be req-429295c5-6e2d-4887-a7c2-a17eedeacf4c service nova] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Updated VIF entry in instance network info cache for port e65ce885-2848-4c59-b069-2d3fffab8131. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:02:09 user nova-compute[231753]: DEBUG nova.network.neutron [req-b2ef12cf-fd65-48a5-b113-13b9118ae3be req-429295c5-6e2d-4887-a7c2-a17eedeacf4c service nova] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Updating instance_info_cache with network_info: [{"id": "e65ce885-2848-4c59-b069-2d3fffab8131", "address": "fa:16:3e:8a:ab:14", "network": {"id": "e850e031-78cb-4491-bc2e-1558870dee53", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1563208818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c63557bedc94739802fe008139488ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65ce885-28", "ovs_interfaceid": "e65ce885-2848-4c59-b069-2d3fffab8131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:02:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b2ef12cf-fd65-48a5-b113-13b9118ae3be req-429295c5-6e2d-4887-a7c2-a17eedeacf4c service nova] Releasing lock "refresh_cache-441fd0df-b5a0-498f-8d02-eb1db2f45b4c" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:02:12 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:02:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Acquiring lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:02:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:02:13 user nova-compute[231753]: DEBUG nova.objects.instance [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lazy-loading 'flavor' on Instance uuid 441fd0df-b5a0-498f-8d02-eb1db2f45b4c {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:02:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.057s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:02:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Acquiring lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:02:13 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:02:13 user nova-compute[231753]: INFO nova.compute.manager [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Attaching volume 7ee95d79-887f-4038-b05a-b17b959bf393 to /dev/vdb
Jul 29 14:02:13 user nova-compute[231753]: DEBUG os_brick.utils [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:02:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:13 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[01b7dffd-f38a-43ee-9af6-55e545dc92f7]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:13 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4510a88a-2fb2-490a-80f2-9bd3c1af18ba]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:13 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c57d32e-bf16-4e04-b0de-3866d49a735a]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:13 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ace8fa8-1d0e-4ca9-bec7-8317bea4e7d2]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:02:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:02:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:13 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:02:13 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:02:13 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3113e78-ca3b-4778-9f83-964ddfddb92f]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:02:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:02:13 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:02:13 user nova-compute[231753]: DEBUG os_brick.utils [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:02:13 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Updating existing volume attachment record: d22abed1-c337-427d-8bce-da9610768bc0 {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:02:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:02:17 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:02:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Acquiring lock "8a7a4543-0848-4e94-a424-8a3bc5883359" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:02:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lock "8a7a4543-0848-4e94-a424-8a3bc5883359" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:02:19 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:02:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:02:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:02:19 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:02:19 user nova-compute[231753]: INFO nova.compute.claims [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Claim successful on node user
Jul 29 14:02:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:02:19 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:02:19 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:02:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.315s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:02:19 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:02:19 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:02:19 user nova-compute[231753]: DEBUG nova.network.neutron [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:02:19 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:02:19 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:02:19 user nova-compute[231753]: DEBUG nova.policy [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '044799f22df449fb82aeef584dcf72e6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '05bd77abd6fc41499a1071d21320227d', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:02:19 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:02:19 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:02:19 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Creating image(s)
Jul 29 14:02:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Acquiring lock "/opt/stack/data/nova/instances/8a7a4543-0848-4e94-a424-8a3bc5883359/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:02:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lock "/opt/stack/data/nova/instances/8a7a4543-0848-4e94-a424-8a3bc5883359/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:02:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lock "/opt/stack/data/nova/instances/8a7a4543-0848-4e94-a424-8a3bc5883359/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format.<locals>.write_to_disk_info_file" :: held 0.008s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:02:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.142s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Acquiring lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:02:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:02:19 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.142s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/8a7a4543-0848-4e94-a424-8a3bc5883359/disk 1073741824 {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a,backing_fmt=raw /opt/stack/data/nova/instances/8a7a4543-0848-4e94-a424-8a3bc5883359/disk 1073741824" returned: 0 in 0.056s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lock "69db73d3e361dd0be24d2b84dc11d2caebd4742a" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image.<locals>.create_qcow2_image" :: held 0.205s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:02:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/69db73d3e361dd0be24d2b84dc11d2caebd4742a --force-share --output=json" returned: 0 in 0.135s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:20 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Checking if we can resize image /opt/stack/data/nova/instances/8a7a4543-0848-4e94-a424-8a3bc5883359/disk. size=1073741824 {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:166}}
Jul 29 14:02:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a7a4543-0848-4e94-a424-8a3bc5883359/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:20 user nova-compute[231753]: DEBUG nova.network.neutron [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Successfully created port: 4d05fd16-9ec0-4eb3-97d0-b0a763fce22d {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:02:20 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a7a4543-0848-4e94-a424-8a3bc5883359/disk --force-share --output=json" returned: 0 in 0.168s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:20 user nova-compute[231753]: DEBUG nova.virt.disk.api [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Cannot resize image /opt/stack/data/nova/instances/8a7a4543-0848-4e94-a424-8a3bc5883359/disk to a smaller size. {{(pid=231753) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:172}}
Jul 29 14:02:20 user nova-compute[231753]: DEBUG nova.objects.instance [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lazy-loading 'migration_context' on Instance uuid 8a7a4543-0848-4e94-a424-8a3bc5883359 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:02:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Created local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4851}}
Jul 29 14:02:20 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Ensure instance console log exists: /opt/stack/data/nova/instances/8a7a4543-0848-4e94-a424-8a3bc5883359/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:02:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:02:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:02:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwWMitkh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:02:21 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:02:21 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:02:21 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:02:21 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:02:21 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393 -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393 -p 172.16.0.220:3260" returned: 21 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6115846-8e12-435b-abf2-d16e08b653f8]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:02:21 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393 -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[259316f6-1b9f-49f2-aff9-d87f19354777]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393] added
Jul 29 14:02:21 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c70720-a504-4cb0-adce-c013fadc2d17]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[995dbb97-cd56-4b33-93ab-0693bfa8a376]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vwWMitkh {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG nova.network.neutron [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Successfully updated port: 4d05fd16-9ec0-4eb3-97d0-b0a763fce22d {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v vwWMitkh" returned: 0 in 0.030s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[912637d3-9679-4348-84c7-409179320e34]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'vwWMitkh'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Acquiring lock "refresh_cache-8a7a4543-0848-4e94-a424-8a3bc5883359" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Acquired lock "refresh_cache-8a7a4543-0848-4e94-a424-8a3bc5883359" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG nova.network.neutron [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[27a75260-8525-4db2-b330-5556a0b58f21]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG nova.compute.manager [req-5a257d6c-75fd-4542-b7d5-363e3aa3f9d4 req-cb2a3f3b-88c5-4ebf-8a67-0008f72b33f7 service nova] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Received event network-changed-4d05fd16-9ec0-4eb3-97d0-b0a763fce22d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG nova.compute.manager [req-5a257d6c-75fd-4542-b7d5-363e3aa3f9d4 req-cb2a3f3b-88c5-4ebf-8a67-0008f72b33f7 service nova] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Refreshing instance network info cache due to event network-changed-4d05fd16-9ec0-4eb3-97d0-b0a763fce22d. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5a257d6c-75fd-4542-b7d5-363e3aa3f9d4 req-cb2a3f3b-88c5-4ebf-8a67-0008f72b33f7 service nova] Acquiring lock "refresh_cache-8a7a4543-0848-4e94-a424-8a3bc5883359" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[adfd5561-994a-4e6a-92ae-8fb8b71b3d1a]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:02:21 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:02:21 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393 -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG nova.network.neutron [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393 -p 172.16.0.220:3260 --login" returned: 0 in 0.050s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b43ff55a-2cfe-48f5-972f-439e79f3c639]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393, portal: 172.16.0.220,3260]
Jul 29 14:02:21 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393, portal: 172.16.0.220,3260] successful.
Jul 29 14:02:21 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a251aa-429a-48ea-ad27-b23d5a5e3854]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[1317b28a-fd87-4f24-8d90-1219baee213e]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:02:21 user nova-compute[231753]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393 (non-flash)
Jul 29 14:02:21 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:02:21 user nova-compute[231753]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393 (non-flash)
Jul 29 14:02:21 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.283s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] HCTL ('34', '-', '-', 0) found on session 54 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[27ade9b8-f5b6-4add-9668-f101c26aef5b]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: None {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG nova.network.neutron [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Updating instance_info_cache with network_info: [{"id": "4d05fd16-9ec0-4eb3-97d0-b0a763fce22d", "address": "fa:16:3e:55:a5:8d", "network": {"id": "2ddc9999-9ee3-464c-9f09-409be4323fa8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413085584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bd77abd6fc41499a1071d21320227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d05fd16-9e", "ovs_interfaceid": "4d05fd16-9ec0-4eb3-97d0-b0a763fce22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Releasing lock "refresh_cache-8a7a4543-0848-4e94-a424-8a3bc5883359" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Instance network_info: |[{"id": "4d05fd16-9ec0-4eb3-97d0-b0a763fce22d", "address": "fa:16:3e:55:a5:8d", "network": {"id": "2ddc9999-9ee3-464c-9f09-409be4323fa8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413085584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bd77abd6fc41499a1071d21320227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d05fd16-9e", "ovs_interfaceid": "4d05fd16-9ec0-4eb3-97d0-b0a763fce22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5a257d6c-75fd-4542-b7d5-363e3aa3f9d4 req-cb2a3f3b-88c5-4ebf-8a67-0008f72b33f7 service nova] Acquired lock "refresh_cache-8a7a4543-0848-4e94-a424-8a3bc5883359" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG nova.network.neutron [req-5a257d6c-75fd-4542-b7d5-363e3aa3f9d4 req-cb2a3f3b-88c5-4ebf-8a67-0008f72b33f7 service nova] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Refreshing network info cache for port 4d05fd16-9ec0-4eb3-97d0-b0a763fce22d {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Start _get_guest_xml network_info=[{"id": "4d05fd16-9ec0-4eb3-97d0-b0a763fce22d", "address": "fa:16:3e:55:a5:8d", "network": {"id": "2ddc9999-9ee3-464c-9f09-409be4323fa8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413085584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bd77abd6fc41499a1071d21320227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d05fd16-9e", "ovs_interfaceid": "4d05fd16-9ec0-4eb3-97d0-b0a763fce22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'encrypted': False, 'guest_format': None, 'size': 0, 'encryption_options': None, 'device_type': 'disk', 'encryption_format': None, 'device_name': '/dev/vda', 'encryption_secret_uuid': None, 'disk_bus': 'virtio', 'boot_index': 0, 'image_id': 'e16ae177-482e-47d8-a71b-737a50412c32'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:02:21 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:02:21 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:02:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='c8fc807773e5354afe61636071771906',container_format='bare',created_at=2023-07-29T13:29:25Z,direct_url=<?>,disk_format='qcow2',id=e16ae177-482e-47d8-a71b-737a50412c32,min_disk=0,min_ram=0,name='cirros-0.6.2-x86_64-disk',owner='c691c184cace4b549169d1b6e8985e5c',properties=ImageMetaProps,protected=<?>,size=21430272,status='active',tags=<?>,updated_at=2023-07-29T13:29:27Z,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:02:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-220515737',display_name='tempest-VolumesActionsTest-instance-220515737',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-220515737',id=50,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05bd77abd6fc41499a1071d21320227d',ramdisk_id='',reservation_id='r-si5z4l56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1523708427',owner_user_name='tempest-VolumesActionsTest-1523708427-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:02:20Z,user_data=None,user_id='044799f22df449fb82aeef584dcf72e6',uuid=8a7a4543-0848-4e94-a424-8a3bc5883359,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d05fd16-9ec0-4eb3-97d0-b0a763fce22d", "address": "fa:16:3e:55:a5:8d", "network": {"id": "2ddc9999-9ee3-464c-9f09-409be4323fa8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413085584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bd77abd6fc41499a1071d21320227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d05fd16-9e", "ovs_interfaceid": "4d05fd16-9ec0-4eb3-97d0-b0a763fce22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Converting VIF {"id": "4d05fd16-9ec0-4eb3-97d0-b0a763fce22d", "address": "fa:16:3e:55:a5:8d", "network": {"id": "2ddc9999-9ee3-464c-9f09-409be4323fa8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413085584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bd77abd6fc41499a1071d21320227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d05fd16-9e", "ovs_interfaceid": "4d05fd16-9ec0-4eb3-97d0-b0a763fce22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:a5:8d,bridge_name='br-int',has_traffic_filtering=True,id=4d05fd16-9ec0-4eb3-97d0-b0a763fce22d,network=Network(2ddc9999-9ee3-464c-9f09-409be4323fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d05fd16-9e') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG nova.objects.instance [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lazy-loading 'pci_devices' on Instance uuid 8a7a4543-0848-4e94-a424-8a3bc5883359 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:02:21 user nova-compute[231753]:   <uuid>8a7a4543-0848-4e94-a424-8a3bc5883359</uuid>
Jul 29 14:02:21 user nova-compute[231753]:   <name>instance-00000032</name>
Jul 29 14:02:21 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 14:02:21 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 14:02:21 user nova-compute[231753]:   <metadata>
Jul 29 14:02:21 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:02:21 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 14:02:21 user nova-compute[231753]:       <nova:name>tempest-VolumesActionsTest-instance-220515737</nova:name>
Jul 29 14:02:21 user nova-compute[231753]:       <nova:creationTime>2023-07-29 14:02:21</nova:creationTime>
Jul 29 14:02:21 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 14:02:21 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 14:02:21 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 14:02:21 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 14:02:21 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:02:21 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:02:21 user nova-compute[231753]:       </nova:flavor>
Jul 29 14:02:21 user nova-compute[231753]:       <nova:owner>
Jul 29 14:02:21 user nova-compute[231753]:         <nova:user uuid="044799f22df449fb82aeef584dcf72e6">tempest-VolumesActionsTest-1523708427-project-member</nova:user>
Jul 29 14:02:21 user nova-compute[231753]:         <nova:project uuid="05bd77abd6fc41499a1071d21320227d">tempest-VolumesActionsTest-1523708427</nova:project>
Jul 29 14:02:21 user nova-compute[231753]:       </nova:owner>
Jul 29 14:02:21 user nova-compute[231753]:       <nova:root type="image" uuid="e16ae177-482e-47d8-a71b-737a50412c32"/>
Jul 29 14:02:21 user nova-compute[231753]:       <nova:ports>
Jul 29 14:02:21 user nova-compute[231753]:         <nova:port uuid="4d05fd16-9ec0-4eb3-97d0-b0a763fce22d">
Jul 29 14:02:21 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.8" ipVersion="4"/>
Jul 29 14:02:21 user nova-compute[231753]:         </nova:port>
Jul 29 14:02:21 user nova-compute[231753]:       </nova:ports>
Jul 29 14:02:21 user nova-compute[231753]:     </nova:instance>
Jul 29 14:02:21 user nova-compute[231753]:   </metadata>
Jul 29 14:02:21 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 14:02:21 user nova-compute[231753]:     <system>
Jul 29 14:02:21 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:02:21 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:02:21 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 14:02:21 user nova-compute[231753]:       <entry name="serial">8a7a4543-0848-4e94-a424-8a3bc5883359</entry>
Jul 29 14:02:21 user nova-compute[231753]:       <entry name="uuid">8a7a4543-0848-4e94-a424-8a3bc5883359</entry>
Jul 29 14:02:21 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:02:21 user nova-compute[231753]:     </system>
Jul 29 14:02:21 user nova-compute[231753]:   </sysinfo>
Jul 29 14:02:21 user nova-compute[231753]:   <os>
Jul 29 14:02:21 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:02:21 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 14:02:21 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 14:02:21 user nova-compute[231753]:   </os>
Jul 29 14:02:21 user nova-compute[231753]:   <features>
Jul 29 14:02:21 user nova-compute[231753]:     <acpi/>
Jul 29 14:02:21 user nova-compute[231753]:     <apic/>
Jul 29 14:02:21 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 14:02:21 user nova-compute[231753]:   </features>
Jul 29 14:02:21 user nova-compute[231753]:   <clock offset="utc">
Jul 29 14:02:21 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:02:21 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:02:21 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 14:02:21 user nova-compute[231753]:   </clock>
Jul 29 14:02:21 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 14:02:21 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 14:02:21 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:02:21 user nova-compute[231753]:   </cpu>
Jul 29 14:02:21 user nova-compute[231753]:   <devices>
Jul 29 14:02:21 user nova-compute[231753]:     <disk type="file" device="disk">
Jul 29 14:02:21 user nova-compute[231753]:       <driver name="qemu" type="qcow2" cache="none"/>
Jul 29 14:02:21 user nova-compute[231753]:       <source file="/opt/stack/data/nova/instances/8a7a4543-0848-4e94-a424-8a3bc5883359/disk"/>
Jul 29 14:02:21 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 14:02:21 user nova-compute[231753]:     </disk>
Jul 29 14:02:21 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 14:02:21 user nova-compute[231753]:       <mac address="fa:16:3e:55:a5:8d"/>
Jul 29 14:02:21 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 14:02:21 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 14:02:21 user nova-compute[231753]:       <target dev="tap4d05fd16-9e"/>
Jul 29 14:02:21 user nova-compute[231753]:     </interface>
Jul 29 14:02:21 user nova-compute[231753]:     <serial type="pty">
Jul 29 14:02:21 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/8a7a4543-0848-4e94-a424-8a3bc5883359/console.log" append="off"/>
Jul 29 14:02:21 user nova-compute[231753]:     </serial>
Jul 29 14:02:21 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:02:21 user nova-compute[231753]:     <video>
Jul 29 14:02:21 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 14:02:21 user nova-compute[231753]:     </video>
Jul 29 14:02:21 user nova-compute[231753]:     <rng model="virtio">
Jul 29 14:02:21 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:02:21 user nova-compute[231753]:     </rng>
Jul 29 14:02:21 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:02:21 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 14:02:21 user nova-compute[231753]:       <stats period="10"/>
Jul 29 14:02:21 user nova-compute[231753]:     </memballoon>
Jul 29 14:02:21 user nova-compute[231753]:   </devices>
Jul 29 14:02:21 user nova-compute[231753]: </domain>
Jul 29 14:02:21 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:02:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-220515737',display_name='tempest-VolumesActionsTest-instance-220515737',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-220515737',id=50,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=None,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='05bd77abd6fc41499a1071d21320227d',ramdisk_id='',reservation_id='r-si5z4l56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesActionsTest-1523708427',owner_user_name='tempest-VolumesActionsTest-1523708427-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:02:20Z,user_data=None,user_id='044799f22df449fb82aeef584dcf72e6',uuid=8a7a4543-0848-4e94-a424-8a3bc5883359,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d05fd16-9ec0-4eb3-97d0-b0a763fce22d", "address": "fa:16:3e:55:a5:8d", "network": {"id": "2ddc9999-9ee3-464c-9f09-409be4323fa8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413085584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bd77abd6fc41499a1071d21320227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d05fd16-9e", "ovs_interfaceid": "4d05fd16-9ec0-4eb3-97d0-b0a763fce22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Converting VIF {"id": "4d05fd16-9ec0-4eb3-97d0-b0a763fce22d", "address": "fa:16:3e:55:a5:8d", "network": {"id": "2ddc9999-9ee3-464c-9f09-409be4323fa8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413085584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bd77abd6fc41499a1071d21320227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d05fd16-9e", "ovs_interfaceid": "4d05fd16-9ec0-4eb3-97d0-b0a763fce22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:a5:8d,bridge_name='br-int',has_traffic_filtering=True,id=4d05fd16-9ec0-4eb3-97d0-b0a763fce22d,network=Network(2ddc9999-9ee3-464c-9f09-409be4323fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d05fd16-9e') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG os_vif [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:a5:8d,bridge_name='br-int',has_traffic_filtering=True,id=4d05fd16-9ec0-4eb3-97d0-b0a763fce22d,network=Network(2ddc9999-9ee3-464c-9f09-409be4323fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d05fd16-9e') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d05fd16-9e, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tap4d05fd16-9e, col_values=(('external_ids', {'iface-id': '4d05fd16-9ec0-4eb3-97d0-b0a763fce22d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:55:a5:8d', 'vm-uuid': '8a7a4543-0848-4e94-a424-8a3bc5883359'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:02:21 user nova-compute[231753]: INFO os_vif [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:a5:8d,bridge_name='br-int',has_traffic_filtering=True,id=4d05fd16-9ec0-4eb3-97d0-b0a763fce22d,network=Network(2ddc9999-9ee3-464c-9f09-409be4323fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d05fd16-9e')
Jul 29 14:02:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:02:21 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] No VIF found with MAC fa:16:3e:55:a5:8d, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:02:22 user nova-compute[231753]: DEBUG nova.network.neutron [req-5a257d6c-75fd-4542-b7d5-363e3aa3f9d4 req-cb2a3f3b-88c5-4ebf-8a67-0008f72b33f7 service nova] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Updated VIF entry in instance network info cache for port 4d05fd16-9ec0-4eb3-97d0-b0a763fce22d. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:02:22 user nova-compute[231753]: DEBUG nova.network.neutron [req-5a257d6c-75fd-4542-b7d5-363e3aa3f9d4 req-cb2a3f3b-88c5-4ebf-8a67-0008f72b33f7 service nova] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Updating instance_info_cache with network_info: [{"id": "4d05fd16-9ec0-4eb3-97d0-b0a763fce22d", "address": "fa:16:3e:55:a5:8d", "network": {"id": "2ddc9999-9ee3-464c-9f09-409be4323fa8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413085584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bd77abd6fc41499a1071d21320227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d05fd16-9e", "ovs_interfaceid": "4d05fd16-9ec0-4eb3-97d0-b0a763fce22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:02:22 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-5a257d6c-75fd-4542-b7d5-363e3aa3f9d4 req-cb2a3f3b-88c5-4ebf-8a67-0008f72b33f7 service nova] Releasing lock "refresh_cache-8a7a4543-0848-4e94-a424-8a3bc5883359" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:02:22 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:02:22 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Searching for a device in session 54 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:02:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwWMitkh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:02:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.317s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:02:22 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] <== connect_volume: return (1319ms) {'type': 'block', 'scsi_wwn': '26165346230343863', 'path': '/dev/sdc'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:02:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26165346230343863', 'path': '/dev/sdc'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:02:22 user nova-compute[231753]: DEBUG nova.objects.instance [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lazy-loading 'flavor' on Instance uuid 441fd0df-b5a0-498f-8d02-eb1db2f45b4c {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:02:22 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 14:02:22 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:02:22 user nova-compute[231753]:   <source dev="/dev/sdc"/>
Jul 29 14:02:22 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:02:22 user nova-compute[231753]:   <serial>7ee95d79-887f-4038-b05a-b17b959bf393</serial>
Jul 29 14:02:22 user nova-compute[231753]: </disk>
Jul 29 14:02:22 user nova-compute[231753]:  {{(pid=231753) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 14:02:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:02:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] No BDM found with device name vdb, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:02:23 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] No VIF found with MAC fa:16:3e:8a:ab:14, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:02:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e5198409-9275-4c0d-8b15-a777cf265eab tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.743s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:02:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:02:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:02:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:02:23 user nova-compute[231753]: DEBUG nova.compute.manager [req-6238c885-1aff-4e41-b500-8c8fd2c1f47d req-5449ca71-c618-4869-9ae1-9ed66f481ae7 service nova] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Received event network-vif-plugged-4d05fd16-9ec0-4eb3-97d0-b0a763fce22d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:02:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6238c885-1aff-4e41-b500-8c8fd2c1f47d req-5449ca71-c618-4869-9ae1-9ed66f481ae7 service nova] Acquiring lock "8a7a4543-0848-4e94-a424-8a3bc5883359-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:02:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6238c885-1aff-4e41-b500-8c8fd2c1f47d req-5449ca71-c618-4869-9ae1-9ed66f481ae7 service nova] Lock "8a7a4543-0848-4e94-a424-8a3bc5883359-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.007s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:02:23 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6238c885-1aff-4e41-b500-8c8fd2c1f47d req-5449ca71-c618-4869-9ae1-9ed66f481ae7 service nova] Lock "8a7a4543-0848-4e94-a424-8a3bc5883359-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:02:23 user nova-compute[231753]: DEBUG nova.compute.manager [req-6238c885-1aff-4e41-b500-8c8fd2c1f47d req-5449ca71-c618-4869-9ae1-9ed66f481ae7 service nova] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] No waiting events found dispatching network-vif-plugged-4d05fd16-9ec0-4eb3-97d0-b0a763fce22d {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:02:23 user nova-compute[231753]: WARNING nova.compute.manager [req-6238c885-1aff-4e41-b500-8c8fd2c1f47d req-5449ca71-c618-4869-9ae1-9ed66f481ae7 service nova] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Received unexpected event network-vif-plugged-4d05fd16-9ec0-4eb3-97d0-b0a763fce22d for instance with vm_state building and task_state spawning.
Jul 29 14:02:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:02:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:02:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:02:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:02:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:02:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:02:25 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690639345.5473766, 8a7a4543-0848-4e94-a424-8a3bc5883359 => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:02:25 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] VM Resumed (Lifecycle Event)
Jul 29 14:02:25 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:02:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:02:25 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Instance spawned successfully.
Jul 29 14:02:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:02:25 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:02:25 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:02:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:02:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:02:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:02:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:02:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:02:25 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:02:25 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:02:25 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690639345.55092, 8a7a4543-0848-4e94-a424-8a3bc5883359 => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:02:25 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] VM Started (Lifecycle Event)
Jul 29 14:02:25 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:02:25 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:02:25 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:02:25 user nova-compute[231753]: INFO nova.compute.manager [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Took 5.90 seconds to spawn the instance on the hypervisor.
Jul 29 14:02:25 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:02:25 user nova-compute[231753]: DEBUG nova.compute.manager [req-dff94ff7-873e-44d3-9828-6cc3fff34f8f req-0e266ddb-6c65-4a93-9828-0b6d38364681 service nova] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Received event network-vif-plugged-4d05fd16-9ec0-4eb3-97d0-b0a763fce22d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:02:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-dff94ff7-873e-44d3-9828-6cc3fff34f8f req-0e266ddb-6c65-4a93-9828-0b6d38364681 service nova] Acquiring lock "8a7a4543-0848-4e94-a424-8a3bc5883359-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:02:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-dff94ff7-873e-44d3-9828-6cc3fff34f8f req-0e266ddb-6c65-4a93-9828-0b6d38364681 service nova] Lock "8a7a4543-0848-4e94-a424-8a3bc5883359-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:02:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-dff94ff7-873e-44d3-9828-6cc3fff34f8f req-0e266ddb-6c65-4a93-9828-0b6d38364681 service nova] Lock "8a7a4543-0848-4e94-a424-8a3bc5883359-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:02:25 user nova-compute[231753]: DEBUG nova.compute.manager [req-dff94ff7-873e-44d3-9828-6cc3fff34f8f req-0e266ddb-6c65-4a93-9828-0b6d38364681 service nova] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] No waiting events found dispatching network-vif-plugged-4d05fd16-9ec0-4eb3-97d0-b0a763fce22d {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:02:25 user nova-compute[231753]: WARNING nova.compute.manager [req-dff94ff7-873e-44d3-9828-6cc3fff34f8f req-0e266ddb-6c65-4a93-9828-0b6d38364681 service nova] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Received unexpected event network-vif-plugged-4d05fd16-9ec0-4eb3-97d0-b0a763fce22d for instance with vm_state building and task_state spawning.
Jul 29 14:02:25 user nova-compute[231753]: INFO nova.compute.manager [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Took 6.58 seconds to build instance.
Jul 29 14:02:25 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ff6c55ad-8e13-4514-a0c5-6999f2a208c2 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lock "8a7a4543-0848-4e94-a424-8a3bc5883359" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 6.666s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:02:26 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:02:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:02:28 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:02:28 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 14:02:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "refresh_cache-441fd0df-b5a0-498f-8d02-eb1db2f45b4c" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:02:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquired lock "refresh_cache-441fd0df-b5a0-498f-8d02-eb1db2f45b4c" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:02:28 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Forcefully refreshing network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 14:02:29 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Updating instance_info_cache with network_info: [{"id": "e65ce885-2848-4c59-b069-2d3fffab8131", "address": "fa:16:3e:8a:ab:14", "network": {"id": "e850e031-78cb-4491-bc2e-1558870dee53", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1563208818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c63557bedc94739802fe008139488ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65ce885-28", "ovs_interfaceid": "e65ce885-2848-4c59-b069-2d3fffab8131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:02:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Releasing lock "refresh_cache-441fd0df-b5a0-498f-8d02-eb1db2f45b4c" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:02:29 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Updated the network info_cache for instance {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 14:02:29 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:02:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:02:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:02:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:02:29 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 14:02:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:02:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:02:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk --force-share --output=json" returned: 0 in 0.163s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a7a4543-0848-4e94-a424-8a3bc5883359/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a7a4543-0848-4e94-a424-8a3bc5883359/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a7a4543-0848-4e94-a424-8a3bc5883359/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a7a4543-0848-4e94-a424-8a3bc5883359/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db109e2-0918-42d4-9b19-4a0c72a08370/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db109e2-0918-42d4-9b19-4a0c72a08370/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db109e2-0918-42d4-9b19-4a0c72a08370/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db109e2-0918-42d4-9b19-4a0c72a08370/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk --force-share --output=json" returned: 0 in 0.159s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:30 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdc (vdb) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:02:30 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:02:30 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:02:30 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=8154MB free_disk=24.973312377929688GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 14:02:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:02:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:02:30 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:02:30 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 441fd0df-b5a0-498f-8d02-eb1db2f45b4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:02:30 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 4db109e2-0918-42d4-9b19-4a0c72a08370 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:02:30 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 6bc5023f-6d34-4edc-b189-47d40e58122f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:02:30 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8a7a4543-0848-4e94-a424-8a3bc5883359 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:02:30 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 14:02:30 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 14:02:31 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:02:31 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:02:31 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 14:02:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.354s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:02:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:02:32 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:02:32 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:02:32 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:02:32 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:02:32 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 14:02:33 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:02:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:02:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:02:38 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:02:39 user nova-compute[231753]: DEBUG nova.compute.manager [req-b60242ba-dad0-42ca-8ae3-f8dda0aa6113 req-4c2622e0-1965-41e2-af9d-762d1ecf1578 service nova] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Received event network-changed-3b1ceda0-41f5-4ce0-b4f8-948252b2af4c {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:02:39 user nova-compute[231753]: DEBUG nova.compute.manager [req-b60242ba-dad0-42ca-8ae3-f8dda0aa6113 req-4c2622e0-1965-41e2-af9d-762d1ecf1578 service nova] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Refreshing instance network info cache due to event network-changed-3b1ceda0-41f5-4ce0-b4f8-948252b2af4c. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:02:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b60242ba-dad0-42ca-8ae3-f8dda0aa6113 req-4c2622e0-1965-41e2-af9d-762d1ecf1578 service nova] Acquiring lock "refresh_cache-4db109e2-0918-42d4-9b19-4a0c72a08370" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:02:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b60242ba-dad0-42ca-8ae3-f8dda0aa6113 req-4c2622e0-1965-41e2-af9d-762d1ecf1578 service nova] Acquired lock "refresh_cache-4db109e2-0918-42d4-9b19-4a0c72a08370" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:02:39 user nova-compute[231753]: DEBUG nova.network.neutron [req-b60242ba-dad0-42ca-8ae3-f8dda0aa6113 req-4c2622e0-1965-41e2-af9d-762d1ecf1578 service nova] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Refreshing network info cache for port 3b1ceda0-41f5-4ce0-b4f8-948252b2af4c {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:02:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:02:39 user nova-compute[231753]: DEBUG nova.network.neutron [req-b60242ba-dad0-42ca-8ae3-f8dda0aa6113 req-4c2622e0-1965-41e2-af9d-762d1ecf1578 service nova] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Updated VIF entry in instance network info cache for port 3b1ceda0-41f5-4ce0-b4f8-948252b2af4c. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:02:39 user nova-compute[231753]: DEBUG nova.network.neutron [req-b60242ba-dad0-42ca-8ae3-f8dda0aa6113 req-4c2622e0-1965-41e2-af9d-762d1ecf1578 service nova] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Updating instance_info_cache with network_info: [{"id": "3b1ceda0-41f5-4ce0-b4f8-948252b2af4c", "address": "fa:16:3e:ce:b9:59", "network": {"id": "a10f7c69-0720-46b5-b252-6523dc61a6ca", "bridge": "br-int", "label": "tempest-TestStampPattern-1661615052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28da183a39e9413ebf7f0bc22ea1ae5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1ceda0-41", "ovs_interfaceid": "3b1ceda0-41f5-4ce0-b4f8-948252b2af4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:02:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Acquiring lock "4db109e2-0918-42d4-9b19-4a0c72a08370" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:02:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "4db109e2-0918-42d4-9b19-4a0c72a08370" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:02:39 user nova-compute[231753]: DEBUG nova.objects.instance [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lazy-loading 'flavor' on Instance uuid 4db109e2-0918-42d4-9b19-4a0c72a08370 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:02:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-b60242ba-dad0-42ca-8ae3-f8dda0aa6113 req-4c2622e0-1965-41e2-af9d-762d1ecf1578 service nova] Releasing lock "refresh_cache-4db109e2-0918-42d4-9b19-4a0c72a08370" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:02:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "4db109e2-0918-42d4-9b19-4a0c72a08370" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.048s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:02:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Acquiring lock "4db109e2-0918-42d4-9b19-4a0c72a08370" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:02:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "4db109e2-0918-42d4-9b19-4a0c72a08370" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:02:39 user nova-compute[231753]: INFO nova.compute.manager [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Attaching volume bbfdfffe-a083-4838-a61c-1ff87fea9c01 to /dev/vdb
Jul 29 14:02:39 user nova-compute[231753]: DEBUG os_brick.utils [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:02:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[215a3928-9893-4896-86f3-f274cf433122]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[074e30e2-92e5-4887-9115-6f7c528694d8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:40 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4106fc0-ca49-4bcb-8d9c-f0ad5e461188]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:40 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[58ecef30-fc4f-4104-8980-91d97a703905]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:02:40 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:02:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:40 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:02:40 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:02:40 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba9402a3-a461-429e-bbf7-329735296304]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:40 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:02:40 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:02:40 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:02:40 user nova-compute[231753]: DEBUG os_brick.utils [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] <== get_connector_properties: return (142ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:02:40 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Updating existing volume attachment record: 3e52265a-116d-4b2c-82b5-2058dcad924f {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:02:41 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:02:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-f2130713-e46e-4223-b759-bbfa835692e0 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Acquiring lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:02:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-f2130713-e46e-4223-b759-bbfa835692e0 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:02:42 user nova-compute[231753]: INFO nova.compute.manager [None req-f2130713-e46e-4223-b759-bbfa835692e0 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Detaching volume 7ee95d79-887f-4038-b05a-b17b959bf393
Jul 29 14:02:42 user nova-compute[231753]: INFO nova.virt.block_device [None req-f2130713-e46e-4223-b759-bbfa835692e0 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Attempting to driver detach volume 7ee95d79-887f-4038-b05a-b17b959bf393 from mountpoint /dev/vdb
Jul 29 14:02:42 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-f2130713-e46e-4223-b759-bbfa835692e0 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Attempting to detach device vdb from instance 441fd0df-b5a0-498f-8d02-eb1db2f45b4c from the persistent domain config. {{(pid=231753) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 14:02:42 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-f2130713-e46e-4223-b759-bbfa835692e0 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:02:42 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:02:42 user nova-compute[231753]:   <source dev="/dev/sdc"/>
Jul 29 14:02:42 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:02:42 user nova-compute[231753]:   <serial>7ee95d79-887f-4038-b05a-b17b959bf393</serial>
Jul 29 14:02:42 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 14:02:42 user nova-compute[231753]: </disk>
Jul 29 14:02:42 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:02:42 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-f2130713-e46e-4223-b759-bbfa835692e0 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Successfully detached device vdb from instance 441fd0df-b5a0-498f-8d02-eb1db2f45b4c from the persistent domain config.
Jul 29 14:02:42 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-f2130713-e46e-4223-b759-bbfa835692e0 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 441fd0df-b5a0-498f-8d02-eb1db2f45b4c from the live domain config. {{(pid=231753) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 14:02:42 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-f2130713-e46e-4223-b759-bbfa835692e0 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:02:42 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:02:42 user nova-compute[231753]:   <source dev="/dev/sdc"/>
Jul 29 14:02:42 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:02:42 user nova-compute[231753]:   <serial>7ee95d79-887f-4038-b05a-b17b959bf393</serial>
Jul 29 14:02:42 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 14:02:42 user nova-compute[231753]: </disk>
Jul 29 14:02:42 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Received event <DeviceRemovedEvent: 1690639363.2370555, 441fd0df-b5a0-498f-8d02-eb1db2f45b4c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=231753) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-f2130713-e46e-4223-b759-bbfa835692e0 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 441fd0df-b5a0-498f-8d02-eb1db2f45b4c {{(pid=231753) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 14:02:43 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-f2130713-e46e-4223-b759-bbfa835692e0 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Successfully detached device vdb from instance 441fd0df-b5a0-498f-8d02-eb1db2f45b4c from the live domain config.
Jul 29 14:02:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2130713-e46e-4223-b759-bbfa835692e0 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2130713-e46e-4223-b759-bbfa835692e0 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'vwWMitkh', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:02:43 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-f2130713-e46e-4223-b759-bbfa835692e0 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:02:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-f2130713-e46e-4223-b759-bbfa835692e0 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-f2130713-e46e-4223-b759-bbfa835692e0 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3caf58c6-04d7-46c9-b574-757798615ec6]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2130713-e46e-4223-b759-bbfa835692e0 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 14:02:43 user nova-compute[231753]: No targets found.
Jul 29 14:02:43 user nova-compute[231753]: iSNS:
Jul 29 14:02:43 user nova-compute[231753]: No targets found.
Jul 29 14:02:43 user nova-compute[231753]: STATIC:
Jul 29 14:02:43 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26
Jul 29 14:02:43 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 14:02:43 user nova-compute[231753]:                 Iface Name: default
Jul 29 14:02:43 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393
Jul 29 14:02:43 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 14:02:43 user nova-compute[231753]:                 Iface Name: default
Jul 29 14:02:43 user nova-compute[231753]: FIRMWARE:
Jul 29 14:02:43 user nova-compute[231753]: No targets found.
Jul 29 14:02:43 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2130713-e46e-4223-b759-bbfa835692e0 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 14:02:43 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 14:02:43 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2130713-e46e-4223-b759-bbfa835692e0 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[057e89c0-390e-4c6e-a7e4-5e440847de2d]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3a4729-b698-485d-a36e-eef274a1e80d]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)\ntcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2130713-e46e-4223-b759-bbfa835692e0 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:02:43 user nova-compute[231753]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393 (non-flash)
Jul 29 14:02:43 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2130713-e46e-4223-b759-bbfa835692e0 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:02:43 user nova-compute[231753]: tcp: [54] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393 (non-flash)
Jul 29 14:02:43 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2130713-e46e-4223-b759-bbfa835692e0 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c983ad480>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393'): ({'sdc'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-f2130713-e46e-4223-b759-bbfa835692e0 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Removing single pathed devices sdc {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[91ff1c81-dd30-429a-b567-fd9445109642]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c7a7718-a227-4ca3-92e9-5ac60a93d57c]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-f2130713-e46e-4223-b759-bbfa835692e0 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Flushing IO for device /dev/sdc {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[22bd21ed-712d-455c-be37-9943399a496e]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-f2130713-e46e-4223-b759-bbfa835692e0 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.032s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[39126667-7534-4385-ab08-c1f2a8d87fa9]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-f2130713-e46e-4223-b759-bbfa835692e0 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-f2130713-e46e-4223-b759-bbfa835692e0 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] SCSI volumes sdc have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2130713-e46e-4223-b759-bbfa835692e0 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[93be2220-bcb4-4f3d-9a27-8c8021aa7b9b]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2130713-e46e-4223-b759-bbfa835692e0 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393 -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393 -p 172.16.0.220:3260 --logout" returned: 0 in 0.050s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee5fff59-5e89-451c-8109-2250506962ff]: (4, ('Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393, portal: 172.16.0.220,3260]\nLogout of [sid: 54, target: iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2130713-e46e-4223-b759-bbfa835692e0 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 54, target: iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393, portal: 172.16.0.220,3260]
Jul 29 14:02:43 user nova-compute[231753]: Logout of [sid: 54, target: iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393, portal: 172.16.0.220,3260] successful.
Jul 29 14:02:43 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393 -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:7ee95d79-887f-4038-b05a-b17b959bf393 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c273e386-156f-450a-8de0-eeb7c54d8c31]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2130713-e46e-4223-b759-bbfa835692e0 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-f2130713-e46e-4223-b759-bbfa835692e0 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.268s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-f2130713-e46e-4223-b759-bbfa835692e0 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] <== disconnect_volume: return (269ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:02:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f2130713-e46e-4223-b759-bbfa835692e0 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:02:44 user nova-compute[231753]: DEBUG nova.objects.instance [None req-f2130713-e46e-4223-b759-bbfa835692e0 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lazy-loading 'flavor' on Instance uuid 441fd0df-b5a0-498f-8d02-eb1db2f45b4c {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:02:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-f2130713-e46e-4223-b759-bbfa835692e0 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.621s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:02:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:02:46 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tqXYGUMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:02:47 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:02:47 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:02:47 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:02:47 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:02:47 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:02:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01 -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01 -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b05731c-2709-458d-b988-64dde6b3ed7e]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:02:47 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01 -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ccb4d071-b28a-4ceb-90c0-2e9a63073583]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01] added
Jul 29 14:02:47 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[960333ac-54d0-4e70-8711-4a0e9a859d39]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f3ac7c4-0399-42b5-872b-ed9da9036bdc]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tqXYGUMI {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tqXYGUMI" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a6975b4-208d-4d28-ae3c-b49494f7bc39]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tqXYGUMI'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2863eb2-41fa-4eb5-9808-97ec56f99273]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c667d0a4-35fb-41b8-a4fe-e7d08d412b2f]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:02:47 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:02:47 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01 -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01 -p 172.16.0.220:3260 --login" returned: 0 in 0.069s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[151a02ca-c161-49cc-9642-0bf2b5bdf9d2]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01, portal: 172.16.0.220,3260]
Jul 29 14:02:47 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01, portal: 172.16.0.220,3260] successful.
Jul 29 14:02:47 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[04aa2739-1708-4cba-bd28-cbd921c37c2a]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a085b534-6429-4873-a6bd-b00895ca8fdf]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:02:47 user nova-compute[231753]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01 (non-flash)
Jul 29 14:02:47 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:02:47 user nova-compute[231753]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01 (non-flash)
Jul 29 14:02:47 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.304s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] HCTL ('34', '-', '-', 0) found on session 55 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[179914bd-c5d0-4c71-9586-d950b22ecc58]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Searching for a device in session 55 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:02:47 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tqXYGUMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:02:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.339s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:02:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] <== connect_volume: return (1340ms) {'type': 'block', 'scsi_wwn': '23334306233633165', 'path': '/dev/sdc'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:02:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23334306233633165', 'path': '/dev/sdc'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:02:48 user nova-compute[231753]: DEBUG nova.objects.instance [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lazy-loading 'flavor' on Instance uuid 4db109e2-0918-42d4-9b19-4a0c72a08370 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:02:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 14:02:48 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:02:48 user nova-compute[231753]:   <source dev="/dev/sdc"/>
Jul 29 14:02:48 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:02:48 user nova-compute[231753]:   <serial>bbfdfffe-a083-4838-a61c-1ff87fea9c01</serial>
Jul 29 14:02:48 user nova-compute[231753]: </disk>
Jul 29 14:02:48 user nova-compute[231753]:  {{(pid=231753) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 14:02:49 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:02:49 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] No BDM found with device name vdb, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:02:49 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] No VIF found with MAC fa:16:3e:ce:b9:59, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:02:49 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9a7ddd3f-6f93-440c-9aa1-d044de2bf001 tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "4db109e2-0918-42d4-9b19-4a0c72a08370" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.318s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:02:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:02:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ff7908da-9712-459b-b68b-49fc50405fdf tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Acquiring lock "4db109e2-0918-42d4-9b19-4a0c72a08370" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:02:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ff7908da-9712-459b-b68b-49fc50405fdf tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "4db109e2-0918-42d4-9b19-4a0c72a08370" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:02:50 user nova-compute[231753]: INFO nova.compute.manager [None req-ff7908da-9712-459b-b68b-49fc50405fdf tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Detaching volume bbfdfffe-a083-4838-a61c-1ff87fea9c01
Jul 29 14:02:50 user nova-compute[231753]: INFO nova.virt.block_device [None req-ff7908da-9712-459b-b68b-49fc50405fdf tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Attempting to driver detach volume bbfdfffe-a083-4838-a61c-1ff87fea9c01 from mountpoint /dev/vdb
Jul 29 14:02:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ff7908da-9712-459b-b68b-49fc50405fdf tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Attempting to detach device vdb from instance 4db109e2-0918-42d4-9b19-4a0c72a08370 from the persistent domain config. {{(pid=231753) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 14:02:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-ff7908da-9712-459b-b68b-49fc50405fdf tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:02:50 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:02:50 user nova-compute[231753]:   <source dev="/dev/sdc"/>
Jul 29 14:02:50 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:02:50 user nova-compute[231753]:   <serial>bbfdfffe-a083-4838-a61c-1ff87fea9c01</serial>
Jul 29 14:02:50 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 14:02:50 user nova-compute[231753]: </disk>
Jul 29 14:02:50 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:02:50 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-ff7908da-9712-459b-b68b-49fc50405fdf tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Successfully detached device vdb from instance 4db109e2-0918-42d4-9b19-4a0c72a08370 from the persistent domain config.
Jul 29 14:02:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ff7908da-9712-459b-b68b-49fc50405fdf tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 4db109e2-0918-42d4-9b19-4a0c72a08370 from the live domain config. {{(pid=231753) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 14:02:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-ff7908da-9712-459b-b68b-49fc50405fdf tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:02:50 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:02:50 user nova-compute[231753]:   <source dev="/dev/sdc"/>
Jul 29 14:02:50 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:02:50 user nova-compute[231753]:   <serial>bbfdfffe-a083-4838-a61c-1ff87fea9c01</serial>
Jul 29 14:02:50 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 14:02:50 user nova-compute[231753]: </disk>
Jul 29 14:02:50 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Received event <DeviceRemovedEvent: 1690639371.393556, 4db109e2-0918-42d4-9b19-4a0c72a08370 => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=231753) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-ff7908da-9712-459b-b68b-49fc50405fdf tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 4db109e2-0918-42d4-9b19-4a0c72a08370 {{(pid=231753) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 14:02:51 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-ff7908da-9712-459b-b68b-49fc50405fdf tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Successfully detached device vdb from instance 4db109e2-0918-42d4-9b19-4a0c72a08370 from the live domain config.
Jul 29 14:02:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff7908da-9712-459b-b68b-49fc50405fdf tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff7908da-9712-459b-b68b-49fc50405fdf tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tqXYGUMI', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:02:51 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-ff7908da-9712-459b-b68b-49fc50405fdf tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:02:51 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-ff7908da-9712-459b-b68b-49fc50405fdf tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-ff7908da-9712-459b-b68b-49fc50405fdf tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93a0285-3f65-4788-a6f8-611faf1aca14]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff7908da-9712-459b-b68b-49fc50405fdf tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 14:02:51 user nova-compute[231753]: No targets found.
Jul 29 14:02:51 user nova-compute[231753]: iSNS:
Jul 29 14:02:51 user nova-compute[231753]: No targets found.
Jul 29 14:02:51 user nova-compute[231753]: STATIC:
Jul 29 14:02:51 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26
Jul 29 14:02:51 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 14:02:51 user nova-compute[231753]:                 Iface Name: default
Jul 29 14:02:51 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01
Jul 29 14:02:51 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 14:02:51 user nova-compute[231753]:                 Iface Name: default
Jul 29 14:02:51 user nova-compute[231753]: FIRMWARE:
Jul 29 14:02:51 user nova-compute[231753]: No targets found.
Jul 29 14:02:51 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff7908da-9712-459b-b68b-49fc50405fdf tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 14:02:51 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 14:02:51 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff7908da-9712-459b-b68b-49fc50405fdf tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[233c8b39-292c-4965-92a2-755d7f0a3c2e]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f88a885e-d244-48c5-8675-b024afa1adde]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)\ntcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff7908da-9712-459b-b68b-49fc50405fdf tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:02:51 user nova-compute[231753]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01 (non-flash)
Jul 29 14:02:51 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff7908da-9712-459b-b68b-49fc50405fdf tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:02:51 user nova-compute[231753]: tcp: [55] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01 (non-flash)
Jul 29 14:02:51 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff7908da-9712-459b-b68b-49fc50405fdf tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c805a7130>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01'): ({'sdc'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-ff7908da-9712-459b-b68b-49fc50405fdf tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Removing single pathed devices sdc {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[85fc8657-5f27-4c9d-ae0b-dcecc1516fe4]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c258228b-d770-4856-a336-d8bd8caf6d27]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-ff7908da-9712-459b-b68b-49fc50405fdf tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Flushing IO for device /dev/sdc {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[db087353-484d-457a-a7cd-42387a980adc]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-ff7908da-9712-459b-b68b-49fc50405fdf tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.040s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[06e20591-12f5-4928-b5df-a49365888a30]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-ff7908da-9712-459b-b68b-49fc50405fdf tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-ff7908da-9712-459b-b68b-49fc50405fdf tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] SCSI volumes sdc have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff7908da-9712-459b-b68b-49fc50405fdf tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[542e85cf-6217-48da-85d8-af3d96d56731]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff7908da-9712-459b-b68b-49fc50405fdf tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01 -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01 -p 172.16.0.220:3260 --logout" returned: 0 in 0.058s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[954abac5-1047-4d7e-bba9-dce1782bfc6b]: (4, ('Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01, portal: 172.16.0.220,3260]\nLogout of [sid: 55, target: iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff7908da-9712-459b-b68b-49fc50405fdf tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 55, target: iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01, portal: 172.16.0.220,3260]
Jul 29 14:02:51 user nova-compute[231753]: Logout of [sid: 55, target: iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01, portal: 172.16.0.220,3260] successful.
Jul 29 14:02:51 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01 -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bbfdfffe-a083-4838-a61c-1ff87fea9c01 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[203e5cf1-818e-4d36-9f68-30f8c36c4a51]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff7908da-9712-459b-b68b-49fc50405fdf tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-ff7908da-9712-459b-b68b-49fc50405fdf tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.288s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff7908da-9712-459b-b68b-49fc50405fdf tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] <== disconnect_volume: return (289ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff7908da-9712-459b-b68b-49fc50405fdf tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:02:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:02:52 user nova-compute[231753]: DEBUG nova.objects.instance [None req-ff7908da-9712-459b-b68b-49fc50405fdf tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lazy-loading 'flavor' on Instance uuid 4db109e2-0918-42d4-9b19-4a0c72a08370 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:02:52 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ff7908da-9712-459b-b68b-49fc50405fdf tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "4db109e2-0918-42d4-9b19-4a0c72a08370" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.585s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:02:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:02:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:02:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:03:01 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:03:06 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:03:11 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:03:11 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:03:11 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=231753) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 14:03:11 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 14:03:11 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 14:03:11 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:03:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:03:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:03:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:03:19 user nova-compute[231753]: DEBUG nova.compute.manager [req-bedcd19a-7c60-4bcc-8725-5321dfc766b6 req-8402ffe5-843a-4b52-a726-830b35734b99 service nova] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Received event network-changed-d3fc41a6-4687-4c01-b262-4c09c02345ff {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:03:19 user nova-compute[231753]: DEBUG nova.compute.manager [req-bedcd19a-7c60-4bcc-8725-5321dfc766b6 req-8402ffe5-843a-4b52-a726-830b35734b99 service nova] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Refreshing instance network info cache due to event network-changed-d3fc41a6-4687-4c01-b262-4c09c02345ff. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:03:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bedcd19a-7c60-4bcc-8725-5321dfc766b6 req-8402ffe5-843a-4b52-a726-830b35734b99 service nova] Acquiring lock "refresh_cache-6bc5023f-6d34-4edc-b189-47d40e58122f" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:03:19 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bedcd19a-7c60-4bcc-8725-5321dfc766b6 req-8402ffe5-843a-4b52-a726-830b35734b99 service nova] Acquired lock "refresh_cache-6bc5023f-6d34-4edc-b189-47d40e58122f" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:03:19 user nova-compute[231753]: DEBUG nova.network.neutron [req-bedcd19a-7c60-4bcc-8725-5321dfc766b6 req-8402ffe5-843a-4b52-a726-830b35734b99 service nova] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Refreshing network info cache for port d3fc41a6-4687-4c01-b262-4c09c02345ff {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:03:20 user nova-compute[231753]: DEBUG nova.network.neutron [req-bedcd19a-7c60-4bcc-8725-5321dfc766b6 req-8402ffe5-843a-4b52-a726-830b35734b99 service nova] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Updated VIF entry in instance network info cache for port d3fc41a6-4687-4c01-b262-4c09c02345ff. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:03:20 user nova-compute[231753]: DEBUG nova.network.neutron [req-bedcd19a-7c60-4bcc-8725-5321dfc766b6 req-8402ffe5-843a-4b52-a726-830b35734b99 service nova] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Updating instance_info_cache with network_info: [{"id": "d3fc41a6-4687-4c01-b262-4c09c02345ff", "address": "fa:16:3e:b1:c8:f9", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3fc41a6-46", "ovs_interfaceid": "d3fc41a6-4687-4c01-b262-4c09c02345ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:03:20 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-bedcd19a-7c60-4bcc-8725-5321dfc766b6 req-8402ffe5-843a-4b52-a726-830b35734b99 service nova] Releasing lock "refresh_cache-6bc5023f-6d34-4edc-b189-47d40e58122f" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:03:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:03:23 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:03:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:03:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:03:28 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:03:29 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:03:29 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:03:29 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 14:03:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:03:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "refresh_cache-4db109e2-0918-42d4-9b19-4a0c72a08370" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:03:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquired lock "refresh_cache-4db109e2-0918-42d4-9b19-4a0c72a08370" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:03:29 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Forcefully refreshing network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 14:03:30 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Updating instance_info_cache with network_info: [{"id": "3b1ceda0-41f5-4ce0-b4f8-948252b2af4c", "address": "fa:16:3e:ce:b9:59", "network": {"id": "a10f7c69-0720-46b5-b252-6523dc61a6ca", "bridge": "br-int", "label": "tempest-TestStampPattern-1661615052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28da183a39e9413ebf7f0bc22ea1ae5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1ceda0-41", "ovs_interfaceid": "3b1ceda0-41f5-4ce0-b4f8-948252b2af4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:03:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Releasing lock "refresh_cache-4db109e2-0918-42d4-9b19-4a0c72a08370" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:03:30 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Updated the network info_cache for instance {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 14:03:30 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:03:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:03:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:03:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:03:30 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 14:03:30 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:03:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a7a4543-0848-4e94-a424-8a3bc5883359/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a7a4543-0848-4e94-a424-8a3bc5883359/disk --force-share --output=json" returned: 0 in 0.136s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a7a4543-0848-4e94-a424-8a3bc5883359/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8a7a4543-0848-4e94-a424-8a3bc5883359/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db109e2-0918-42d4-9b19-4a0c72a08370/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db109e2-0918-42d4-9b19-4a0c72a08370/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:30 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db109e2-0918-42d4-9b19-4a0c72a08370/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:31 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4db109e2-0918-42d4-9b19-4a0c72a08370/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:31 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:31 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk --force-share --output=json" returned: 0 in 0.137s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:31 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:31 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk --force-share --output=json" returned: 0 in 0.140s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:31 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:03:31 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:03:31 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=8114MB free_disk=24.943679809570312GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 14:03:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:03:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:03:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:03:31 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:03:31 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 441fd0df-b5a0-498f-8d02-eb1db2f45b4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:03:31 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 4db109e2-0918-42d4-9b19-4a0c72a08370 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:03:31 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 6bc5023f-6d34-4edc-b189-47d40e58122f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:03:31 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8a7a4543-0848-4e94-a424-8a3bc5883359 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:03:31 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 5 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 14:03:31 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=3072MB phys_disk=40GB used_disk=4GB total_vcpus=12 used_vcpus=5 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 14:03:32 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:03:32 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:03:32 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 14:03:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.325s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:03:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "74232e48-360a-47c9-81da-7c7e66734fdb" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:03:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "74232e48-360a-47c9-81da-7c7e66734fdb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:03:32 user nova-compute[231753]: DEBUG nova.compute.manager [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Starting instance... {{(pid=231753) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2406}}
Jul 29 14:03:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:03:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:03:32 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=231753) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2338}}
Jul 29 14:03:32 user nova-compute[231753]: INFO nova.compute.claims [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Claim successful on node user
Jul 29 14:03:32 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:03:32 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:03:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 0.302s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:03:32 user nova-compute[231753]: DEBUG nova.compute.manager [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Start building networks asynchronously for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2803}}
Jul 29 14:03:32 user nova-compute[231753]: DEBUG nova.compute.manager [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Allocating IP information in the background. {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1956}}
Jul 29 14:03:32 user nova-compute[231753]: DEBUG nova.network.neutron [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] allocate_for_instance() {{(pid=231753) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1156}}
Jul 29 14:03:32 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names
Jul 29 14:03:32 user nova-compute[231753]: DEBUG nova.compute.manager [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Start building block device mappings for instance. {{(pid=231753) _build_resources /opt/stack/nova/nova/compute/manager.py:2838}}
Jul 29 14:03:32 user nova-compute[231753]: INFO nova.virt.block_device [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Booting with volume 50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d at /dev/vda
Jul 29 14:03:32 user nova-compute[231753]: DEBUG nova.policy [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'd94a7ea0c19845b886e12c1689cf30a8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f45c92d3fe964066b9be87489b2c9f7e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=231753) authorize /opt/stack/nova/nova/policy.py:203}}
Jul 29 14:03:33 user nova-compute[231753]: DEBUG os_brick.utils [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:03:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[51676c39-355b-4d7e-8f0a-9188fbf0ee25]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c674e370-86e3-4786-88d3-7191826eef18]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d40e308c-75e6-4a1c-8b2f-bf4b55874993]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab5a4235-79b3-49ec-9f0e-7cb72e0353cb]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:03:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:03:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:03:33 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:03:33 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcd70e96-30e0-44e5-ab24-dda5068491c9]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:03:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:03:33 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:03:33 user nova-compute[231753]: DEBUG os_brick.utils [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:03:33 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Updating existing volume attachment record: 79b94ed5-2af5-44ab-ad95-f77c170df391 {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:03:33 user nova-compute[231753]: DEBUG nova.network.neutron [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Successfully created port: d57bdf1d-7d02-4c93-a94c-64c0c863f901 {{(pid=231753) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:548}}
Jul 29 14:03:34 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:03:34 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:03:34 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:03:34 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:03:34 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:03:34 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 14:03:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:03:34 user nova-compute[231753]: DEBUG nova.network.neutron [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Successfully updated port: d57bdf1d-7d02-4c93-a94c-64c0c863f901 {{(pid=231753) _update_port /opt/stack/nova/nova/network/neutron.py:586}}
Jul 29 14:03:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "refresh_cache-74232e48-360a-47c9-81da-7c7e66734fdb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:03:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquired lock "refresh_cache-74232e48-360a-47c9-81da-7c7e66734fdb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:03:34 user nova-compute[231753]: DEBUG nova.network.neutron [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Building network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2002}}
Jul 29 14:03:34 user nova-compute[231753]: DEBUG nova.compute.manager [req-8b8f65d9-6c69-4cd7-b7a6-19c0f81c0b33 req-bb4ca6c2-2cd3-413e-b45d-bd769f2545ef service nova] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Received event network-changed-d57bdf1d-7d02-4c93-a94c-64c0c863f901 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:03:34 user nova-compute[231753]: DEBUG nova.compute.manager [req-8b8f65d9-6c69-4cd7-b7a6-19c0f81c0b33 req-bb4ca6c2-2cd3-413e-b45d-bd769f2545ef service nova] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Refreshing instance network info cache due to event network-changed-d57bdf1d-7d02-4c93-a94c-64c0c863f901. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:03:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8b8f65d9-6c69-4cd7-b7a6-19c0f81c0b33 req-bb4ca6c2-2cd3-413e-b45d-bd769f2545ef service nova] Acquiring lock "refresh_cache-74232e48-360a-47c9-81da-7c7e66734fdb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:03:34 user nova-compute[231753]: DEBUG nova.network.neutron [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Instance cache missing network info. {{(pid=231753) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3315}}
Jul 29 14:03:35 user nova-compute[231753]: DEBUG nova.network.neutron [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Updating instance_info_cache with network_info: [{"id": "d57bdf1d-7d02-4c93-a94c-64c0c863f901", "address": "fa:16:3e:c0:01:56", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57bdf1d-7d", "ovs_interfaceid": "d57bdf1d-7d02-4c93-a94c-64c0c863f901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:03:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Releasing lock "refresh_cache-74232e48-360a-47c9-81da-7c7e66734fdb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:03:35 user nova-compute[231753]: DEBUG nova.compute.manager [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Instance network_info: |[{"id": "d57bdf1d-7d02-4c93-a94c-64c0c863f901", "address": "fa:16:3e:c0:01:56", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57bdf1d-7d", "ovs_interfaceid": "d57bdf1d-7d02-4c93-a94c-64c0c863f901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=231753) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:1971}}
Jul 29 14:03:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8b8f65d9-6c69-4cd7-b7a6-19c0f81c0b33 req-bb4ca6c2-2cd3-413e-b45d-bd769f2545ef service nova] Acquired lock "refresh_cache-74232e48-360a-47c9-81da-7c7e66734fdb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:03:35 user nova-compute[231753]: DEBUG nova.network.neutron [req-8b8f65d9-6c69-4cd7-b7a6-19c0f81c0b33 req-bb4ca6c2-2cd3-413e-b45d-bd769f2545ef service nova] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Refreshing network info cache for port d57bdf1d-7d02-4c93-a94c-64c0c863f901 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:03:35 user nova-compute[231753]: DEBUG nova.network.neutron [req-8b8f65d9-6c69-4cd7-b7a6-19c0f81c0b33 req-bb4ca6c2-2cd3-413e-b45d-bd769f2545ef service nova] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Updated VIF entry in instance network info cache for port d57bdf1d-7d02-4c93-a94c-64c0c863f901. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:03:35 user nova-compute[231753]: DEBUG nova.network.neutron [req-8b8f65d9-6c69-4cd7-b7a6-19c0f81c0b33 req-bb4ca6c2-2cd3-413e-b45d-bd769f2545ef service nova] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Updating instance_info_cache with network_info: [{"id": "d57bdf1d-7d02-4c93-a94c-64c0c863f901", "address": "fa:16:3e:c0:01:56", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57bdf1d-7d", "ovs_interfaceid": "d57bdf1d-7d02-4c93-a94c-64c0c863f901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:03:35 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8b8f65d9-6c69-4cd7-b7a6-19c0f81c0b33 req-bb4ca6c2-2cd3-413e-b45d-bd769f2545ef service nova] Releasing lock "refresh_cache-74232e48-360a-47c9-81da-7c7e66734fdb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:03:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:03:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Acquiring lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:03:38 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:03:38 user nova-compute[231753]: DEBUG nova.objects.instance [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lazy-loading 'flavor' on Instance uuid 441fd0df-b5a0-498f-8d02-eb1db2f45b4c {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:03:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.066s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:03:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Acquiring lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:03:39 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:03:39 user nova-compute[231753]: INFO nova.compute.manager [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Attaching volume e80e7c7e-dc90-4699-9971-825cb561d611 to /dev/vdb
Jul 29 14:03:39 user nova-compute[231753]: DEBUG os_brick.utils [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:03:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.013s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d904291-3308-4131-8706-b4f953074619]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4055cd73-c91c-4856-820e-56b9f52b70f1]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.015s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[47811c4b-f3b0-4dd6-9812-9d2b6cffbdc4]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[372ef3e1-9622-4160-b01a-d664c02f8a45]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:03:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:03:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:39 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:03:39 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:03:39 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e0c4de3-1528-4cb1-8720-4149413f38f4]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:03:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:03:39 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:03:39 user nova-compute[231753]: DEBUG os_brick.utils [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] <== get_connector_properties: return (120ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:03:39 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Updating existing volume attachment record: fc7dd45b-a38f-4b20-87b6-74e1ad0f5776 {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:03:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:03:41 user nova-compute[231753]: DEBUG nova.compute.manager [req-3016ab6e-20a6-4149-952a-27e10bad2929 req-76ab2d77-99c8-45a0-b4b9-4282c3a81c99 service nova] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Received event network-changed-3b1ceda0-41f5-4ce0-b4f8-948252b2af4c {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:03:41 user nova-compute[231753]: DEBUG nova.compute.manager [req-3016ab6e-20a6-4149-952a-27e10bad2929 req-76ab2d77-99c8-45a0-b4b9-4282c3a81c99 service nova] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Refreshing instance network info cache due to event network-changed-3b1ceda0-41f5-4ce0-b4f8-948252b2af4c. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:03:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3016ab6e-20a6-4149-952a-27e10bad2929 req-76ab2d77-99c8-45a0-b4b9-4282c3a81c99 service nova] Acquiring lock "refresh_cache-4db109e2-0918-42d4-9b19-4a0c72a08370" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:03:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3016ab6e-20a6-4149-952a-27e10bad2929 req-76ab2d77-99c8-45a0-b4b9-4282c3a81c99 service nova] Acquired lock "refresh_cache-4db109e2-0918-42d4-9b19-4a0c72a08370" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:03:41 user nova-compute[231753]: DEBUG nova.network.neutron [req-3016ab6e-20a6-4149-952a-27e10bad2929 req-76ab2d77-99c8-45a0-b4b9-4282c3a81c99 service nova] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Refreshing network info cache for port 3b1ceda0-41f5-4ce0-b4f8-948252b2af4c {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:03:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-15fac034-8abe-4b45-ba80-6c61ead98bcd tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Acquiring lock "4db109e2-0918-42d4-9b19-4a0c72a08370" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:03:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-15fac034-8abe-4b45-ba80-6c61ead98bcd tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "4db109e2-0918-42d4-9b19-4a0c72a08370" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:03:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-15fac034-8abe-4b45-ba80-6c61ead98bcd tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Acquiring lock "4db109e2-0918-42d4-9b19-4a0c72a08370-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:03:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-15fac034-8abe-4b45-ba80-6c61ead98bcd tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "4db109e2-0918-42d4-9b19-4a0c72a08370-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:03:41 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-15fac034-8abe-4b45-ba80-6c61ead98bcd tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "4db109e2-0918-42d4-9b19-4a0c72a08370-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:03:41 user nova-compute[231753]: INFO nova.compute.manager [None req-15fac034-8abe-4b45-ba80-6c61ead98bcd tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Terminating instance
Jul 29 14:03:41 user nova-compute[231753]: DEBUG nova.compute.manager [None req-15fac034-8abe-4b45-ba80-6c61ead98bcd tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 14:03:41 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:03:41 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:03:41 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:03:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:03:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:03:42 user nova-compute[231753]: DEBUG nova.network.neutron [req-3016ab6e-20a6-4149-952a-27e10bad2929 req-76ab2d77-99c8-45a0-b4b9-4282c3a81c99 service nova] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Updated VIF entry in instance network info cache for port 3b1ceda0-41f5-4ce0-b4f8-948252b2af4c. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:03:42 user nova-compute[231753]: DEBUG nova.network.neutron [req-3016ab6e-20a6-4149-952a-27e10bad2929 req-76ab2d77-99c8-45a0-b4b9-4282c3a81c99 service nova] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Updating instance_info_cache with network_info: [{"id": "3b1ceda0-41f5-4ce0-b4f8-948252b2af4c", "address": "fa:16:3e:ce:b9:59", "network": {"id": "a10f7c69-0720-46b5-b252-6523dc61a6ca", "bridge": "br-int", "label": "tempest-TestStampPattern-1661615052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28da183a39e9413ebf7f0bc22ea1ae5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1ceda0-41", "ovs_interfaceid": "3b1ceda0-41f5-4ce0-b4f8-948252b2af4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:03:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3016ab6e-20a6-4149-952a-27e10bad2929 req-76ab2d77-99c8-45a0-b4b9-4282c3a81c99 service nova] Releasing lock "refresh_cache-4db109e2-0918-42d4-9b19-4a0c72a08370" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:03:42 user nova-compute[231753]: DEBUG nova.compute.manager [req-137ac084-cb6e-48eb-a14f-4c9225c8bd1e req-8cb08ad6-f9fd-4216-88ce-13c6365468f1 service nova] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Received event network-vif-unplugged-3b1ceda0-41f5-4ce0-b4f8-948252b2af4c {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:03:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-137ac084-cb6e-48eb-a14f-4c9225c8bd1e req-8cb08ad6-f9fd-4216-88ce-13c6365468f1 service nova] Acquiring lock "4db109e2-0918-42d4-9b19-4a0c72a08370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:03:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-137ac084-cb6e-48eb-a14f-4c9225c8bd1e req-8cb08ad6-f9fd-4216-88ce-13c6365468f1 service nova] Lock "4db109e2-0918-42d4-9b19-4a0c72a08370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:03:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-137ac084-cb6e-48eb-a14f-4c9225c8bd1e req-8cb08ad6-f9fd-4216-88ce-13c6365468f1 service nova] Lock "4db109e2-0918-42d4-9b19-4a0c72a08370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:03:42 user nova-compute[231753]: DEBUG nova.compute.manager [req-137ac084-cb6e-48eb-a14f-4c9225c8bd1e req-8cb08ad6-f9fd-4216-88ce-13c6365468f1 service nova] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] No waiting events found dispatching network-vif-unplugged-3b1ceda0-41f5-4ce0-b4f8-948252b2af4c {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:03:42 user nova-compute[231753]: DEBUG nova.compute.manager [req-137ac084-cb6e-48eb-a14f-4c9225c8bd1e req-8cb08ad6-f9fd-4216-88ce-13c6365468f1 service nova] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Received event network-vif-unplugged-3b1ceda0-41f5-4ce0-b4f8-948252b2af4c for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:03:42 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Instance destroyed successfully.
Jul 29 14:03:42 user nova-compute[231753]: DEBUG nova.objects.instance [None req-15fac034-8abe-4b45-ba80-6c61ead98bcd tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lazy-loading 'resources' on Instance uuid 4db109e2-0918-42d4-9b19-4a0c72a08370 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:03:42 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-15fac034-8abe-4b45-ba80-6c61ead98bcd tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:00:46Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-2065518186',display_name='tempest-TestStampPattern-server-2065518186',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-2065518186',id=48,image_ref='5ada5696-44e9-4176-8af1-bdda4a22791d',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJ0UCuB1s/FcIxNR+PeaL27O4FLCSRuPA3sNGjkAYL2ft4zG9hnQn3p/NaR8N5IEf65ITJPm24CQQ3JghZ9yGOSsBJ6AidP6UmfWpGZKzXSpLz9fY7+5vRgRPmfh/cMFA==',key_name='tempest-TestStampPattern-2343879',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:00:55Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28da183a39e9413ebf7f0bc22ea1ae5d',ramdisk_id='',reservation_id='r-2z0i9pmu',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_boot_roles='member,reader',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_image_location='snapshot',image_image_state='available',image_image_type='snapshot',image_instance_uuid='8e8d1ee0-4906-4411-a1fd-c5997a22b5e8',image_min_disk='1',image_min_ram='0',image_owner_id='28da183a39e9413ebf7f0bc22ea1ae5d',image_owner_project_name='tempest-TestStampPattern-442563326',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',image_owner_user_name='tempest-TestStampPattern-442563326-project-member',image_user_id='fe8dbee1098a44418ba739f073503497',owner_project_name='tempest-TestStampPattern-442563326',owner_user_name='tempest-TestStampPattern-442563326-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:00:55Z,user_data=None,user_id='fe8dbee1098a44418ba739f073503497',uuid=4db109e2-0918-42d4-9b19-4a0c72a08370,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3b1ceda0-41f5-4ce0-b4f8-948252b2af4c", "address": "fa:16:3e:ce:b9:59", "network": {"id": "a10f7c69-0720-46b5-b252-6523dc61a6ca", "bridge": "br-int", "label": "tempest-TestStampPattern-1661615052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28da183a39e9413ebf7f0bc22ea1ae5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1ceda0-41", "ovs_interfaceid": "3b1ceda0-41f5-4ce0-b4f8-948252b2af4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:03:42 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-15fac034-8abe-4b45-ba80-6c61ead98bcd tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Converting VIF {"id": "3b1ceda0-41f5-4ce0-b4f8-948252b2af4c", "address": "fa:16:3e:ce:b9:59", "network": {"id": "a10f7c69-0720-46b5-b252-6523dc61a6ca", "bridge": "br-int", "label": "tempest-TestStampPattern-1661615052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.236", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28da183a39e9413ebf7f0bc22ea1ae5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap3b1ceda0-41", "ovs_interfaceid": "3b1ceda0-41f5-4ce0-b4f8-948252b2af4c", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:03:42 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-15fac034-8abe-4b45-ba80-6c61ead98bcd tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:ce:b9:59,bridge_name='br-int',has_traffic_filtering=True,id=3b1ceda0-41f5-4ce0-b4f8-948252b2af4c,network=Network(a10f7c69-0720-46b5-b252-6523dc61a6ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b1ceda0-41') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:03:42 user nova-compute[231753]: DEBUG os_vif [None req-15fac034-8abe-4b45-ba80-6c61ead98bcd tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:b9:59,bridge_name='br-int',has_traffic_filtering=True,id=3b1ceda0-41f5-4ce0-b4f8-948252b2af4c,network=Network(a10f7c69-0720-46b5-b252-6523dc61a6ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b1ceda0-41') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:03:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:03:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap3b1ceda0-41, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:03:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:03:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:03:42 user nova-compute[231753]: INFO os_vif [None req-15fac034-8abe-4b45-ba80-6c61ead98bcd tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:ce:b9:59,bridge_name='br-int',has_traffic_filtering=True,id=3b1ceda0-41f5-4ce0-b4f8-948252b2af4c,network=Network(a10f7c69-0720-46b5-b252-6523dc61a6ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3b1ceda0-41')
Jul 29 14:03:42 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-15fac034-8abe-4b45-ba80-6c61ead98bcd tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Deleting instance files /opt/stack/data/nova/instances/4db109e2-0918-42d4-9b19-4a0c72a08370_del
Jul 29 14:03:42 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-15fac034-8abe-4b45-ba80-6c61ead98bcd tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Deletion of /opt/stack/data/nova/instances/4db109e2-0918-42d4-9b19-4a0c72a08370_del complete
Jul 29 14:03:42 user nova-compute[231753]: INFO nova.compute.manager [None req-15fac034-8abe-4b45-ba80-6c61ead98bcd tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Took 0.91 seconds to destroy the instance on the hypervisor.
Jul 29 14:03:42 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-15fac034-8abe-4b45-ba80-6c61ead98bcd tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 14:03:42 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 14:03:42 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 14:03:43 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:03:43 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Took 0.51 seconds to deallocate network for instance.
Jul 29 14:03:43 user nova-compute[231753]: DEBUG nova.compute.manager [req-6d35525e-82b1-4425-88ad-95c59ef771a2 req-9b7ccdea-a2c2-46d5-bc59-69c93367668a service nova] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Received event network-vif-deleted-3b1ceda0-41f5-4ce0-b4f8-948252b2af4c {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:03:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-15fac034-8abe-4b45-ba80-6c61ead98bcd tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:03:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-15fac034-8abe-4b45-ba80-6c61ead98bcd tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:03:43 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-15fac034-8abe-4b45-ba80-6c61ead98bcd tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:03:43 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-15fac034-8abe-4b45-ba80-6c61ead98bcd tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:03:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-15fac034-8abe-4b45-ba80-6c61ead98bcd tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.222s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:03:43 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-15fac034-8abe-4b45-ba80-6c61ead98bcd tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Deleted allocations for instance 4db109e2-0918-42d4-9b19-4a0c72a08370
Jul 29 14:03:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-15fac034-8abe-4b45-ba80-6c61ead98bcd tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "4db109e2-0918-42d4-9b19-4a0c72a08370" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.844s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:03:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-a49724d3-9119-4f00-ba22-86bb058a653f req-43ae25c5-db93-4ef8-a00a-25206e368cfd service nova] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Received event network-vif-plugged-3b1ceda0-41f5-4ce0-b4f8-948252b2af4c {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:03:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a49724d3-9119-4f00-ba22-86bb058a653f req-43ae25c5-db93-4ef8-a00a-25206e368cfd service nova] Acquiring lock "4db109e2-0918-42d4-9b19-4a0c72a08370-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:03:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a49724d3-9119-4f00-ba22-86bb058a653f req-43ae25c5-db93-4ef8-a00a-25206e368cfd service nova] Lock "4db109e2-0918-42d4-9b19-4a0c72a08370-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:03:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a49724d3-9119-4f00-ba22-86bb058a653f req-43ae25c5-db93-4ef8-a00a-25206e368cfd service nova] Lock "4db109e2-0918-42d4-9b19-4a0c72a08370-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:03:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-a49724d3-9119-4f00-ba22-86bb058a653f req-43ae25c5-db93-4ef8-a00a-25206e368cfd service nova] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] No waiting events found dispatching network-vif-plugged-3b1ceda0-41f5-4ce0-b4f8-948252b2af4c {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:03:44 user nova-compute[231753]: WARNING nova.compute.manager [req-a49724d3-9119-4f00-ba22-86bb058a653f req-43ae25c5-db93-4ef8-a00a-25206e368cfd service nova] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Received unexpected event network-vif-plugged-3b1ceda0-41f5-4ce0-b4f8-948252b2af4c for instance with vm_state deleted and task_state None.
Jul 29 14:03:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG nova.compute.manager [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Start spawning the instance on the hypervisor. {{(pid=231753) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2612}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Creating instance directory {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4717}}
Jul 29 14:03:45 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Creating image(s)
Jul 29 14:03:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Did not create local disks {{(pid=231753) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:4853}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Ensure instance console log exists: /opt/stack/data/nova/instances/74232e48-360a-47c9-81da-7c7e66734fdb/console.log {{(pid=231753) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:4603}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Start _get_guest_xml network_info=[{"id": "d57bdf1d-7d02-4c93-a94c-64c0c863f901", "address": "fa:16:3e:c0:01:56", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57bdf1d-7d", "ovs_interfaceid": "d57bdf1d-7d02-4c93-a94c-64c0c863f901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}}} image_meta=ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqn': 'iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OGWCzcmd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False}, 'status': 'reserved', 'instance': '74232e48-360a-47c9-81da-7c7e66734fdb', 'attached_at': '', 'detached_at': '', 'volume_id': '50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d', 'serial': '50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d'}, 'guest_format': None, 'mount_device': '/dev/vda', 'device_type': 'disk', 'delete_on_termination': False, 'attachment_id': '79b94ed5-2af5-44ab-ad95-f77c170df391', 'boot_index': 0, 'disk_bus': 'virtio', 'volume_type': None} {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7553}}
Jul 29 14:03:45 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:03:45 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:03:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Searching host: 'user' for CPU controller through CGroups V1... {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1650}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] CPU controller missing on host. {{(pid=231753) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1660}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Searching host: 'user' for CPU controller through CGroups V2... {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1669}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.host [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] CPU controller found on host. {{(pid=231753) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1676}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=231753) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5390}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Getting desirable topologies for flavor Flavor(created_at=2023-07-29T13:29:14Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='1',id=6,is_public=True,memory_mb=512,name='m1.tiny',projects=<?>,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=<?>,container_format=<?>,created_at=<?>,direct_url=<?>,disk_format=<?>,id=<?>,min_disk=0,min_ram=0,name=<?>,owner=<?>,properties=ImageMetaProps,protected=<?>,size=1073741824,status='active',tags=<?>,updated_at=<?>,virtual_size=<?>,visibility=<?>), allow threads: True {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:558}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Flavor limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Image limits 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Flavor pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Image pref 0:0:0 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=231753) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:564}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:466}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Got 1 possible topologies {{(pid=231753) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:496}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:570}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG nova.virt.hardware [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=231753) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:572}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OGWCzcmd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:03:45 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:03:45 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:03:45 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:03:45 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:03:45 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:03:45 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7409eaf-1511-4294-8623-710beba85875]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:03:45 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[33cf916d-2e7a-4ccd-a0be-3a80ca3e2277]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d] added
Jul 29 14:03:45 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ac0f31-c2ca-4170-bc1f-9ac11f5b2c2a]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb089844-ed25-4803-adf3-d06dfc41c829]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OGWCzcmd {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d -p 172.16.0.220:3260 --op update -n node.session.auth.username -v OGWCzcmd" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cba9ea6-5d42-4c63-a8bc-d7cf01dbb913]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'OGWCzcmd'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3eace14-8dcb-4dc9-9baa-747d2b768915]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[52b5f3d9-a809-4f31-97f5-1b53638f8244]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:03:45 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:03:45 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d -p 172.16.0.220:3260 --login" returned: 0 in 0.052s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[141c1946-4b09-4b6b-a17a-5a9c7e781e6d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d, portal: 172.16.0.220,3260]
Jul 29 14:03:45 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d, portal: 172.16.0.220,3260] successful.
Jul 29 14:03:45 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.030s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab07633f-184b-4017-92ce-812dbfbd09b2]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4db92e25-ce70-4c17-b893-3bdc27391217]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:03:45 user nova-compute[231753]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d (non-flash)
Jul 29 14:03:45 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:03:45 user nova-compute[231753]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d (non-flash)
Jul 29 14:03:45 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.284s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] HCTL ('34', '-', '-', 0) found on session 56 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b5999c1-f272-4f23-afd1-e7f1e6ec3813]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Searching for a device in session 56 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:03:45 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OGWCzcmd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tSRKufEb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:03:46 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:03:46 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.319s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] <== connect_volume: return (1321ms) {'type': 'block', 'scsi_wwn': '26362363337386665', 'path': '/dev/sdc'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26362363337386665', 'path': '/dev/sdc'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.209s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:03:46 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:03:46 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:03:46 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:03:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611 -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:03:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1358688974',display_name='tempest-TestVolumeBootPattern-server-1358688974',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1358688974',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtoigQ7m5duqzfsiAOyArrbvva1hS5wetlA/wlY5VxGp3gb7rI+IjO+yTaKkT8nB18YhdDg3ru+M38WK4CdhiGgmsEXaLAhkk+kUuZmxu7gpTgpEVOFzr1YWb8fNF9FBQ==',key_name='tempest-TestVolumeBootPattern-1166783581',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f45c92d3fe964066b9be87489b2c9f7e',ramdisk_id='',reservation_id='r-6755fdim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-434673895',owner_user_name='tempest-TestVolumeBootPattern-434673895-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:03:33Z,user_data=None,user_id='d94a7ea0c19845b886e12c1689cf30a8',uuid=74232e48-360a-47c9-81da-7c7e66734fdb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d57bdf1d-7d02-4c93-a94c-64c0c863f901", "address": "fa:16:3e:c0:01:56", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57bdf1d-7d", "ovs_interfaceid": "d57bdf1d-7d02-4c93-a94c-64c0c863f901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=kvm {{(pid=231753) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:563}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Converting VIF {"id": "d57bdf1d-7d02-4c93-a94c-64c0c863f901", "address": "fa:16:3e:c0:01:56", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57bdf1d-7d", "ovs_interfaceid": "d57bdf1d-7d02-4c93-a94c-64c0c863f901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:01:56,bridge_name='br-int',has_traffic_filtering=True,id=d57bdf1d-7d02-4c93-a94c-64c0c863f901,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd57bdf1d-7d') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG nova.objects.instance [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lazy-loading 'pci_devices' on Instance uuid 74232e48-360a-47c9-81da-7c7e66734fdb {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611 -p 172.16.0.220:3260" returned: 21 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e67c9b2-de40-4be5-ae85-8c6276a621cd]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:03:46 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611 -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] End _get_guest_xml xml=<domain type="kvm">
Jul 29 14:03:46 user nova-compute[231753]:   <uuid>74232e48-360a-47c9-81da-7c7e66734fdb</uuid>
Jul 29 14:03:46 user nova-compute[231753]:   <name>instance-00000033</name>
Jul 29 14:03:46 user nova-compute[231753]:   <memory>524288</memory>
Jul 29 14:03:46 user nova-compute[231753]:   <vcpu>1</vcpu>
Jul 29 14:03:46 user nova-compute[231753]:   <metadata>
Jul 29 14:03:46 user nova-compute[231753]:     <nova:instance xmlns:nova="http://openstack.org/xmlns/libvirt/nova/1.1">
Jul 29 14:03:46 user nova-compute[231753]:       <nova:package version="0.0.0"/>
Jul 29 14:03:46 user nova-compute[231753]:       <nova:name>tempest-TestVolumeBootPattern-server-1358688974</nova:name>
Jul 29 14:03:46 user nova-compute[231753]:       <nova:creationTime>2023-07-29 14:03:45</nova:creationTime>
Jul 29 14:03:46 user nova-compute[231753]:       <nova:flavor name="m1.tiny">
Jul 29 14:03:46 user nova-compute[231753]:         <nova:memory>512</nova:memory>
Jul 29 14:03:46 user nova-compute[231753]:         <nova:disk>1</nova:disk>
Jul 29 14:03:46 user nova-compute[231753]:         <nova:swap>0</nova:swap>
Jul 29 14:03:46 user nova-compute[231753]:         <nova:ephemeral>0</nova:ephemeral>
Jul 29 14:03:46 user nova-compute[231753]:         <nova:vcpus>1</nova:vcpus>
Jul 29 14:03:46 user nova-compute[231753]:       </nova:flavor>
Jul 29 14:03:46 user nova-compute[231753]:       <nova:owner>
Jul 29 14:03:46 user nova-compute[231753]:         <nova:user uuid="d94a7ea0c19845b886e12c1689cf30a8">tempest-TestVolumeBootPattern-434673895-project-member</nova:user>
Jul 29 14:03:46 user nova-compute[231753]:         <nova:project uuid="f45c92d3fe964066b9be87489b2c9f7e">tempest-TestVolumeBootPattern-434673895</nova:project>
Jul 29 14:03:46 user nova-compute[231753]:       </nova:owner>
Jul 29 14:03:46 user nova-compute[231753]:       <nova:ports>
Jul 29 14:03:46 user nova-compute[231753]:         <nova:port uuid="d57bdf1d-7d02-4c93-a94c-64c0c863f901">
Jul 29 14:03:46 user nova-compute[231753]:           <nova:ip type="fixed" address="10.0.0.4" ipVersion="4"/>
Jul 29 14:03:46 user nova-compute[231753]:         </nova:port>
Jul 29 14:03:46 user nova-compute[231753]:       </nova:ports>
Jul 29 14:03:46 user nova-compute[231753]:     </nova:instance>
Jul 29 14:03:46 user nova-compute[231753]:   </metadata>
Jul 29 14:03:46 user nova-compute[231753]:   <sysinfo type="smbios">
Jul 29 14:03:46 user nova-compute[231753]:     <system>
Jul 29 14:03:46 user nova-compute[231753]:       <entry name="manufacturer">OpenStack Foundation</entry>
Jul 29 14:03:46 user nova-compute[231753]:       <entry name="product">OpenStack Nova</entry>
Jul 29 14:03:46 user nova-compute[231753]:       <entry name="version">0.0.0</entry>
Jul 29 14:03:46 user nova-compute[231753]:       <entry name="serial">74232e48-360a-47c9-81da-7c7e66734fdb</entry>
Jul 29 14:03:46 user nova-compute[231753]:       <entry name="uuid">74232e48-360a-47c9-81da-7c7e66734fdb</entry>
Jul 29 14:03:46 user nova-compute[231753]:       <entry name="family">Virtual Machine</entry>
Jul 29 14:03:46 user nova-compute[231753]:     </system>
Jul 29 14:03:46 user nova-compute[231753]:   </sysinfo>
Jul 29 14:03:46 user nova-compute[231753]:   <os>
Jul 29 14:03:46 user nova-compute[231753]:     <type arch="x86_64" machine="pc">hvm</type>
Jul 29 14:03:46 user nova-compute[231753]:     <boot dev="hd"/>
Jul 29 14:03:46 user nova-compute[231753]:     <smbios mode="sysinfo"/>
Jul 29 14:03:46 user nova-compute[231753]:   </os>
Jul 29 14:03:46 user nova-compute[231753]:   <features>
Jul 29 14:03:46 user nova-compute[231753]:     <acpi/>
Jul 29 14:03:46 user nova-compute[231753]:     <apic/>
Jul 29 14:03:46 user nova-compute[231753]:     <vmcoreinfo/>
Jul 29 14:03:46 user nova-compute[231753]:   </features>
Jul 29 14:03:46 user nova-compute[231753]:   <clock offset="utc">
Jul 29 14:03:46 user nova-compute[231753]:     <timer name="pit" tickpolicy="delay"/>
Jul 29 14:03:46 user nova-compute[231753]:     <timer name="rtc" tickpolicy="catchup"/>
Jul 29 14:03:46 user nova-compute[231753]:     <timer name="hpet" present="no"/>
Jul 29 14:03:46 user nova-compute[231753]:   </clock>
Jul 29 14:03:46 user nova-compute[231753]:   <cpu mode="custom" match="exact">
Jul 29 14:03:46 user nova-compute[231753]:     <model>Nehalem</model>
Jul 29 14:03:46 user nova-compute[231753]:     <topology sockets="1" cores="1" threads="1"/>
Jul 29 14:03:46 user nova-compute[231753]:   </cpu>
Jul 29 14:03:46 user nova-compute[231753]:   <devices>
Jul 29 14:03:46 user nova-compute[231753]:     <disk type="block" device="disk">
Jul 29 14:03:46 user nova-compute[231753]:       <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:03:46 user nova-compute[231753]:       <source dev="/dev/sdc"/>
Jul 29 14:03:46 user nova-compute[231753]:       <target dev="vda" bus="virtio"/>
Jul 29 14:03:46 user nova-compute[231753]:       <serial>50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d</serial>
Jul 29 14:03:46 user nova-compute[231753]:     </disk>
Jul 29 14:03:46 user nova-compute[231753]:     <interface type="ethernet">
Jul 29 14:03:46 user nova-compute[231753]:       <mac address="fa:16:3e:c0:01:56"/>
Jul 29 14:03:46 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 14:03:46 user nova-compute[231753]:       <mtu size="1442"/>
Jul 29 14:03:46 user nova-compute[231753]:       <target dev="tapd57bdf1d-7d"/>
Jul 29 14:03:46 user nova-compute[231753]:     </interface>
Jul 29 14:03:46 user nova-compute[231753]:     <serial type="pty">
Jul 29 14:03:46 user nova-compute[231753]:       <log file="/opt/stack/data/nova/instances/74232e48-360a-47c9-81da-7c7e66734fdb/console.log" append="off"/>
Jul 29 14:03:46 user nova-compute[231753]:     </serial>
Jul 29 14:03:46 user nova-compute[231753]:     <graphics type="vnc" autoport="yes" listen="0.0.0.0"/>
Jul 29 14:03:46 user nova-compute[231753]:     <video>
Jul 29 14:03:46 user nova-compute[231753]:       <model type="virtio"/>
Jul 29 14:03:46 user nova-compute[231753]:     </video>
Jul 29 14:03:46 user nova-compute[231753]:     <rng model="virtio">
Jul 29 14:03:46 user nova-compute[231753]:       <backend model="random">/dev/urandom</backend>
Jul 29 14:03:46 user nova-compute[231753]:     </rng>
Jul 29 14:03:46 user nova-compute[231753]:     <controller type="usb" index="0" model="none"/>
Jul 29 14:03:46 user nova-compute[231753]:     <memballoon model="virtio">
Jul 29 14:03:46 user nova-compute[231753]:       <stats period="10"/>
Jul 29 14:03:46 user nova-compute[231753]:     </memballoon>
Jul 29 14:03:46 user nova-compute[231753]:   </devices>
Jul 29 14:03:46 user nova-compute[231753]: </domain>
Jul 29 14:03:46 user nova-compute[231753]:  {{(pid=231753) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:7559}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:03:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1358688974',display_name='tempest-TestVolumeBootPattern-server-1358688974',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1358688974',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtoigQ7m5duqzfsiAOyArrbvva1hS5wetlA/wlY5VxGp3gb7rI+IjO+yTaKkT8nB18YhdDg3ru+M38WK4CdhiGgmsEXaLAhkk+kUuZmxu7gpTgpEVOFzr1YWb8fNF9FBQ==',key_name='tempest-TestVolumeBootPattern-1166783581',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f45c92d3fe964066b9be87489b2c9f7e',ramdisk_id='',reservation_id='r-6755fdim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestVolumeBootPattern-434673895',owner_user_name='tempest-TestVolumeBootPattern-434673895-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2023-07-29T14:03:33Z,user_data=None,user_id='d94a7ea0c19845b886e12c1689cf30a8',uuid=74232e48-360a-47c9-81da-7c7e66734fdb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d57bdf1d-7d02-4c93-a94c-64c0c863f901", "address": "fa:16:3e:c0:01:56", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57bdf1d-7d", "ovs_interfaceid": "d57bdf1d-7d02-4c93-a94c-64c0c863f901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) plug /opt/stack/nova/nova/virt/libvirt/vif.py:710}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Converting VIF {"id": "d57bdf1d-7d02-4c93-a94c-64c0c863f901", "address": "fa:16:3e:c0:01:56", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57bdf1d-7d", "ovs_interfaceid": "d57bdf1d-7d02-4c93-a94c-64c0c863f901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:c0:01:56,bridge_name='br-int',has_traffic_filtering=True,id=d57bdf1d-7d02-4c93-a94c-64c0c863f901,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd57bdf1d-7d') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG os_vif [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:01:56,bridge_name='br-int',has_traffic_filtering=True,id=d57bdf1d-7d02-4c93-a94c-64c0c863f901,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd57bdf1d-7d') {{(pid=231753) plug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:76}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611 -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8677bb5-a667-4266-b0f5-f387b5978358]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611] added
Jul 29 14:03:46 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd57bdf1d-7d, may_exist=True, interface_attrs={}) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Interface, record=tapd57bdf1d-7d, col_values=(('external_ids', {'iface-id': 'd57bdf1d-7d02-4c93-a94c-64c0c863f901', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:c0:01:56', 'vm-uuid': '74232e48-360a-47c9-81da-7c7e66734fdb'}),), if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:03:46 user nova-compute[231753]: INFO os_vif [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:c0:01:56,bridge_name='br-int',has_traffic_filtering=True,id=d57bdf1d-7d02-4c93-a94c-64c0c863f901,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd57bdf1d-7d')
Jul 29 14:03:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611 -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ace1f3da-3c95-4598-b3a0-b8ff4e40d960]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611 -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.024s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bf1859-8cfa-4cce-8f74-ac823a940d40]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tSRKufEb {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611 -p 172.16.0.220:3260 --op update -n node.session.auth.username -v tSRKufEb" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cddc913-e852-4187-92ba-3fe510ab24f3]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'tSRKufEb'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] No VIF found with MAC fa:16:3e:c0:01:56, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611 -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c54094b5-c7eb-4e49-8094-a46d27c1aa84]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[473faa05-ff27-494c-853c-fd065e1aa3bd]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:03:46 user nova-compute[231753]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d (non-flash)
Jul 29 14:03:46 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:03:46 user nova-compute[231753]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d (non-flash)
Jul 29 14:03:46 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:03:46 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611 -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611 -p 172.16.0.220:3260 --login" returned: 0 in 0.079s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:47 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf560d2-8380-46d9-9738-e367d2cf45e3]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:47 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611, portal: 172.16.0.220,3260]
Jul 29 14:03:47 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611, portal: 172.16.0.220,3260] successful.
Jul 29 14:03:47 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:03:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611 -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611 -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:47 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f04fd54c-3893-4839-b482-fff0cbaac9e4]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:47 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:03:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:47 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f91ab937-09a2-454c-913f-29bb468f7b03]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:47 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:03:47 user nova-compute[231753]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d (non-flash)
Jul 29 14:03:47 user nova-compute[231753]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611 (non-flash)
Jul 29 14:03:47 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:03:47 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:03:47 user nova-compute[231753]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d (non-flash)
Jul 29 14:03:47 user nova-compute[231753]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611 (non-flash)
Jul 29 14:03:47 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:03:47 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.337s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:03:47 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:03:47 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] HCTL ('35', '-', '-', 0) found on session 57 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:03:47 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:03:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:47 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c70fcc4e-c19a-4b04-a71d-5cf0c75fe5bc]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:47 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Searching for a device in session 57 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:03:47 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tSRKufEb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:03:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.372s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:03:48 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] <== connect_volume: return (1581ms) {'type': 'block', 'scsi_wwn': '26238663731646562', 'path': '/dev/sdd'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:03:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '26238663731646562', 'path': '/dev/sdd'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:03:48 user nova-compute[231753]: DEBUG nova.objects.instance [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lazy-loading 'flavor' on Instance uuid 441fd0df-b5a0-498f-8d02-eb1db2f45b4c {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:03:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 14:03:48 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:03:48 user nova-compute[231753]:   <source dev="/dev/sdd"/>
Jul 29 14:03:48 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:03:48 user nova-compute[231753]:   <serial>e80e7c7e-dc90-4699-9971-825cb561d611</serial>
Jul 29 14:03:48 user nova-compute[231753]: </disk>
Jul 29 14:03:48 user nova-compute[231753]:  {{(pid=231753) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 14:03:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:03:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:03:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:03:48 user nova-compute[231753]: DEBUG nova.compute.manager [req-e60b0db3-fdfb-4613-b816-c8ba32e8d12e req-f9b3f9f6-2ef0-4b9a-bac9-99714868c535 service nova] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Received event network-vif-plugged-d57bdf1d-7d02-4c93-a94c-64c0c863f901 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:03:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e60b0db3-fdfb-4613-b816-c8ba32e8d12e req-f9b3f9f6-2ef0-4b9a-bac9-99714868c535 service nova] Acquiring lock "74232e48-360a-47c9-81da-7c7e66734fdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:03:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e60b0db3-fdfb-4613-b816-c8ba32e8d12e req-f9b3f9f6-2ef0-4b9a-bac9-99714868c535 service nova] Lock "74232e48-360a-47c9-81da-7c7e66734fdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:03:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-e60b0db3-fdfb-4613-b816-c8ba32e8d12e req-f9b3f9f6-2ef0-4b9a-bac9-99714868c535 service nova] Lock "74232e48-360a-47c9-81da-7c7e66734fdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:03:48 user nova-compute[231753]: DEBUG nova.compute.manager [req-e60b0db3-fdfb-4613-b816-c8ba32e8d12e req-f9b3f9f6-2ef0-4b9a-bac9-99714868c535 service nova] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] No waiting events found dispatching network-vif-plugged-d57bdf1d-7d02-4c93-a94c-64c0c863f901 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:03:48 user nova-compute[231753]: WARNING nova.compute.manager [req-e60b0db3-fdfb-4613-b816-c8ba32e8d12e req-f9b3f9f6-2ef0-4b9a-bac9-99714868c535 service nova] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Received unexpected event network-vif-plugged-d57bdf1d-7d02-4c93-a94c-64c0c863f901 for instance with vm_state building and task_state spawning.
Jul 29 14:03:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:03:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:03:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:03:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] No BDM found with device name vdb, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:03:48 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] No VIF found with MAC fa:16:3e:8a:ab:14, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:03:48 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9b82d9a2-36e8-4813-945e-6a16d8ffd8b2 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.575s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:03:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-41a10908-4e93-4322-bcf2-04d90b32a0f9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Acquiring lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-41a10908-4e93-4322-bcf2-04d90b32a0f9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:03:50 user nova-compute[231753]: INFO nova.compute.manager [None req-41a10908-4e93-4322-bcf2-04d90b32a0f9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Detaching volume e80e7c7e-dc90-4699-9971-825cb561d611
Jul 29 14:03:50 user nova-compute[231753]: INFO nova.virt.block_device [None req-41a10908-4e93-4322-bcf2-04d90b32a0f9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Attempting to driver detach volume e80e7c7e-dc90-4699-9971-825cb561d611 from mountpoint /dev/vdb
Jul 29 14:03:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-41a10908-4e93-4322-bcf2-04d90b32a0f9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Attempting to detach device vdb from instance 441fd0df-b5a0-498f-8d02-eb1db2f45b4c from the persistent domain config. {{(pid=231753) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-41a10908-4e93-4322-bcf2-04d90b32a0f9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:03:50 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:03:50 user nova-compute[231753]:   <source dev="/dev/sdd"/>
Jul 29 14:03:50 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:03:50 user nova-compute[231753]:   <serial>e80e7c7e-dc90-4699-9971-825cb561d611</serial>
Jul 29 14:03:50 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 14:03:50 user nova-compute[231753]: </disk>
Jul 29 14:03:50 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:03:50 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-41a10908-4e93-4322-bcf2-04d90b32a0f9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Successfully detached device vdb from instance 441fd0df-b5a0-498f-8d02-eb1db2f45b4c from the persistent domain config.
Jul 29 14:03:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-41a10908-4e93-4322-bcf2-04d90b32a0f9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 441fd0df-b5a0-498f-8d02-eb1db2f45b4c from the live domain config. {{(pid=231753) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-41a10908-4e93-4322-bcf2-04d90b32a0f9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:03:50 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:03:50 user nova-compute[231753]:   <source dev="/dev/sdd"/>
Jul 29 14:03:50 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:03:50 user nova-compute[231753]:   <serial>e80e7c7e-dc90-4699-9971-825cb561d611</serial>
Jul 29 14:03:50 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 14:03:50 user nova-compute[231753]: </disk>
Jul 29 14:03:50 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG nova.compute.manager [req-21a0d759-5dd1-4cee-b1e6-3b347b3f7d61 req-099b1c1d-f88d-4711-ae88-ffb4784bb151 service nova] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Received event network-vif-plugged-d57bdf1d-7d02-4c93-a94c-64c0c863f901 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-21a0d759-5dd1-4cee-b1e6-3b347b3f7d61 req-099b1c1d-f88d-4711-ae88-ffb4784bb151 service nova] Acquiring lock "74232e48-360a-47c9-81da-7c7e66734fdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-21a0d759-5dd1-4cee-b1e6-3b347b3f7d61 req-099b1c1d-f88d-4711-ae88-ffb4784bb151 service nova] Lock "74232e48-360a-47c9-81da-7c7e66734fdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-21a0d759-5dd1-4cee-b1e6-3b347b3f7d61 req-099b1c1d-f88d-4711-ae88-ffb4784bb151 service nova] Lock "74232e48-360a-47c9-81da-7c7e66734fdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG nova.compute.manager [req-21a0d759-5dd1-4cee-b1e6-3b347b3f7d61 req-099b1c1d-f88d-4711-ae88-ffb4784bb151 service nova] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] No waiting events found dispatching network-vif-plugged-d57bdf1d-7d02-4c93-a94c-64c0c863f901 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:03:50 user nova-compute[231753]: WARNING nova.compute.manager [req-21a0d759-5dd1-4cee-b1e6-3b347b3f7d61 req-099b1c1d-f88d-4711-ae88-ffb4784bb151 service nova] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Received unexpected event network-vif-plugged-d57bdf1d-7d02-4c93-a94c-64c0c863f901 for instance with vm_state building and task_state spawning.
Jul 29 14:03:50 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690639430.6360843, 74232e48-360a-47c9-81da-7c7e66734fdb => Resumed> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:03:50 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] VM Resumed (Lifecycle Event)
Jul 29 14:03:50 user nova-compute[231753]: DEBUG nova.compute.manager [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Instance event wait completed in 0 seconds for  {{(pid=231753) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:577}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Guest created on hypervisor {{(pid=231753) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4411}}
Jul 29 14:03:50 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Instance spawned successfully.
Jul 29 14:03:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:894}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Found default for hw_cdrom_bus of ide {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Found default for hw_disk_bus of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Found default for hw_input_bus of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Found default for hw_pointer_model of None {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Found default for hw_video_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Found default for hw_vif_model of virtio {{(pid=231753) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:923}}
Jul 29 14:03:50 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:03:50 user nova-compute[231753]: DEBUG nova.virt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Emitting event <LifecycleEvent: 1690639430.6369715, 74232e48-360a-47c9-81da-7c7e66734fdb => Started> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:03:50 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] VM Started (Lifecycle Event)
Jul 29 14:03:50 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=231753) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1398}}
Jul 29 14:03:50 user nova-compute[231753]: INFO nova.compute.manager [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] During sync_power_state the instance has a pending task (spawning). Skip.
Jul 29 14:03:50 user nova-compute[231753]: INFO nova.compute.manager [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Took 5.38 seconds to spawn the instance on the hypervisor.
Jul 29 14:03:50 user nova-compute[231753]: DEBUG nova.compute.manager [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:03:50 user nova-compute[231753]: INFO nova.compute.manager [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Took 18.42 seconds to build instance.
Jul 29 14:03:50 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-5dfe0fe7-c283-4e01-b240-cb91489d51a4 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "74232e48-360a-47c9-81da-7c7e66734fdb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.<locals>._locked_do_build_and_run_instance" :: held 18.518s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Received event <DeviceRemovedEvent: 1690639430.8893006, 441fd0df-b5a0-498f-8d02-eb1db2f45b4c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=231753) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-41a10908-4e93-4322-bcf2-04d90b32a0f9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 441fd0df-b5a0-498f-8d02-eb1db2f45b4c {{(pid=231753) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 14:03:50 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-41a10908-4e93-4322-bcf2-04d90b32a0f9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Successfully detached device vdb from instance 441fd0df-b5a0-498f-8d02-eb1db2f45b4c from the live domain config.
Jul 29 14:03:50 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41a10908-4e93-4322-bcf2-04d90b32a0f9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a10908-4e93-4322-bcf2-04d90b32a0f9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'tSRKufEb', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:03:50 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-41a10908-4e93-4322-bcf2-04d90b32a0f9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:03:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-41a10908-4e93-4322-bcf2-04d90b32a0f9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-41a10908-4e93-4322-bcf2-04d90b32a0f9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[26bbf14a-155b-446f-a185-8794c7693d5c]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a10908-4e93-4322-bcf2-04d90b32a0f9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 14:03:50 user nova-compute[231753]: No targets found.
Jul 29 14:03:50 user nova-compute[231753]: iSNS:
Jul 29 14:03:50 user nova-compute[231753]: No targets found.
Jul 29 14:03:50 user nova-compute[231753]: STATIC:
Jul 29 14:03:50 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26
Jul 29 14:03:50 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 14:03:50 user nova-compute[231753]:                 Iface Name: default
Jul 29 14:03:50 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d
Jul 29 14:03:50 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 14:03:50 user nova-compute[231753]:                 Iface Name: default
Jul 29 14:03:50 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611
Jul 29 14:03:50 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 14:03:50 user nova-compute[231753]:                 Iface Name: default
Jul 29 14:03:50 user nova-compute[231753]: FIRMWARE:
Jul 29 14:03:50 user nova-compute[231753]: No targets found.
Jul 29 14:03:50 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a10908-4e93-4322-bcf2-04d90b32a0f9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 14:03:50 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 14:03:50 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a10908-4e93-4322-bcf2-04d90b32a0f9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[93819f19-fbe5-4a6a-9a06-5f405fdf0874]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d799a62d-3e05-40f2-a7e0-2233564371aa]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d (non-flash)\ntcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a10908-4e93-4322-bcf2-04d90b32a0f9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:03:50 user nova-compute[231753]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d (non-flash)
Jul 29 14:03:50 user nova-compute[231753]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611 (non-flash)
Jul 29 14:03:50 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a10908-4e93-4322-bcf2-04d90b32a0f9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:03:50 user nova-compute[231753]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d (non-flash)
Jul 29 14:03:50 user nova-compute[231753]: tcp: [57] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611 (non-flash)
Jul 29 14:03:50 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a10908-4e93-4322-bcf2-04d90b32a0f9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c803af400>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611'): ({'sdd'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-41a10908-4e93-4322-bcf2-04d90b32a0f9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Removing single pathed devices sdd {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:03:50 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:51 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d142c2f-0c00-441f-b74a-13986ed01da9]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:51 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd950022-ea24-4f83-9d55-b726b4cff602]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:51 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-41a10908-4e93-4322-bcf2-04d90b32a0f9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Flushing IO for device /dev/sdd {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:03:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.012s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:51 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8ebfcf9-6a9e-4d06-a940-f6772e7e3afb]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:51 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-41a10908-4e93-4322-bcf2-04d90b32a0f9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:03:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.042s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:51 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a7fb95e-bda1-4727-90f7-a5a2a6c8a5a8]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:51 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-41a10908-4e93-4322-bcf2-04d90b32a0f9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:03:51 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-41a10908-4e93-4322-bcf2-04d90b32a0f9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] SCSI volumes sdd have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:03:51 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a10908-4e93-4322-bcf2-04d90b32a0f9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:03:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:51 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7401b8b0-bc32-46ea-b376-0592007bfdc5]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:51 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a10908-4e93-4322-bcf2-04d90b32a0f9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:03:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611 -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611 -p 172.16.0.220:3260 --logout" returned: 0 in 0.056s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:51 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[858c1f69-9cf2-4304-9b27-1716ef5e1622]: (4, ('Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611, portal: 172.16.0.220,3260]\nLogout of [sid: 57, target: iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:51 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a10908-4e93-4322-bcf2-04d90b32a0f9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 57, target: iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611, portal: 172.16.0.220,3260]
Jul 29 14:03:51 user nova-compute[231753]: Logout of [sid: 57, target: iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611, portal: 172.16.0.220,3260] successful.
Jul 29 14:03:51 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:03:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611 -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:03:51 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:e80e7c7e-dc90-4699-9971-825cb561d611 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:03:51 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e3e048-eff7-4b73-8acf-2f9ff90aa885]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:03:51 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a10908-4e93-4322-bcf2-04d90b32a0f9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:03:51 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-41a10908-4e93-4322-bcf2-04d90b32a0f9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.311s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:03:51 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-41a10908-4e93-4322-bcf2-04d90b32a0f9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] <== disconnect_volume: return (312ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:03:51 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-41a10908-4e93-4322-bcf2-04d90b32a0f9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:03:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:03:51 user nova-compute[231753]: DEBUG nova.objects.instance [None req-41a10908-4e93-4322-bcf2-04d90b32a0f9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lazy-loading 'flavor' on Instance uuid 441fd0df-b5a0-498f-8d02-eb1db2f45b4c {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:03:51 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-41a10908-4e93-4322-bcf2-04d90b32a0f9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.629s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:03:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:03:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:03:57 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690639422.5407755, 4db109e2-0918-42d4-9b19-4a0c72a08370 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:03:57 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] VM Stopped (Lifecycle Event)
Jul 29 14:03:57 user nova-compute[231753]: DEBUG nova.compute.manager [None req-e0ca9a7e-c057-4a83-8364-542bbe4c0e5a None None] [instance: 4db109e2-0918-42d4-9b19-4a0c72a08370] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:04:01 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:04:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:04:06 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:04:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:04:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9626a04c-888f-4412-8991-157f2d172e52 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Acquiring lock "8a7a4543-0848-4e94-a424-8a3bc5883359" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:04:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9626a04c-888f-4412-8991-157f2d172e52 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lock "8a7a4543-0848-4e94-a424-8a3bc5883359" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:04:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9626a04c-888f-4412-8991-157f2d172e52 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Acquiring lock "8a7a4543-0848-4e94-a424-8a3bc5883359-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:04:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9626a04c-888f-4412-8991-157f2d172e52 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lock "8a7a4543-0848-4e94-a424-8a3bc5883359-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:04:09 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9626a04c-888f-4412-8991-157f2d172e52 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lock "8a7a4543-0848-4e94-a424-8a3bc5883359-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:04:09 user nova-compute[231753]: INFO nova.compute.manager [None req-9626a04c-888f-4412-8991-157f2d172e52 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Terminating instance
Jul 29 14:04:09 user nova-compute[231753]: DEBUG nova.compute.manager [None req-9626a04c-888f-4412-8991-157f2d172e52 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 14:04:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:04:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:04:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:04:10 user nova-compute[231753]: DEBUG nova.compute.manager [req-87a7dd3f-9e38-4e1d-be77-ca64a067f248 req-1fa5ac93-b268-4289-9749-89e07df76da9 service nova] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Received event network-vif-unplugged-4d05fd16-9ec0-4eb3-97d0-b0a763fce22d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:04:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-87a7dd3f-9e38-4e1d-be77-ca64a067f248 req-1fa5ac93-b268-4289-9749-89e07df76da9 service nova] Acquiring lock "8a7a4543-0848-4e94-a424-8a3bc5883359-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:04:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-87a7dd3f-9e38-4e1d-be77-ca64a067f248 req-1fa5ac93-b268-4289-9749-89e07df76da9 service nova] Lock "8a7a4543-0848-4e94-a424-8a3bc5883359-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:04:10 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-87a7dd3f-9e38-4e1d-be77-ca64a067f248 req-1fa5ac93-b268-4289-9749-89e07df76da9 service nova] Lock "8a7a4543-0848-4e94-a424-8a3bc5883359-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:04:10 user nova-compute[231753]: DEBUG nova.compute.manager [req-87a7dd3f-9e38-4e1d-be77-ca64a067f248 req-1fa5ac93-b268-4289-9749-89e07df76da9 service nova] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] No waiting events found dispatching network-vif-unplugged-4d05fd16-9ec0-4eb3-97d0-b0a763fce22d {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:04:10 user nova-compute[231753]: DEBUG nova.compute.manager [req-87a7dd3f-9e38-4e1d-be77-ca64a067f248 req-1fa5ac93-b268-4289-9749-89e07df76da9 service nova] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Received event network-vif-unplugged-4d05fd16-9ec0-4eb3-97d0-b0a763fce22d for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:04:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:04:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:04:10 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Instance destroyed successfully.
Jul 29 14:04:10 user nova-compute[231753]: DEBUG nova.objects.instance [None req-9626a04c-888f-4412-8991-157f2d172e52 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lazy-loading 'resources' on Instance uuid 8a7a4543-0848-4e94-a424-8a3bc5883359 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:04:10 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-9626a04c-888f-4412-8991-157f2d172e52 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:02:18Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-VolumesActionsTest-instance-220515737',display_name='tempest-VolumesActionsTest-instance-220515737',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-volumesactionstest-instance-220515737',id=50,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data=None,key_name=None,keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:02:25Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='05bd77abd6fc41499a1071d21320227d',ramdisk_id='',reservation_id='r-si5z4l56',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesActionsTest-1523708427',owner_user_name='tempest-VolumesActionsTest-1523708427-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:02:26Z,user_data=None,user_id='044799f22df449fb82aeef584dcf72e6',uuid=8a7a4543-0848-4e94-a424-8a3bc5883359,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d05fd16-9ec0-4eb3-97d0-b0a763fce22d", "address": "fa:16:3e:55:a5:8d", "network": {"id": "2ddc9999-9ee3-464c-9f09-409be4323fa8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413085584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bd77abd6fc41499a1071d21320227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d05fd16-9e", "ovs_interfaceid": "4d05fd16-9ec0-4eb3-97d0-b0a763fce22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:04:10 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-9626a04c-888f-4412-8991-157f2d172e52 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Converting VIF {"id": "4d05fd16-9ec0-4eb3-97d0-b0a763fce22d", "address": "fa:16:3e:55:a5:8d", "network": {"id": "2ddc9999-9ee3-464c-9f09-409be4323fa8", "bridge": "br-int", "label": "tempest-VolumesActionsTest-1413085584-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "05bd77abd6fc41499a1071d21320227d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d05fd16-9e", "ovs_interfaceid": "4d05fd16-9ec0-4eb3-97d0-b0a763fce22d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:04:10 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-9626a04c-888f-4412-8991-157f2d172e52 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:55:a5:8d,bridge_name='br-int',has_traffic_filtering=True,id=4d05fd16-9ec0-4eb3-97d0-b0a763fce22d,network=Network(2ddc9999-9ee3-464c-9f09-409be4323fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d05fd16-9e') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:04:10 user nova-compute[231753]: DEBUG os_vif [None req-9626a04c-888f-4412-8991-157f2d172e52 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:a5:8d,bridge_name='br-int',has_traffic_filtering=True,id=4d05fd16-9ec0-4eb3-97d0-b0a763fce22d,network=Network(2ddc9999-9ee3-464c-9f09-409be4323fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d05fd16-9e') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:04:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:04:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d05fd16-9e, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:04:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:04:10 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:04:10 user nova-compute[231753]: INFO os_vif [None req-9626a04c-888f-4412-8991-157f2d172e52 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:55:a5:8d,bridge_name='br-int',has_traffic_filtering=True,id=4d05fd16-9ec0-4eb3-97d0-b0a763fce22d,network=Network(2ddc9999-9ee3-464c-9f09-409be4323fa8),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d05fd16-9e')
Jul 29 14:04:10 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-9626a04c-888f-4412-8991-157f2d172e52 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Deleting instance files /opt/stack/data/nova/instances/8a7a4543-0848-4e94-a424-8a3bc5883359_del
Jul 29 14:04:10 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-9626a04c-888f-4412-8991-157f2d172e52 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Deletion of /opt/stack/data/nova/instances/8a7a4543-0848-4e94-a424-8a3bc5883359_del complete
Jul 29 14:04:10 user nova-compute[231753]: INFO nova.compute.manager [None req-9626a04c-888f-4412-8991-157f2d172e52 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Took 0.89 seconds to destroy the instance on the hypervisor.
Jul 29 14:04:10 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-9626a04c-888f-4412-8991-157f2d172e52 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 14:04:10 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 14:04:10 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 14:04:11 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:04:11 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Took 0.47 seconds to deallocate network for instance.
Jul 29 14:04:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9626a04c-888f-4412-8991-157f2d172e52 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:04:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9626a04c-888f-4412-8991-157f2d172e52 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:04:11 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-9626a04c-888f-4412-8991-157f2d172e52 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:04:11 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-9626a04c-888f-4412-8991-157f2d172e52 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:04:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9626a04c-888f-4412-8991-157f2d172e52 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.235s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:04:11 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-9626a04c-888f-4412-8991-157f2d172e52 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Deleted allocations for instance 8a7a4543-0848-4e94-a424-8a3bc5883359
Jul 29 14:04:11 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-9626a04c-888f-4412-8991-157f2d172e52 tempest-VolumesActionsTest-1523708427 tempest-VolumesActionsTest-1523708427-project-member] Lock "8a7a4543-0848-4e94-a424-8a3bc5883359" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.773s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:04:12 user nova-compute[231753]: DEBUG nova.compute.manager [req-3acc540f-aeb2-438a-8711-00db1e112680 req-2e56587a-cd4a-4aab-be02-03f95af64bb2 service nova] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Received event network-vif-plugged-4d05fd16-9ec0-4eb3-97d0-b0a763fce22d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:04:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3acc540f-aeb2-438a-8711-00db1e112680 req-2e56587a-cd4a-4aab-be02-03f95af64bb2 service nova] Acquiring lock "8a7a4543-0848-4e94-a424-8a3bc5883359-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:04:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3acc540f-aeb2-438a-8711-00db1e112680 req-2e56587a-cd4a-4aab-be02-03f95af64bb2 service nova] Lock "8a7a4543-0848-4e94-a424-8a3bc5883359-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:04:12 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3acc540f-aeb2-438a-8711-00db1e112680 req-2e56587a-cd4a-4aab-be02-03f95af64bb2 service nova] Lock "8a7a4543-0848-4e94-a424-8a3bc5883359-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:04:12 user nova-compute[231753]: DEBUG nova.compute.manager [req-3acc540f-aeb2-438a-8711-00db1e112680 req-2e56587a-cd4a-4aab-be02-03f95af64bb2 service nova] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] No waiting events found dispatching network-vif-plugged-4d05fd16-9ec0-4eb3-97d0-b0a763fce22d {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:04:12 user nova-compute[231753]: WARNING nova.compute.manager [req-3acc540f-aeb2-438a-8711-00db1e112680 req-2e56587a-cd4a-4aab-be02-03f95af64bb2 service nova] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Received unexpected event network-vif-plugged-4d05fd16-9ec0-4eb3-97d0-b0a763fce22d for instance with vm_state deleted and task_state None.
Jul 29 14:04:12 user nova-compute[231753]: DEBUG nova.compute.manager [req-3acc540f-aeb2-438a-8711-00db1e112680 req-2e56587a-cd4a-4aab-be02-03f95af64bb2 service nova] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Received event network-vif-deleted-4d05fd16-9ec0-4eb3-97d0-b0a763fce22d {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:04:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:04:15 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:04:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:04:20 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:04:23 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:04:25 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690639450.5081403, 8a7a4543-0848-4e94-a424-8a3bc5883359 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:04:25 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] VM Stopped (Lifecycle Event)
Jul 29 14:04:25 user nova-compute[231753]: DEBUG nova.compute.manager [None req-9e740be1-e31b-44bb-9eb5-cad56b2e1971 None None] [instance: 8a7a4543-0848-4e94-a424-8a3bc5883359] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:04:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:04:29 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:04:29 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Cleaning up deleted instances with incomplete migration  {{(pid=231753) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:11167}}
Jul 29 14:04:30 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:04:30 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:04:30 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:04:30 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=231753) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 14:04:30 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 14:04:30 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 14:04:30 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:04:31 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:04:31 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 14:04:31 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Rebuilding the list of instances to heal {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 14:04:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "refresh_cache-8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:04:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquired lock "refresh_cache-8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:04:31 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Forcefully refreshing network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 14:04:31 user nova-compute[231753]: DEBUG nova.objects.instance [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lazy-loading 'info_cache' on Instance uuid 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:04:31 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Updating instance_info_cache with network_info: [{"id": "eea8caab-510b-4b6d-bf98-d1149bd48f91", "address": "fa:16:3e:cf:43:1e", "network": {"id": "a10f7c69-0720-46b5-b252-6523dc61a6ca", "bridge": "br-int", "label": "tempest-TestStampPattern-1661615052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28da183a39e9413ebf7f0bc22ea1ae5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea8caab-51", "ovs_interfaceid": "eea8caab-510b-4b6d-bf98-d1149bd48f91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:04:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Releasing lock "refresh_cache-8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:04:31 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Updated the network info_cache for instance {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 14:04:31 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:04:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:04:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:04:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:04:31 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 14:04:31 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:04:31 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:04:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk --force-share --output=json" returned: 0 in 0.149s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:04:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:04:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8/disk --force-share --output=json" returned: 0 in 0.138s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:04:32 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdc (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:04:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:04:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk --force-share --output=json" returned: 0 in 0.139s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:04:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:04:32 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk --force-share --output=json" returned: 0 in 0.141s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:04:33 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:04:33 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:04:33 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=8176MB free_disk=24.970367431640625GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 14:04:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:04:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:04:33 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8 actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:04:33 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 441fd0df-b5a0-498f-8d02-eb1db2f45b4c actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512, 'DISK_GB': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:04:33 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 6bc5023f-6d34-4edc-b189-47d40e58122f actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:04:33 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 74232e48-360a-47c9-81da-7c7e66734fdb actively managed on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 512}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:04:33 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 4 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 14:04:33 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=2560MB phys_disk=40GB used_disk=2GB total_vcpus=12 used_vcpus=4 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 14:04:33 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Refreshing inventories for resource provider 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:804}}
Jul 29 14:04:33 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Updating ProviderTree inventory for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 from _refresh_and_get_inventory using data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:768}}
Jul 29 14:04:33 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Updating inventory in ProviderTree for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 with inventory: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}}
Jul 29 14:04:33 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Refreshing aggregate associations for resource provider 222db5c7-e17f-4307-968d-4284bf5c19f4, aggregates: None {{(pid=231753) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:813}}
Jul 29 14:04:33 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Refreshing trait associations for resource provider 222db5c7-e17f-4307-968d-4284bf5c19f4, traits: HW_CPU_X86_SSSE3,HW_CPU_X86_SSE42,COMPUTE_NET_ATTACH_INTERFACE,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_VOLUME_EXTEND,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_CIRRUS,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_IDE,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_TRUSTED_CERTS,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_DEVICE_TAGGING,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_STORAGE_BUS_USB,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_RESCUE_BFV,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_GRAPHICS_MODEL_VMVGA,HW_CPU_X86_SSE2,COMPUTE_NET_VIF_MODEL_VMXNET3,COMPUTE_NET_VIF_MODEL_RTL8139,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_IMAGE_TYPE_AMI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_ACCELERATORS,COMPUTE_STORAGE_BUS_SATA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE,COMPUTE_STORAGE_BUS_FDC,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NODE,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_STORAGE_BUS_VIRTIO {{(pid=231753) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:825}}
Jul 29 14:04:33 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:04:33 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:04:33 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 14:04:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.501s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:04:34 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:04:34 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:04:34 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:04:34 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 14:04:35 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:04:35 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:04:35 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:04:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:04:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:04:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=231753) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 14:04:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 14:04:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 14:04:40 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:04:41 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:04:42 user nova-compute[231753]: DEBUG nova.compute.manager [req-0a615421-2449-45f1-bc66-a108da9fb456 req-6cd62523-d812-420a-adcd-b28d92b3d28c service nova] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Received event network-changed-eea8caab-510b-4b6d-bf98-d1149bd48f91 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:04:42 user nova-compute[231753]: DEBUG nova.compute.manager [req-0a615421-2449-45f1-bc66-a108da9fb456 req-6cd62523-d812-420a-adcd-b28d92b3d28c service nova] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Refreshing instance network info cache due to event network-changed-eea8caab-510b-4b6d-bf98-d1149bd48f91. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:04:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0a615421-2449-45f1-bc66-a108da9fb456 req-6cd62523-d812-420a-adcd-b28d92b3d28c service nova] Acquiring lock "refresh_cache-8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:04:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0a615421-2449-45f1-bc66-a108da9fb456 req-6cd62523-d812-420a-adcd-b28d92b3d28c service nova] Acquired lock "refresh_cache-8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:04:42 user nova-compute[231753]: DEBUG nova.network.neutron [req-0a615421-2449-45f1-bc66-a108da9fb456 req-6cd62523-d812-420a-adcd-b28d92b3d28c service nova] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Refreshing network info cache for port eea8caab-510b-4b6d-bf98-d1149bd48f91 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:04:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-95488235-07f3-4b67-800d-1a14574531df tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Acquiring lock "8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:04:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-95488235-07f3-4b67-800d-1a14574531df tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.003s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:04:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-95488235-07f3-4b67-800d-1a14574531df tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Acquiring lock "8e8d1ee0-4906-4411-a1fd-c5997a22b5e8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:04:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-95488235-07f3-4b67-800d-1a14574531df tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "8e8d1ee0-4906-4411-a1fd-c5997a22b5e8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:04:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-95488235-07f3-4b67-800d-1a14574531df tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "8e8d1ee0-4906-4411-a1fd-c5997a22b5e8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:04:42 user nova-compute[231753]: INFO nova.compute.manager [None req-95488235-07f3-4b67-800d-1a14574531df tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Terminating instance
Jul 29 14:04:42 user nova-compute[231753]: DEBUG nova.compute.manager [None req-95488235-07f3-4b67-800d-1a14574531df tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 14:04:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:04:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:04:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:04:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:04:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:04:42 user nova-compute[231753]: DEBUG nova.network.neutron [req-0a615421-2449-45f1-bc66-a108da9fb456 req-6cd62523-d812-420a-adcd-b28d92b3d28c service nova] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Updated VIF entry in instance network info cache for port eea8caab-510b-4b6d-bf98-d1149bd48f91. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:04:42 user nova-compute[231753]: DEBUG nova.network.neutron [req-0a615421-2449-45f1-bc66-a108da9fb456 req-6cd62523-d812-420a-adcd-b28d92b3d28c service nova] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Updating instance_info_cache with network_info: [{"id": "eea8caab-510b-4b6d-bf98-d1149bd48f91", "address": "fa:16:3e:cf:43:1e", "network": {"id": "a10f7c69-0720-46b5-b252-6523dc61a6ca", "bridge": "br-int", "label": "tempest-TestStampPattern-1661615052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28da183a39e9413ebf7f0bc22ea1ae5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea8caab-51", "ovs_interfaceid": "eea8caab-510b-4b6d-bf98-d1149bd48f91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:04:42 user nova-compute[231753]: DEBUG nova.compute.manager [req-efb8cd69-5dd6-4758-b82a-eafdbdefd006 req-33320d0b-a354-4eb9-b292-070a0484831b service nova] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Received event network-vif-unplugged-eea8caab-510b-4b6d-bf98-d1149bd48f91 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:04:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-efb8cd69-5dd6-4758-b82a-eafdbdefd006 req-33320d0b-a354-4eb9-b292-070a0484831b service nova] Acquiring lock "8e8d1ee0-4906-4411-a1fd-c5997a22b5e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:04:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-efb8cd69-5dd6-4758-b82a-eafdbdefd006 req-33320d0b-a354-4eb9-b292-070a0484831b service nova] Lock "8e8d1ee0-4906-4411-a1fd-c5997a22b5e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:04:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-efb8cd69-5dd6-4758-b82a-eafdbdefd006 req-33320d0b-a354-4eb9-b292-070a0484831b service nova] Lock "8e8d1ee0-4906-4411-a1fd-c5997a22b5e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:04:42 user nova-compute[231753]: DEBUG nova.compute.manager [req-efb8cd69-5dd6-4758-b82a-eafdbdefd006 req-33320d0b-a354-4eb9-b292-070a0484831b service nova] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] No waiting events found dispatching network-vif-unplugged-eea8caab-510b-4b6d-bf98-d1149bd48f91 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:04:42 user nova-compute[231753]: DEBUG nova.compute.manager [req-efb8cd69-5dd6-4758-b82a-eafdbdefd006 req-33320d0b-a354-4eb9-b292-070a0484831b service nova] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Received event network-vif-unplugged-eea8caab-510b-4b6d-bf98-d1149bd48f91 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:04:42 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-0a615421-2449-45f1-bc66-a108da9fb456 req-6cd62523-d812-420a-adcd-b28d92b3d28c service nova] Releasing lock "refresh_cache-8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:04:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:04:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:04:43 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Instance destroyed successfully.
Jul 29 14:04:43 user nova-compute[231753]: DEBUG nova.objects.instance [None req-95488235-07f3-4b67-800d-1a14574531df tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lazy-loading 'resources' on Instance uuid 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8 {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:04:43 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-95488235-07f3-4b67-800d-1a14574531df tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T13:57:35Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestStampPattern-server-1347009007',display_name='tempest-TestStampPattern-server-1347009007',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-teststamppattern-server-1347009007',id=44,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGJ0UCuB1s/FcIxNR+PeaL27O4FLCSRuPA3sNGjkAYL2ft4zG9hnQn3p/NaR8N5IEf65ITJPm24CQQ3JghZ9yGOSsBJ6AidP6UmfWpGZKzXSpLz9fY7+5vRgRPmfh/cMFA==',key_name='tempest-TestStampPattern-2343879',keypairs=<?>,launch_index=0,launched_at=2023-07-29T13:57:42Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='28da183a39e9413ebf7f0bc22ea1ae5d',ramdisk_id='',reservation_id='r-gflmac11',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestStampPattern-442563326',owner_user_name='tempest-TestStampPattern-442563326-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:00:45Z,user_data=None,user_id='fe8dbee1098a44418ba739f073503497',uuid=8e8d1ee0-4906-4411-a1fd-c5997a22b5e8,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "eea8caab-510b-4b6d-bf98-d1149bd48f91", "address": "fa:16:3e:cf:43:1e", "network": {"id": "a10f7c69-0720-46b5-b252-6523dc61a6ca", "bridge": "br-int", "label": "tempest-TestStampPattern-1661615052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28da183a39e9413ebf7f0bc22ea1ae5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea8caab-51", "ovs_interfaceid": "eea8caab-510b-4b6d-bf98-d1149bd48f91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:04:43 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-95488235-07f3-4b67-800d-1a14574531df tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Converting VIF {"id": "eea8caab-510b-4b6d-bf98-d1149bd48f91", "address": "fa:16:3e:cf:43:1e", "network": {"id": "a10f7c69-0720-46b5-b252-6523dc61a6ca", "bridge": "br-int", "label": "tempest-TestStampPattern-1661615052-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "28da183a39e9413ebf7f0bc22ea1ae5d", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapeea8caab-51", "ovs_interfaceid": "eea8caab-510b-4b6d-bf98-d1149bd48f91", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:04:43 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-95488235-07f3-4b67-800d-1a14574531df tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:cf:43:1e,bridge_name='br-int',has_traffic_filtering=True,id=eea8caab-510b-4b6d-bf98-d1149bd48f91,network=Network(a10f7c69-0720-46b5-b252-6523dc61a6ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeea8caab-51') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:04:43 user nova-compute[231753]: DEBUG os_vif [None req-95488235-07f3-4b67-800d-1a14574531df tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:43:1e,bridge_name='br-int',has_traffic_filtering=True,id=eea8caab-510b-4b6d-bf98-d1149bd48f91,network=Network(a10f7c69-0720-46b5-b252-6523dc61a6ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeea8caab-51') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:04:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:04:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapeea8caab-51, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:04:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:04:43 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:04:43 user nova-compute[231753]: INFO os_vif [None req-95488235-07f3-4b67-800d-1a14574531df tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:cf:43:1e,bridge_name='br-int',has_traffic_filtering=True,id=eea8caab-510b-4b6d-bf98-d1149bd48f91,network=Network(a10f7c69-0720-46b5-b252-6523dc61a6ca),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapeea8caab-51')
Jul 29 14:04:43 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-95488235-07f3-4b67-800d-1a14574531df tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Deleting instance files /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8_del
Jul 29 14:04:43 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-95488235-07f3-4b67-800d-1a14574531df tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Deletion of /opt/stack/data/nova/instances/8e8d1ee0-4906-4411-a1fd-c5997a22b5e8_del complete
Jul 29 14:04:43 user nova-compute[231753]: INFO nova.compute.manager [None req-95488235-07f3-4b67-800d-1a14574531df tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Took 0.84 seconds to destroy the instance on the hypervisor.
Jul 29 14:04:43 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-95488235-07f3-4b67-800d-1a14574531df tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 14:04:43 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 14:04:43 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 14:04:43 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:04:43 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Took 0.54 seconds to deallocate network for instance.
Jul 29 14:04:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-95488235-07f3-4b67-800d-1a14574531df tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:04:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-95488235-07f3-4b67-800d-1a14574531df tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:04:43 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-95488235-07f3-4b67-800d-1a14574531df tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:04:43 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-95488235-07f3-4b67-800d-1a14574531df tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:04:43 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-95488235-07f3-4b67-800d-1a14574531df tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.209s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:04:44 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-95488235-07f3-4b67-800d-1a14574531df tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Deleted allocations for instance 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8
Jul 29 14:04:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-95488235-07f3-4b67-800d-1a14574531df tempest-TestStampPattern-442563326 tempest-TestStampPattern-442563326-project-member] Lock "8e8d1ee0-4906-4411-a1fd-c5997a22b5e8" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 1.797s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:04:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-d2d6168c-a5f9-487d-9c0f-4abd6bdb3b5f req-fda2233d-5af7-496c-95bc-d3f84efa813f service nova] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Received event network-vif-deleted-eea8caab-510b-4b6d-bf98-d1149bd48f91 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:04:44 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:04:44 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Cleaning up deleted instances {{(pid=231753) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11129}}
Jul 29 14:04:44 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] There are 0 instances to clean {{(pid=231753) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:11138}}
Jul 29 14:04:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-9f9c1059-f9e7-4945-94ac-f2846fdc1b7b req-be19ec9e-838a-4261-8c0a-fa1dbea06287 service nova] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Received event network-vif-plugged-eea8caab-510b-4b6d-bf98-d1149bd48f91 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:04:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9f9c1059-f9e7-4945-94ac-f2846fdc1b7b req-be19ec9e-838a-4261-8c0a-fa1dbea06287 service nova] Acquiring lock "8e8d1ee0-4906-4411-a1fd-c5997a22b5e8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:04:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9f9c1059-f9e7-4945-94ac-f2846fdc1b7b req-be19ec9e-838a-4261-8c0a-fa1dbea06287 service nova] Lock "8e8d1ee0-4906-4411-a1fd-c5997a22b5e8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:04:44 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9f9c1059-f9e7-4945-94ac-f2846fdc1b7b req-be19ec9e-838a-4261-8c0a-fa1dbea06287 service nova] Lock "8e8d1ee0-4906-4411-a1fd-c5997a22b5e8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:04:44 user nova-compute[231753]: DEBUG nova.compute.manager [req-9f9c1059-f9e7-4945-94ac-f2846fdc1b7b req-be19ec9e-838a-4261-8c0a-fa1dbea06287 service nova] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] No waiting events found dispatching network-vif-plugged-eea8caab-510b-4b6d-bf98-d1149bd48f91 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:04:44 user nova-compute[231753]: WARNING nova.compute.manager [req-9f9c1059-f9e7-4945-94ac-f2846fdc1b7b req-be19ec9e-838a-4261-8c0a-fa1dbea06287 service nova] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Received unexpected event network-vif-plugged-eea8caab-510b-4b6d-bf98-d1149bd48f91 for instance with vm_state deleted and task_state None.
Jul 29 14:04:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Acquiring lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:04:46 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:04:46 user nova-compute[231753]: DEBUG nova.objects.instance [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lazy-loading 'flavor' on Instance uuid 441fd0df-b5a0-498f-8d02-eb1db2f45b4c {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:04:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.069s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:04:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Acquiring lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:04:47 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:04:47 user nova-compute[231753]: INFO nova.compute.manager [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Attaching volume bf2ad84d-af71-4626-b22e-503c26d3f03c to /dev/vdb
Jul 29 14:04:47 user nova-compute[231753]: DEBUG os_brick.utils [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:04:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:04:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.015s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:04:47 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[236c5098-9f9c-470e-b66f-298dfaf3a282]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:04:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:04:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:04:47 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0eba6e9-091c-4ad0-9c5d-7318152174f4]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:04:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:04:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:04:47 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7b85b8-5f50-436a-bc5c-149bfcf1c4db]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:04:47 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b33f37f-512f-4a3a-bee9-9b2f47eb5420]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:04:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:04:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:04:47 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:04:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:04:47 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:04:47 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:04:47 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a32618-180c-4949-a884-36c9d75751b4]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:04:47 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:04:47 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:04:47 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:04:47 user nova-compute[231753]: DEBUG os_brick.utils [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] <== get_connector_properties: return (129ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:04:47 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Updating existing volume attachment record: 795010a3-f34f-43cf-85f1-d27ce37f3a16 {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:04:48 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:04:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:04:50 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:04:53 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FNcPxKbg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:04:54 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:04:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:04:54 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:04:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:04:54 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:04:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c -p 172.16.0.220:3260" returned: 21 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[74fbc7cd-7634-4c84-a2a5-feb9d8280582]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:04:54 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[539ac77a-1dda-4e90-a056-94fa9c86f492]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c] added
Jul 29 14:04:54 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[41ffdb11-560a-4c06-9634-f43d98708db8]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[33b2f96b-a6e6-4f46-be2e-e270aed77229]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FNcPxKbg {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c -p 172.16.0.220:3260 --op update -n node.session.auth.username -v FNcPxKbg" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[148ef756-d6f0-4d7e-880e-212e551bfb2a]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'FNcPxKbg'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d454350a-4522-4442-b9ab-8afa817875be]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6590a14e-6ad8-47cf-a2d0-392711cd4e6e]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:04:54 user nova-compute[231753]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d (non-flash)
Jul 29 14:04:54 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:04:54 user nova-compute[231753]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d (non-flash)
Jul 29 14:04:54 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c -p 172.16.0.220:3260 --login" returned: 0 in 0.055s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dbc5a37-bcf7-43a8-9bdf-a0a0be656c8d]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c, portal: 172.16.0.220,3260]
Jul 29 14:04:54 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c, portal: 172.16.0.220,3260] successful.
Jul 29 14:04:54 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2383e58-d229-4d46-ad9e-afc475961134]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae84c977-79ed-4ae0-ad13-2a1404ed14d0]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:04:54 user nova-compute[231753]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d (non-flash)
Jul 29 14:04:54 user nova-compute[231753]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c (non-flash)
Jul 29 14:04:54 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:04:54 user nova-compute[231753]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d (non-flash)
Jul 29 14:04:54 user nova-compute[231753]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c (non-flash)
Jul 29 14:04:54 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.277s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] HCTL ('35', '-', '-', 0) found on session 58 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Scanning host 35 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host35/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host35/scan" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f504bf7-512b-4bdf-b124-ab012aac1f39]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Searching for a device in session 58 and hctl ['35', '*', '*', 0] yield: sdd {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:04:54 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Connected to sdd using {'target_iqn': 'iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FNcPxKbg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:04:55 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.311s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:04:55 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] <== connect_volume: return (1313ms) {'type': 'block', 'scsi_wwn': '23830653734636366', 'path': '/dev/sdd'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:04:55 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23830653734636366', 'path': '/dev/sdd'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:04:55 user nova-compute[231753]: DEBUG nova.objects.instance [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lazy-loading 'flavor' on Instance uuid 441fd0df-b5a0-498f-8d02-eb1db2f45b4c {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:04:55 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 14:04:55 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:04:55 user nova-compute[231753]:   <source dev="/dev/sdd"/>
Jul 29 14:04:55 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:04:55 user nova-compute[231753]:   <serial>bf2ad84d-af71-4626-b22e-503c26d3f03c</serial>
Jul 29 14:04:55 user nova-compute[231753]: </disk>
Jul 29 14:04:55 user nova-compute[231753]:  {{(pid=231753) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 14:04:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:04:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] No BDM found with device name vdb, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:04:56 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] No VIF found with MAC fa:16:3e:8a:ab:14, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:04:56 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-af0dfdd2-56f7-46cc-ba7f-928bb950ddc9 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.215s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:04:58 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690639483.0398939, 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8 => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:04:58 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] VM Stopped (Lifecycle Event)
Jul 29 14:04:58 user nova-compute[231753]: DEBUG nova.compute.manager [None req-6288938d-6db9-41eb-8aed-1ca43a6cbf60 None None] [instance: 8e8d1ee0-4906-4411-a1fd-c5997a22b5e8] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:04:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:04:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:04:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=231753) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 14:04:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 14:04:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 14:04:58 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:04:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e466515f-34a1-49e8-89c8-0142a7fd672c tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Acquiring lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:04:58 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e466515f-34a1-49e8-89c8-0142a7fd672c tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:04:58 user nova-compute[231753]: INFO nova.compute.manager [None req-e466515f-34a1-49e8-89c8-0142a7fd672c tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Detaching volume bf2ad84d-af71-4626-b22e-503c26d3f03c
Jul 29 14:04:58 user nova-compute[231753]: INFO nova.virt.block_device [None req-e466515f-34a1-49e8-89c8-0142a7fd672c tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Attempting to driver detach volume bf2ad84d-af71-4626-b22e-503c26d3f03c from mountpoint /dev/vdb
Jul 29 14:04:58 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e466515f-34a1-49e8-89c8-0142a7fd672c tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Attempting to detach device vdb from instance 441fd0df-b5a0-498f-8d02-eb1db2f45b4c from the persistent domain config. {{(pid=231753) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 14:04:58 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-e466515f-34a1-49e8-89c8-0142a7fd672c tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:04:58 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:04:58 user nova-compute[231753]:   <source dev="/dev/sdd"/>
Jul 29 14:04:58 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:04:58 user nova-compute[231753]:   <serial>bf2ad84d-af71-4626-b22e-503c26d3f03c</serial>
Jul 29 14:04:58 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 14:04:58 user nova-compute[231753]: </disk>
Jul 29 14:04:58 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:04:58 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-e466515f-34a1-49e8-89c8-0142a7fd672c tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Successfully detached device vdb from instance 441fd0df-b5a0-498f-8d02-eb1db2f45b4c from the persistent domain config.
Jul 29 14:04:58 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e466515f-34a1-49e8-89c8-0142a7fd672c tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 441fd0df-b5a0-498f-8d02-eb1db2f45b4c from the live domain config. {{(pid=231753) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 14:04:58 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-e466515f-34a1-49e8-89c8-0142a7fd672c tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:04:58 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:04:58 user nova-compute[231753]:   <source dev="/dev/sdd"/>
Jul 29 14:04:58 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:04:58 user nova-compute[231753]:   <serial>bf2ad84d-af71-4626-b22e-503c26d3f03c</serial>
Jul 29 14:04:58 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 14:04:58 user nova-compute[231753]: </disk>
Jul 29 14:04:58 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Received event <DeviceRemovedEvent: 1690639499.277755, 441fd0df-b5a0-498f-8d02-eb1db2f45b4c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=231753) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-e466515f-34a1-49e8-89c8-0142a7fd672c tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 441fd0df-b5a0-498f-8d02-eb1db2f45b4c {{(pid=231753) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 14:04:59 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-e466515f-34a1-49e8-89c8-0142a7fd672c tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Successfully detached device vdb from instance 441fd0df-b5a0-498f-8d02-eb1db2f45b4c from the live domain config.
Jul 29 14:04:59 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e466515f-34a1-49e8-89c8-0142a7fd672c tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e466515f-34a1-49e8-89c8-0142a7fd672c tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'FNcPxKbg', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdd'}, None), 'kwargs': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:04:59 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-e466515f-34a1-49e8-89c8-0142a7fd672c tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:04:59 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-e466515f-34a1-49e8-89c8-0142a7fd672c tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-e466515f-34a1-49e8-89c8-0142a7fd672c tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5100e5a3-8c7b-4032-b5a8-190cc74fe859]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e466515f-34a1-49e8-89c8-0142a7fd672c tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 14:04:59 user nova-compute[231753]: No targets found.
Jul 29 14:04:59 user nova-compute[231753]: iSNS:
Jul 29 14:04:59 user nova-compute[231753]: No targets found.
Jul 29 14:04:59 user nova-compute[231753]: STATIC:
Jul 29 14:04:59 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26
Jul 29 14:04:59 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 14:04:59 user nova-compute[231753]:                 Iface Name: default
Jul 29 14:04:59 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d
Jul 29 14:04:59 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 14:04:59 user nova-compute[231753]:                 Iface Name: default
Jul 29 14:04:59 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c
Jul 29 14:04:59 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 14:04:59 user nova-compute[231753]:                 Iface Name: default
Jul 29 14:04:59 user nova-compute[231753]: FIRMWARE:
Jul 29 14:04:59 user nova-compute[231753]: No targets found.
Jul 29 14:04:59 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e466515f-34a1-49e8-89c8-0142a7fd672c tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 14:04:59 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 14:04:59 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e466515f-34a1-49e8-89c8-0142a7fd672c tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c9c78a5-f625-4459-9c98-d579648b074b]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e394a88-c893-4dbe-85f7-cdef59c93649]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d (non-flash)\ntcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e466515f-34a1-49e8-89c8-0142a7fd672c tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:04:59 user nova-compute[231753]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d (non-flash)
Jul 29 14:04:59 user nova-compute[231753]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c (non-flash)
Jul 29 14:04:59 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e466515f-34a1-49e8-89c8-0142a7fd672c tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:04:59 user nova-compute[231753]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d (non-flash)
Jul 29 14:04:59 user nova-compute[231753]: tcp: [58] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c (non-flash)
Jul 29 14:04:59 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e466515f-34a1-49e8-89c8-0142a7fd672c tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c802f1e10>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c'): ({'sdd'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-e466515f-34a1-49e8-89c8-0142a7fd672c tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Removing single pathed devices sdd {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[fef47ea7-d5ac-4260-9b37-c81a17800458]: (4, ('path checker states:\nup                  3\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdd {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdd" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[eac6f74c-c833-4a44-a599-50c64eca9078]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-e466515f-34a1-49e8-89c8-0142a7fd672c tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Flushing IO for device /dev/sdd {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdd {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdd" returned: 0 in 0.013s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f296191-eadc-4362-9257-c15c7346a468]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-e466515f-34a1-49e8-89c8-0142a7fd672c tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdd/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdd/device/delete" returned: 0 in 0.032s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[7504c6f2-b310-4526-9316-2ca16a4b6dfc]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-e466515f-34a1-49e8-89c8-0142a7fd672c tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Checking to see if SCSI volumes sdd have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-e466515f-34a1-49e8-89c8-0142a7fd672c tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] SCSI volumes sdd have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e466515f-34a1-49e8-89c8-0142a7fd672c tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.057s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[23a28e9a-43e0-428f-869d-843302372850]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e466515f-34a1-49e8-89c8-0142a7fd672c tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad0875b9-67ae-4eef-8cfc-dd7807c6f7d4]: (4, ('Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c, portal: 172.16.0.220,3260]\nLogout of [sid: 58, target: iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e466515f-34a1-49e8-89c8-0142a7fd672c tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 58, target: iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c, portal: 172.16.0.220,3260]
Jul 29 14:04:59 user nova-compute[231753]: Logout of [sid: 58, target: iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c, portal: 172.16.0.220,3260] successful.
Jul 29 14:04:59 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:bf2ad84d-af71-4626-b22e-503c26d3f03c -p 172.16.0.220:3260 --op delete" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d969d48c-ec1f-4ee4-812b-1820e62ddeab]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e466515f-34a1-49e8-89c8-0142a7fd672c tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-e466515f-34a1-49e8-89c8-0142a7fd672c tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.331s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-e466515f-34a1-49e8-89c8-0142a7fd672c tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] <== disconnect_volume: return (332ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:04:59 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e466515f-34a1-49e8-89c8-0142a7fd672c tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:05:00 user nova-compute[231753]: DEBUG nova.objects.instance [None req-e466515f-34a1-49e8-89c8-0142a7fd672c tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lazy-loading 'flavor' on Instance uuid 441fd0df-b5a0-498f-8d02-eb1db2f45b4c {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:05:00 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-e466515f-34a1-49e8-89c8-0142a7fd672c tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.855s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:05:03 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:05:08 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:05:13 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:05:13 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:05:13 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5001 ms, sending inactivity probe {{(pid=231753) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 14:05:13 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 14:05:13 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 14:05:13 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:05:18 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:05:23 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:05:23 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:05:26 user nova-compute[231753]: DEBUG nova.compute.manager [req-9bfec126-c1ce-41ec-8435-04195a6ab518 req-5c3f8e07-c308-4fb5-b5d2-26411754fe0d service nova] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Received event network-changed-d57bdf1d-7d02-4c93-a94c-64c0c863f901 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:05:26 user nova-compute[231753]: DEBUG nova.compute.manager [req-9bfec126-c1ce-41ec-8435-04195a6ab518 req-5c3f8e07-c308-4fb5-b5d2-26411754fe0d service nova] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Refreshing instance network info cache due to event network-changed-d57bdf1d-7d02-4c93-a94c-64c0c863f901. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:05:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9bfec126-c1ce-41ec-8435-04195a6ab518 req-5c3f8e07-c308-4fb5-b5d2-26411754fe0d service nova] Acquiring lock "refresh_cache-74232e48-360a-47c9-81da-7c7e66734fdb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:05:26 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9bfec126-c1ce-41ec-8435-04195a6ab518 req-5c3f8e07-c308-4fb5-b5d2-26411754fe0d service nova] Acquired lock "refresh_cache-74232e48-360a-47c9-81da-7c7e66734fdb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:05:26 user nova-compute[231753]: DEBUG nova.network.neutron [req-9bfec126-c1ce-41ec-8435-04195a6ab518 req-5c3f8e07-c308-4fb5-b5d2-26411754fe0d service nova] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Refreshing network info cache for port d57bdf1d-7d02-4c93-a94c-64c0c863f901 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:05:27 user nova-compute[231753]: DEBUG nova.network.neutron [req-9bfec126-c1ce-41ec-8435-04195a6ab518 req-5c3f8e07-c308-4fb5-b5d2-26411754fe0d service nova] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Updated VIF entry in instance network info cache for port d57bdf1d-7d02-4c93-a94c-64c0c863f901. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:05:27 user nova-compute[231753]: DEBUG nova.network.neutron [req-9bfec126-c1ce-41ec-8435-04195a6ab518 req-5c3f8e07-c308-4fb5-b5d2-26411754fe0d service nova] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Updating instance_info_cache with network_info: [{"id": "d57bdf1d-7d02-4c93-a94c-64c0c863f901", "address": "fa:16:3e:c0:01:56", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57bdf1d-7d", "ovs_interfaceid": "d57bdf1d-7d02-4c93-a94c-64c0c863f901", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:05:27 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-9bfec126-c1ce-41ec-8435-04195a6ab518 req-5c3f8e07-c308-4fb5-b5d2-26411754fe0d service nova] Releasing lock "refresh_cache-74232e48-360a-47c9-81da-7c7e66734fdb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:05:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:05:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:05:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=231753) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 14:05:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 14:05:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 14:05:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:05:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "74232e48-360a-47c9-81da-7c7e66734fdb" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:05:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "74232e48-360a-47c9-81da-7c7e66734fdb" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:05:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "74232e48-360a-47c9-81da-7c7e66734fdb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:05:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "74232e48-360a-47c9-81da-7c7e66734fdb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:05:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "74232e48-360a-47c9-81da-7c7e66734fdb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:05:28 user nova-compute[231753]: INFO nova.compute.manager [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Terminating instance
Jul 29 14:05:28 user nova-compute[231753]: DEBUG nova.compute.manager [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 14:05:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:05:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:05:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:05:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:05:28 user nova-compute[231753]: DEBUG nova.compute.manager [req-6a37ca83-d411-45c7-b26b-88eeabbb9b20 req-b30512df-3488-44bc-ad20-5a4dcff1f675 service nova] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Received event network-changed-d57bdf1d-7d02-4c93-a94c-64c0c863f901 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:05:28 user nova-compute[231753]: DEBUG nova.compute.manager [req-6a37ca83-d411-45c7-b26b-88eeabbb9b20 req-b30512df-3488-44bc-ad20-5a4dcff1f675 service nova] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Refreshing instance network info cache due to event network-changed-d57bdf1d-7d02-4c93-a94c-64c0c863f901. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:05:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6a37ca83-d411-45c7-b26b-88eeabbb9b20 req-b30512df-3488-44bc-ad20-5a4dcff1f675 service nova] Acquiring lock "refresh_cache-74232e48-360a-47c9-81da-7c7e66734fdb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:05:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6a37ca83-d411-45c7-b26b-88eeabbb9b20 req-b30512df-3488-44bc-ad20-5a4dcff1f675 service nova] Acquired lock "refresh_cache-74232e48-360a-47c9-81da-7c7e66734fdb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:05:28 user nova-compute[231753]: DEBUG nova.network.neutron [req-6a37ca83-d411-45c7-b26b-88eeabbb9b20 req-b30512df-3488-44bc-ad20-5a4dcff1f675 service nova] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Refreshing network info cache for port d57bdf1d-7d02-4c93-a94c-64c0c863f901 {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:05:29 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Instance destroyed successfully.
Jul 29 14:05:29 user nova-compute[231753]: DEBUG nova.objects.instance [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lazy-loading 'resources' on Instance uuid 74232e48-360a-47c9-81da-7c7e66734fdb {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:03:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-1358688974',display_name='tempest-TestVolumeBootPattern-server-1358688974',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-1358688974',id=51,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtoigQ7m5duqzfsiAOyArrbvva1hS5wetlA/wlY5VxGp3gb7rI+IjO+yTaKkT8nB18YhdDg3ru+M38WK4CdhiGgmsEXaLAhkk+kUuZmxu7gpTgpEVOFzr1YWb8fNF9FBQ==',key_name='tempest-TestVolumeBootPattern-1166783581',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:03:50Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f45c92d3fe964066b9be87489b2c9f7e',ramdisk_id='',reservation_id='r-6755fdim',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-434673895',owner_user_name='tempest-TestVolumeBootPattern-434673895-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:03:51Z,user_data=None,user_id='d94a7ea0c19845b886e12c1689cf30a8',uuid=74232e48-360a-47c9-81da-7c7e66734fdb,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d57bdf1d-7d02-4c93-a94c-64c0c863f901", "address": "fa:16:3e:c0:01:56", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57bdf1d-7d", "ovs_interfaceid": "d57bdf1d-7d02-4c93-a94c-64c0c863f901", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Converting VIF {"id": "d57bdf1d-7d02-4c93-a94c-64c0c863f901", "address": "fa:16:3e:c0:01:56", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.251", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57bdf1d-7d", "ovs_interfaceid": "d57bdf1d-7d02-4c93-a94c-64c0c863f901", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:c0:01:56,bridge_name='br-int',has_traffic_filtering=True,id=d57bdf1d-7d02-4c93-a94c-64c0c863f901,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd57bdf1d-7d') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG os_vif [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:01:56,bridge_name='br-int',has_traffic_filtering=True,id=d57bdf1d-7d02-4c93-a94c-64c0c863f901,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd57bdf1d-7d') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd57bdf1d-7d, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:05:29 user nova-compute[231753]: INFO os_vif [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:c0:01:56,bridge_name='br-int',has_traffic_filtering=True,id=d57bdf1d-7d02-4c93-a94c-64c0c863f901,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd57bdf1d-7d')
Jul 29 14:05:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'OGWCzcmd', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': True}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:05:29 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:05:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.006s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.025s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[5144c948-aa67-45f7-bcf8-dbd69a2618c5]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:17059aac-e7a5-42d1-8146-7905dea9299e\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 14:05:29 user nova-compute[231753]: No targets found.
Jul 29 14:05:29 user nova-compute[231753]: iSNS:
Jul 29 14:05:29 user nova-compute[231753]: No targets found.
Jul 29 14:05:29 user nova-compute[231753]: STATIC:
Jul 29 14:05:29 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26
Jul 29 14:05:29 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 14:05:29 user nova-compute[231753]:                 Iface Name: default
Jul 29 14:05:29 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d
Jul 29 14:05:29 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 14:05:29 user nova-compute[231753]:                 Iface Name: default
Jul 29 14:05:29 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:17059aac-e7a5-42d1-8146-7905dea9299e
Jul 29 14:05:29 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 14:05:29 user nova-compute[231753]:                 Iface Name: default
Jul 29 14:05:29 user nova-compute[231753]: FIRMWARE:
Jul 29 14:05:29 user nova-compute[231753]: No targets found.
Jul 29 14:05:29 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 14:05:29 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 14:05:29 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[300f0247-b0d3-4140-bb5e-fceef4e04619]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:17059aac-e7a5-42d1-8146-7905dea9299e\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.027s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c41d6b-7e7a-4744-bbfa-615a34c82763]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)\ntcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d (non-flash)\ntcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17059aac-e7a5-42d1-8146-7905dea9299e (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:05:29 user nova-compute[231753]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d (non-flash)
Jul 29 14:05:29 user nova-compute[231753]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17059aac-e7a5-42d1-8146-7905dea9299e (non-flash)
Jul 29 14:05:29 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:05:29 user nova-compute[231753]: tcp: [56] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d (non-flash)
Jul 29 14:05:29 user nova-compute[231753]: tcp: [59] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:17059aac-e7a5-42d1-8146-7905dea9299e (non-flash)
Jul 29 14:05:29 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c80466680>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d'): ({'sdc'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Removing single pathed devices sdc {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG nova.network.neutron [req-6a37ca83-d411-45c7-b26b-88eeabbb9b20 req-b30512df-3488-44bc-ad20-5a4dcff1f675 service nova] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Updated VIF entry in instance network info cache for port d57bdf1d-7d02-4c93-a94c-64c0c863f901. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG nova.network.neutron [req-6a37ca83-d411-45c7-b26b-88eeabbb9b20 req-b30512df-3488-44bc-ad20-5a4dcff1f675 service nova] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Updating instance_info_cache with network_info: [{"id": "d57bdf1d-7d02-4c93-a94c-64c0c863f901", "address": "fa:16:3e:c0:01:56", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd57bdf1d-7d", "ovs_interfaceid": "d57bdf1d-7d02-4c93-a94c-64c0c863f901", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[71630026-ba31-474c-aba4-6ed713bb40c6]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6a37ca83-d411-45c7-b26b-88eeabbb9b20 req-b30512df-3488-44bc-ad20-5a4dcff1f675 service nova] Releasing lock "refresh_cache-74232e48-360a-47c9-81da-7c7e66734fdb" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG nova.compute.manager [req-6a37ca83-d411-45c7-b26b-88eeabbb9b20 req-b30512df-3488-44bc-ad20-5a4dcff1f675 service nova] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Received event network-vif-unplugged-d57bdf1d-7d02-4c93-a94c-64c0c863f901 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6a37ca83-d411-45c7-b26b-88eeabbb9b20 req-b30512df-3488-44bc-ad20-5a4dcff1f675 service nova] Acquiring lock "74232e48-360a-47c9-81da-7c7e66734fdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6a37ca83-d411-45c7-b26b-88eeabbb9b20 req-b30512df-3488-44bc-ad20-5a4dcff1f675 service nova] Lock "74232e48-360a-47c9-81da-7c7e66734fdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-6a37ca83-d411-45c7-b26b-88eeabbb9b20 req-b30512df-3488-44bc-ad20-5a4dcff1f675 service nova] Lock "74232e48-360a-47c9-81da-7c7e66734fdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG nova.compute.manager [req-6a37ca83-d411-45c7-b26b-88eeabbb9b20 req-b30512df-3488-44bc-ad20-5a4dcff1f675 service nova] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] No waiting events found dispatching network-vif-unplugged-d57bdf1d-7d02-4c93-a94c-64c0c863f901 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG nova.compute.manager [req-6a37ca83-d411-45c7-b26b-88eeabbb9b20 req-b30512df-3488-44bc-ad20-5a4dcff1f675 service nova] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Received event network-vif-unplugged-d57bdf1d-7d02-4c93-a94c-64c0c863f901 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c61ac7-54a0-4dd4-9a56-816d82498ed1]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Flushing IO for device /dev/sdc {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.014s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b96606b9-6b95-458c-a734-793b1d5cb326]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.045s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7603e2e-78b6-4b31-878a-044bda84c015]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] SCSI volumes sdc have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG os_brick.privileged.rootwrap [-] Unlinking ('/dev/disk/by-id/scsi-26362363337386665', '/dev/disk/by-id/scsi-1SCST_BIO54be6106-cb6378fe5e35f904', '/dev/disk/by-id/scsi-SSCST_BIO_Storage_54be6106') {{(pid=242780) unlink_root /usr/local/lib/python3.10/dist-packages/os_brick/privileged/rootwrap.py:219}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb77861c-a9d9-404e-9045-336f8ba378e7]: (4, None) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[748edae4-7cc9-4ba9-83b5-eaa92f58ea47]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d -p 172.16.0.220:3260 --logout" returned: 0 in 0.046s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee9a4b4-cf05-42b4-ba10-febf8cd0e63f]: (4, ('Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d, portal: 172.16.0.220,3260]\nLogout of [sid: 56, target: iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 56, target: iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d, portal: 172.16.0.220,3260]
Jul 29 14:05:29 user nova-compute[231753]: Logout of [sid: 56, target: iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d, portal: 172.16.0.220,3260] successful.
Jul 29 14:05:29 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:50e9fad7-0997-4fc1-ab4e-2d7ec8c5462d -p 172.16.0.220:3260 --op delete" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[718100b3-9d83-42e1-8837-389917ac69f0]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.308s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] <== disconnect_volume: return (314ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:05:29 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Deleting instance files /opt/stack/data/nova/instances/74232e48-360a-47c9-81da-7c7e66734fdb_del
Jul 29 14:05:29 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Deletion of /opt/stack/data/nova/instances/74232e48-360a-47c9-81da-7c7e66734fdb_del complete
Jul 29 14:05:29 user nova-compute[231753]: INFO nova.compute.manager [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Took 1.39 seconds to destroy the instance on the hypervisor.
Jul 29 14:05:29 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 14:05:29 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 14:05:30 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:05:30 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Took 0.42 seconds to deallocate network for instance.
Jul 29 14:05:30 user nova-compute[231753]: DEBUG nova.compute.manager [req-0c8c22d0-f95b-4199-b2ab-cc515c11cbcc req-4bd8ec52-9553-437a-8e90-3b5cd0189db5 service nova] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Received event network-vif-deleted-d57bdf1d-7d02-4c93-a94c-64c0c863f901 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:05:31 user nova-compute[231753]: DEBUG nova.compute.manager [req-a09eb0d1-60b5-4b6c-a802-25db133054e5 req-731b49fc-55e4-4d88-869a-1d31907658a4 service nova] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Received event network-vif-plugged-d57bdf1d-7d02-4c93-a94c-64c0c863f901 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:05:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a09eb0d1-60b5-4b6c-a802-25db133054e5 req-731b49fc-55e4-4d88-869a-1d31907658a4 service nova] Acquiring lock "74232e48-360a-47c9-81da-7c7e66734fdb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:05:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a09eb0d1-60b5-4b6c-a802-25db133054e5 req-731b49fc-55e4-4d88-869a-1d31907658a4 service nova] Lock "74232e48-360a-47c9-81da-7c7e66734fdb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:05:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-a09eb0d1-60b5-4b6c-a802-25db133054e5 req-731b49fc-55e4-4d88-869a-1d31907658a4 service nova] Lock "74232e48-360a-47c9-81da-7c7e66734fdb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:05:31 user nova-compute[231753]: DEBUG nova.compute.manager [req-a09eb0d1-60b5-4b6c-a802-25db133054e5 req-731b49fc-55e4-4d88-869a-1d31907658a4 service nova] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] No waiting events found dispatching network-vif-plugged-d57bdf1d-7d02-4c93-a94c-64c0c863f901 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:05:31 user nova-compute[231753]: WARNING nova.compute.manager [req-a09eb0d1-60b5-4b6c-a802-25db133054e5 req-731b49fc-55e4-4d88-869a-1d31907658a4 service nova] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Received unexpected event network-vif-plugged-d57bdf1d-7d02-4c93-a94c-64c0c863f901 for instance with vm_state active and task_state deleting.
Jul 29 14:05:31 user nova-compute[231753]: INFO nova.compute.manager [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Took 0.78 seconds to detach 1 volumes for instance.
Jul 29 14:05:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:05:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:05:31 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:05:31 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:05:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.154s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:05:31 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Deleted allocations for instance 74232e48-360a-47c9-81da-7c7e66734fdb
Jul 29 14:05:31 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:05:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-11218d72-a292-4f2a-a9c5-791d6de4658c tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "74232e48-360a-47c9-81da-7c7e66734fdb" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.924s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:05:33 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:05:33 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:05:33 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 14:05:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "refresh_cache-441fd0df-b5a0-498f-8d02-eb1db2f45b4c" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:05:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquired lock "refresh_cache-441fd0df-b5a0-498f-8d02-eb1db2f45b4c" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:05:33 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Forcefully refreshing network info cache for instance {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1996}}
Jul 29 14:05:33 user nova-compute[231753]: DEBUG nova.network.neutron [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Updating instance_info_cache with network_info: [{"id": "e65ce885-2848-4c59-b069-2d3fffab8131", "address": "fa:16:3e:8a:ab:14", "network": {"id": "e850e031-78cb-4491-bc2e-1558870dee53", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1563208818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c63557bedc94739802fe008139488ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65ce885-28", "ovs_interfaceid": "e65ce885-2848-4c59-b069-2d3fffab8131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:05:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Releasing lock "refresh_cache-441fd0df-b5a0-498f-8d02-eb1db2f45b4c" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:05:33 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Updated the network info_cache for instance {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9913}}
Jul 29 14:05:33 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:05:33 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:05:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:05:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:05:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:05:33 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 14:05:34 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] skipping disk /dev/sdb (vda) as it is a volume {{(pid=231753) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:11216}}
Jul 29 14:05:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:05:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk --force-share --output=json" returned: 0 in 0.133s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:05:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:05:34 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:05:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:05:34 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:05:34 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:05:34 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=8415MB free_disk=25.093547821044922GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 14:05:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:05:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:05:34 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 441fd0df-b5a0-498f-8d02-eb1db2f45b4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:05:34 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 6bc5023f-6d34-4edc-b189-47d40e58122f actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:05:34 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 2 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 14:05:34 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=1536MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=2 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 14:05:34 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:05:34 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:05:34 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 14:05:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.214s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:05:36 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:05:36 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:05:36 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 14:05:37 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:05:37 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:05:37 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:05:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:05:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:05:42 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:05:44 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690639529.3915875, 74232e48-360a-47c9-81da-7c7e66734fdb => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:05:44 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] VM Stopped (Lifecycle Event)
Jul 29 14:05:44 user nova-compute[231753]: DEBUG nova.compute.manager [None req-8493281a-6d8f-4c88-a5d0-7dbf0ce362e7 None None] [instance: 74232e48-360a-47c9-81da-7c7e66734fdb] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:05:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:05:45 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:05:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:05:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:05:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Acquiring lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:05:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:05:55 user nova-compute[231753]: DEBUG nova.objects.instance [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lazy-loading 'flavor' on Instance uuid 441fd0df-b5a0-498f-8d02-eb1db2f45b4c {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:05:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name.<locals>.do_reserve" :: held 0.061s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:05:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Acquiring lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:05:55 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" acquired by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:05:55 user nova-compute[231753]: INFO nova.compute.manager [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Attaching volume f129dd50-380f-4756-9d5c-96ed1c8ccb3a to /dev/vdb
Jul 29 14:05:55 user nova-compute[231753]: DEBUG os_brick.utils [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.0.0.210', 'multipath': False, 'enforce_multipath': True, 'host': 'user', 'execute': None}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:05:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): cat /etc/iscsi/initiatorname.iscsi {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:05:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "cat /etc/iscsi/initiatorname.iscsi" returned: 0 in 0.014s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:05:55 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e32d5dae-4f9b-4ffe-8ac9-8e1934ea964c]: (4, ('InitiatorName=iqn.2016-04.com.open-iscsi:e4aa2292d692\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:05:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): findmnt / -n -o SOURCE {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:05:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "findmnt / -n -o SOURCE" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:05:55 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[fba4d269-b384-4e8b-97a4-6a9acefd2ce8]: (4, ('/dev/mapper/vg0-lv--0\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:05:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blkid /dev/mapper/vg0-lv--0 -s UUID -o value {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:05:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blkid /dev/mapper/vg0-lv--0 -s UUID -o value" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:05:55 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[76d99a92-1dbb-40a3-ba06-dd3838b5923d]: (4, ('e95b3b51-542d-42ca-ac40-f83360608668\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:05:55 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d60a60a0-0f79-4b2e-a380-948995533326]: (4, 'e20c3142-5af9-7467-ecd8-70b2e4a210d6') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:05:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Running cmd (subprocess): nvme version {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:05:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] 'nvme version' failed. Not Retrying. {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:05:55 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.nvmeof [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] nvme not present on system {{(pid=231753) nvme_present /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/nvmeof.py:757}}
Jul 29 14:05:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): nvme show-hostnqn {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:05:55 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] 'nvme show-hostnqn' failed. Not Retrying. {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:473}}
Jul 29 14:05:55 user nova-compute[231753]: WARNING os_brick.privileged.nvmeof [-] Could not generate host nqn: [Errno 2] No such file or directory: 'nvme'
Jul 29 14:05:55 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e6a0d7-0353-4083-b863-b1c8453c46db]: (4, '') {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:05:55 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] LIGHTOS: [Errno 111] ECONNREFUSED {{(pid=231753) find_dsc /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:98}}
Jul 29 14:05:55 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:76}}
Jul 29 14:05:55 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.lightos [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] LIGHTOS: no hostnqn found. {{(pid=231753) get_connector_properties /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/lightos.py:84}}
Jul 29 14:05:55 user nova-compute[231753]: DEBUG os_brick.utils [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.0.0.210', 'host': 'user', 'multipath': False, 'initiator': 'iqn.2016-04.com.open-iscsi:e4aa2292d692', 'do_local_attach': False, 'uuid': 'e95b3b51-542d-42ca-ac40-f83360608668', 'system uuid': 'e20c3142-5af9-7467-ecd8-70b2e4a210d6', 'nvme_native_multipath': False} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:05:55 user nova-compute[231753]: DEBUG nova.virt.block_device [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Updating existing volume attachment record: 6def977f-ed32-43bf-b30e-1b9fdad24ad1 {{(pid=231753) _volume_attach /opt/stack/nova/nova/virt/block_device.py:631}}
Jul 29 14:05:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:05:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Calling os-brick to attach iSCSI Volume {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:63}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] ==> connect_volume: call "{'self': <os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, 'connection_properties': {'target_iqn': 'iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PyYwGKtT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:06:02 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:06:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:06:02 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:06:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Acquiring lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:06:02 user nova-compute[231753]: INFO os_brick.initiator.connectors.iscsi [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Trying to connect to iSCSI portal 172.16.0.220:3260
Jul 29 14:06:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a -p 172.16.0.220:3260 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a -p 172.16.0.220:3260" returned: 21 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4c3def4-f538-4063-946c-573b77482604]: (4, ('', 'iscsiadm: No records found\n')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found
Jul 29 14:06:02 user nova-compute[231753]:  {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a -p 172.16.0.220:3260 --interface default --op new {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a -p 172.16.0.220:3260 --interface default --op new" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a55d81ff-e52f-4b15-811f-a7c47a015985]: (4, ('New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a] added\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 172.16.0.220,3260,-1 iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a] added
Jul 29 14:06:02 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a -p 172.16.0.220:3260 --op update -n node.session.scan -v manual" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf8f8bad-dd9e-40fe-a198-0947f66a439b]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a -p 172.16.0.220:3260 --op update -n node.session.auth.authmethod -v CHAP" returned: 0 in 0.034s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c0297e-7379-4f9f-bc26-00ccbd42eba5]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.authmethod', '-v', 'CHAP'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PyYwGKtT {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a -p 172.16.0.220:3260 --op update -n node.session.auth.username -v PyYwGKtT" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e81e330-bc29-4c37-8887-025c6e216c3f]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.username', '-v', 'PyYwGKtT'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v *** {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a -p 172.16.0.220:3260 --op update -n node.session.auth.password -v ***" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[d58fb630-179a-49e1-abba-81195f9235d2]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.auth.password', '-v', '***'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[27826c51-bb16-43e2-b744-72a993d39df4]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:06:02 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:06:02 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a -p 172.16.0.220:3260 --login {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a -p 172.16.0.220:3260 --login" returned: 0 in 0.048s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[368b23ab-b895-4481-ab20-10d09af1a08b]: (4, ('Logging in to [iface: default, target: iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a, portal: 172.16.0.220,3260]\nLogin to [iface: default, target: iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a, portal: 172.16.0.220,3260]
Jul 29 14:06:02 user nova-compute[231753]: Login to [iface: default, target: iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a, portal: 172.16.0.220,3260] successful.
Jul 29 14:06:02 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a -p 172.16.0.220:3260 --op update -n node.startup -v automatic" returned: 0 in 0.022s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[61cfc397-af3c-4b41-9817-c42f36b9faf6]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[330d617e-8d78-4e90-933f-3d2f342529a1]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:06:02 user nova-compute[231753]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a (non-flash)
Jul 29 14:06:02 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:06:02 user nova-compute[231753]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a (non-flash)
Jul 29 14:06:02 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "connect_to_iscsi_portal-172.16.0.220:3260-iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.274s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Connected to 172.16.0.220:3260 {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:633}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] HCTL ('34', '-', '-', 0) found on session 60 with lun 0 {{(pid=231753) get_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:694}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Scanning host 34 c: -, t: -, l: 0) {{(pid=231753) scan_iscsi /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:719}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/class/scsi_host/host34/scan {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/class/scsi_host/host34/scan" returned: 0 in 0.016s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c59c7a5-82c9-4396-a255-99b401be6bee]: (4, ('- - 0', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Searching for a device in session 60 and hctl ['34', '*', '*', 0] yield: sdc {{(pid=231753) device_name_by_hctl /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:713}}
Jul 29 14:06:02 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Connected to sdc using {'target_iqn': 'iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PyYwGKtT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False} {{(pid=231753) _connect_vol /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:661}}
Jul 29 14:06:03 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 1.306s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:06:03 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] <== connect_volume: return (1308ms) {'type': 'block', 'scsi_wwn': '23030613763666661', 'path': '/dev/sdc'} {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:06:03 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '23030613763666661', 'path': '/dev/sdc'} {{(pid=231753) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}}
Jul 29 14:06:03 user nova-compute[231753]: DEBUG nova.objects.instance [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lazy-loading 'flavor' on Instance uuid 441fd0df-b5a0-498f-8d02-eb1db2f45b4c {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:06:03 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] attach device xml: <disk type="block" device="disk">
Jul 29 14:06:03 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:06:03 user nova-compute[231753]:   <source dev="/dev/sdc"/>
Jul 29 14:06:03 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:06:03 user nova-compute[231753]:   <serial>f129dd50-380f-4756-9d5c-96ed1c8ccb3a</serial>
Jul 29 14:06:03 user nova-compute[231753]: </disk>
Jul 29 14:06:03 user nova-compute[231753]:  {{(pid=231753) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:339}}
Jul 29 14:06:04 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] No BDM found with device name vda, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:06:04 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] No BDM found with device name vdb, not building metadata. {{(pid=231753) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12092}}
Jul 29 14:06:04 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] No VIF found with MAC fa:16:3e:8a:ab:14, not building metadata {{(pid=231753) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:12068}}
Jul 29 14:06:04 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d55534d4-2c33-4b2c-b648-e936018bb329 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" "released" by "nova.compute.manager.ComputeManager.attach_volume.<locals>.do_attach_volume" :: held 9.232s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:06:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:06:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:06:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=231753) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 14:06:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 14:06:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 14:06:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:06:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2e24d5df-4315-42b2-923c-1631519f189d tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Acquiring lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:06:06 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2e24d5df-4315-42b2-923c-1631519f189d tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" acquired by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:06:06 user nova-compute[231753]: INFO nova.compute.manager [None req-2e24d5df-4315-42b2-923c-1631519f189d tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Detaching volume f129dd50-380f-4756-9d5c-96ed1c8ccb3a
Jul 29 14:06:06 user nova-compute[231753]: INFO nova.virt.block_device [None req-2e24d5df-4315-42b2-923c-1631519f189d tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Attempting to driver detach volume f129dd50-380f-4756-9d5c-96ed1c8ccb3a from mountpoint /dev/vdb
Jul 29 14:06:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2e24d5df-4315-42b2-923c-1631519f189d tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Attempting to detach device vdb from instance 441fd0df-b5a0-498f-8d02-eb1db2f45b4c from the persistent domain config. {{(pid=231753) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2477}}
Jul 29 14:06:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-2e24d5df-4315-42b2-923c-1631519f189d tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:06:06 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:06:06 user nova-compute[231753]:   <source dev="/dev/sdc"/>
Jul 29 14:06:06 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:06:06 user nova-compute[231753]:   <serial>f129dd50-380f-4756-9d5c-96ed1c8ccb3a</serial>
Jul 29 14:06:06 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 14:06:06 user nova-compute[231753]: </disk>
Jul 29 14:06:06 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:06:06 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-2e24d5df-4315-42b2-923c-1631519f189d tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Successfully detached device vdb from instance 441fd0df-b5a0-498f-8d02-eb1db2f45b4c from the persistent domain config.
Jul 29 14:06:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2e24d5df-4315-42b2-923c-1631519f189d tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] (1/8): Attempting to detach device vdb with device alias virtio-disk1 from instance 441fd0df-b5a0-498f-8d02-eb1db2f45b4c from the live domain config. {{(pid=231753) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2513}}
Jul 29 14:06:06 user nova-compute[231753]: DEBUG nova.virt.libvirt.guest [None req-2e24d5df-4315-42b2-923c-1631519f189d tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] detach device xml: <disk type="block" device="disk">
Jul 29 14:06:06 user nova-compute[231753]:   <driver name="qemu" type="raw" cache="none" io="native"/>
Jul 29 14:06:06 user nova-compute[231753]:   <source dev="/dev/sdc"/>
Jul 29 14:06:06 user nova-compute[231753]:   <target dev="vdb" bus="virtio"/>
Jul 29 14:06:06 user nova-compute[231753]:   <serial>f129dd50-380f-4756-9d5c-96ed1c8ccb3a</serial>
Jul 29 14:06:06 user nova-compute[231753]:   <address type="pci" domain="0x0000" bus="0x00" slot="0x07" function="0x0"/>
Jul 29 14:06:06 user nova-compute[231753]: </disk>
Jul 29 14:06:06 user nova-compute[231753]:  {{(pid=231753) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:465}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-339a8281-4710-4a36-8b6f-09377d8dab58 None None] Received event <DeviceRemovedEvent: 1690639567.0369325, 441fd0df-b5a0-498f-8d02-eb1db2f45b4c => virtio-disk1> from libvirt while the driver is waiting for it; dispatched. {{(pid=231753) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2360}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG nova.virt.libvirt.driver [None req-2e24d5df-4315-42b2-923c-1631519f189d tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Start waiting for the detach event from libvirt for device vdb with device alias virtio-disk1 for instance 441fd0df-b5a0-498f-8d02-eb1db2f45b4c {{(pid=231753) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2589}}
Jul 29 14:06:07 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-2e24d5df-4315-42b2-923c-1631519f189d tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Successfully detached device vdb from instance 441fd0df-b5a0-498f-8d02-eb1db2f45b4c from the live domain config.
Jul 29 14:06:07 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e24d5df-4315-42b2-923c-1631519f189d tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e24d5df-4315-42b2-923c-1631519f189d tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'PyYwGKtT', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdc'}, None), 'kwargs': False}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:06:07 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-2e24d5df-4315-42b2-923c-1631519f189d tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:06:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-2e24d5df-4315-42b2-923c-1631519f189d tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-2e24d5df-4315-42b2-923c-1631519f189d tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0358f5a-2028-4200-af7a-238b53848983]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nTarget: iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e24d5df-4315-42b2-923c-1631519f189d tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 14:06:07 user nova-compute[231753]: No targets found.
Jul 29 14:06:07 user nova-compute[231753]: iSNS:
Jul 29 14:06:07 user nova-compute[231753]: No targets found.
Jul 29 14:06:07 user nova-compute[231753]: STATIC:
Jul 29 14:06:07 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26
Jul 29 14:06:07 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 14:06:07 user nova-compute[231753]:                 Iface Name: default
Jul 29 14:06:07 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a
Jul 29 14:06:07 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 14:06:07 user nova-compute[231753]:                 Iface Name: default
Jul 29 14:06:07 user nova-compute[231753]: FIRMWARE:
Jul 29 14:06:07 user nova-compute[231753]: No targets found.
Jul 29 14:06:07 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e24d5df-4315-42b2-923c-1631519f189d tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 14:06:07 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 14:06:07 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e24d5df-4315-42b2-923c-1631519f189d tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.019s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[10ebb436-ae9f-4dee-943d-d360adafc579]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26\n172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[363194f0-c554-49b1-a5f0-2abeb45670c9]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)\ntcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e24d5df-4315-42b2-923c-1631519f189d tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:06:07 user nova-compute[231753]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a (non-flash)
Jul 29 14:06:07 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e24d5df-4315-42b2-923c-1631519f189d tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:06:07 user nova-compute[231753]: tcp: [60] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a (non-flash)
Jul 29 14:06:07 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e24d5df-4315-42b2-923c-1631519f189d tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c802db370>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a'): ({'sdc'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-2e24d5df-4315-42b2-923c-1631519f189d tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Removing single pathed devices sdc {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f27da60-91ea-4542-8eae-c1069980a4e9]: (4, ('path checker states:\nup                  2\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdc {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdc" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[e86a5077-1917-4fb8-a7be-3baf30554241]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-2e24d5df-4315-42b2-923c-1631519f189d tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Flushing IO for device /dev/sdc {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdc {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdc" returned: 0 in 0.013s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a2f611-f3bb-4f49-9c28-ed52923469e9]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-2e24d5df-4315-42b2-923c-1631519f189d tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Remove SCSI device /dev/sdc with /sys/block/sdc/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdc/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdc/device/delete" returned: 0 in 0.050s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5737ce8-f32e-4a0f-9be4-ee32ade9957e]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-2e24d5df-4315-42b2-923c-1631519f189d tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Checking to see if SCSI volumes sdc have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-2e24d5df-4315-42b2-923c-1631519f189d tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] SCSI volumes sdc have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e24d5df-4315-42b2-923c-1631519f189d tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.030s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5ac0eb-2a13-4c33-b687-7b8d42137f41]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e24d5df-4315-42b2-923c-1631519f189d tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a -p 172.16.0.220:3260 --logout" returned: 0 in 0.066s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[80460d2f-a127-4850-a4e7-bb34a12fedb8]: (4, ('Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a, portal: 172.16.0.220,3260]\nLogout of [sid: 60, target: iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e24d5df-4315-42b2-923c-1631519f189d tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 60, target: iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a, portal: 172.16.0.220,3260]
Jul 29 14:06:07 user nova-compute[231753]: Logout of [sid: 60, target: iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a, portal: 172.16.0.220,3260] successful.
Jul 29 14:06:07 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:f129dd50-380f-4756-9d5c-96ed1c8ccb3a -p 172.16.0.220:3260 --op delete" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[08205ef1-289a-46dc-89c9-b2f0a7cd7adc]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e24d5df-4315-42b2-923c-1631519f189d tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-2e24d5df-4315-42b2-923c-1631519f189d tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.322s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-2e24d5df-4315-42b2-923c-1631519f189d tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] <== disconnect_volume: return (324ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:06:07 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2e24d5df-4315-42b2-923c-1631519f189d tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:06:08 user nova-compute[231753]: DEBUG nova.objects.instance [None req-2e24d5df-4315-42b2-923c-1631519f189d tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lazy-loading 'flavor' on Instance uuid 441fd0df-b5a0-498f-8d02-eb1db2f45b4c {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:06:08 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-2e24d5df-4315-42b2-923c-1631519f189d tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" "released" by "nova.compute.manager.ComputeManager.detach_volume.<locals>.do_detach_volume" :: held 1.649s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:06:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:06:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:06:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:06:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:06:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=231753) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 14:06:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 14:06:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 14:06:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:06:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:06:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:06:25 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:06:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:06:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "6bc5023f-6d34-4edc-b189-47d40e58122f" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:06:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "6bc5023f-6d34-4edc-b189-47d40e58122f" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:06:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "6bc5023f-6d34-4edc-b189-47d40e58122f-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:06:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "6bc5023f-6d34-4edc-b189-47d40e58122f-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:06:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "6bc5023f-6d34-4edc-b189-47d40e58122f-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:06:30 user nova-compute[231753]: INFO nova.compute.manager [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Terminating instance
Jul 29 14:06:30 user nova-compute[231753]: DEBUG nova.compute.manager [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 14:06:30 user nova-compute[231753]: DEBUG nova.compute.manager [req-4ef2bd52-9696-43bc-92f9-3db5e7ac23db req-948ae120-1da9-4d33-940e-a7bd3e74d572 service nova] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Received event network-changed-d3fc41a6-4687-4c01-b262-4c09c02345ff {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:06:30 user nova-compute[231753]: DEBUG nova.compute.manager [req-4ef2bd52-9696-43bc-92f9-3db5e7ac23db req-948ae120-1da9-4d33-940e-a7bd3e74d572 service nova] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Refreshing instance network info cache due to event network-changed-d3fc41a6-4687-4c01-b262-4c09c02345ff. {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11037}}
Jul 29 14:06:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4ef2bd52-9696-43bc-92f9-3db5e7ac23db req-948ae120-1da9-4d33-940e-a7bd3e74d572 service nova] Acquiring lock "refresh_cache-6bc5023f-6d34-4edc-b189-47d40e58122f" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:312}}
Jul 29 14:06:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4ef2bd52-9696-43bc-92f9-3db5e7ac23db req-948ae120-1da9-4d33-940e-a7bd3e74d572 service nova] Acquired lock "refresh_cache-6bc5023f-6d34-4edc-b189-47d40e58122f" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:315}}
Jul 29 14:06:30 user nova-compute[231753]: DEBUG nova.network.neutron [req-4ef2bd52-9696-43bc-92f9-3db5e7ac23db req-948ae120-1da9-4d33-940e-a7bd3e74d572 service nova] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Refreshing network info cache for port d3fc41a6-4687-4c01-b262-4c09c02345ff {{(pid=231753) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:1999}}
Jul 29 14:06:30 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:06:30 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:06:30 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:06:30 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:06:30 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Instance destroyed successfully.
Jul 29 14:06:30 user nova-compute[231753]: DEBUG nova.objects.instance [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lazy-loading 'resources' on Instance uuid 6bc5023f-6d34-4edc-b189-47d40e58122f {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:06:30 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:01:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-TestVolumeBootPattern-server-478082754',display_name='tempest-TestVolumeBootPattern-server-478082754',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-testvolumebootpattern-server-478082754',id=49,image_ref='',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNtoigQ7m5duqzfsiAOyArrbvva1hS5wetlA/wlY5VxGp3gb7rI+IjO+yTaKkT8nB18YhdDg3ru+M38WK4CdhiGgmsEXaLAhkk+kUuZmxu7gpTgpEVOFzr1YWb8fNF9FBQ==',key_name='tempest-TestVolumeBootPattern-1166783581',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:01:40Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='f45c92d3fe964066b9be87489b2c9f7e',ramdisk_id='',reservation_id='r-zgkwws2p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestVolumeBootPattern-434673895',owner_user_name='tempest-TestVolumeBootPattern-434673895-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:01:41Z,user_data=None,user_id='d94a7ea0c19845b886e12c1689cf30a8',uuid=6bc5023f-6d34-4edc-b189-47d40e58122f,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d3fc41a6-4687-4c01-b262-4c09c02345ff", "address": "fa:16:3e:b1:c8:f9", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3fc41a6-46", "ovs_interfaceid": "d3fc41a6-4687-4c01-b262-4c09c02345ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:06:30 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Converting VIF {"id": "d3fc41a6-4687-4c01-b262-4c09c02345ff", "address": "fa:16:3e:b1:c8:f9", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.243", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3fc41a6-46", "ovs_interfaceid": "d3fc41a6-4687-4c01-b262-4c09c02345ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:06:30 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:b1:c8:f9,bridge_name='br-int',has_traffic_filtering=True,id=d3fc41a6-4687-4c01-b262-4c09c02345ff,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3fc41a6-46') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:06:30 user nova-compute[231753]: DEBUG os_vif [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:c8:f9,bridge_name='br-int',has_traffic_filtering=True,id=d3fc41a6-4687-4c01-b262-4c09c02345ff,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3fc41a6-46') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG nova.compute.manager [req-8c8c63aa-6cd5-411c-88d9-2167bbf723b4 req-f513d538-5891-472c-a0ba-58a42c3da0e2 service nova] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Received event network-vif-unplugged-d3fc41a6-4687-4c01-b262-4c09c02345ff {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8c8c63aa-6cd5-411c-88d9-2167bbf723b4 req-f513d538-5891-472c-a0ba-58a42c3da0e2 service nova] Acquiring lock "6bc5023f-6d34-4edc-b189-47d40e58122f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8c8c63aa-6cd5-411c-88d9-2167bbf723b4 req-f513d538-5891-472c-a0ba-58a42c3da0e2 service nova] Lock "6bc5023f-6d34-4edc-b189-47d40e58122f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8c8c63aa-6cd5-411c-88d9-2167bbf723b4 req-f513d538-5891-472c-a0ba-58a42c3da0e2 service nova] Lock "6bc5023f-6d34-4edc-b189-47d40e58122f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG nova.compute.manager [req-8c8c63aa-6cd5-411c-88d9-2167bbf723b4 req-f513d538-5891-472c-a0ba-58a42c3da0e2 service nova] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] No waiting events found dispatching network-vif-unplugged-d3fc41a6-4687-4c01-b262-4c09c02345ff {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG nova.compute.manager [req-8c8c63aa-6cd5-411c-88d9-2167bbf723b4 req-f513d538-5891-472c-a0ba-58a42c3da0e2 service nova] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Received event network-vif-unplugged-d3fc41a6-4687-4c01-b262-4c09c02345ff for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapd3fc41a6-46, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:06:31 user nova-compute[231753]: INFO os_vif [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:b1:c8:f9,bridge_name='br-int',has_traffic_filtering=True,id=d3fc41a6-4687-4c01-b262-4c09c02345ff,network=Network(6f6ddf4e-65f7-4791-a403-40a32e5808ed),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd3fc41a6-46')
Jul 29 14:06:31 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] calling os-brick to detach iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:72}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] ==> disconnect_volume: call "{'args': (<os_brick.initiator.connectors.iscsi.ISCSIConnector object at 0x7f7c983033a0>, {'target_iqn': 'iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26', 'target_portal': '172.16.0.220:3260', 'target_discovered': False, 'auth_method': 'CHAP', 'auth_username': 'wGMAFhqZ', 'auth_password': '***', 'target_lun': 0, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'device_path': '/dev/sdb'}, None), 'kwargs': True}}" {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:175}}
Jul 29 14:06:31 user nova-compute[231753]: WARNING os_brick.initiator.connectors.base [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Service needs to call os_brick.setup() before connecting volumes, if it doesn't it will break on the next release
Jul 29 14:06:31 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:68}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:73}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m discoverydb -o show -P 1 {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m discoverydb -o show -P 1" returned: 0 in 0.021s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d6c8fdc-866d-4614-b833-297361932b0b]: (4, ('SENDTARGETS:\nNo targets found.\niSNS:\nNo targets found.\nSTATIC:\nTarget: iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26\n\tPortal: 172.16.0.220:3260,-1\n\t\tIface Name: default\nFIRMWARE:\nNo targets found.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ['-m', 'discoverydb', '-o', 'show', '-P', 1]: stdout=SENDTARGETS:
Jul 29 14:06:31 user nova-compute[231753]: No targets found.
Jul 29 14:06:31 user nova-compute[231753]: iSNS:
Jul 29 14:06:31 user nova-compute[231753]: No targets found.
Jul 29 14:06:31 user nova-compute[231753]: STATIC:
Jul 29 14:06:31 user nova-compute[231753]: Target: iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26
Jul 29 14:06:31 user nova-compute[231753]:         Portal: 172.16.0.220:3260,-1
Jul 29 14:06:31 user nova-compute[231753]:                 Iface Name: default
Jul 29 14:06:31 user nova-compute[231753]: FIRMWARE:
Jul 29 14:06:31 user nova-compute[231753]: No targets found.
Jul 29 14:06:31 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Regex to get portals from discoverydb: ^SENDTARGETS:
Jul 29 14:06:31 user nova-compute[231753]: .*?^DiscoveryAddress: 172.16.0.220,3260.*?
Jul 29 14:06:31 user nova-compute[231753]: (.*?)^(?:DiscoveryAddress|iSNS):.* {{(pid=231753) _get_discoverydb_portals /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:371}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Getting connected devices for (ips,iqns,luns)=[('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26', 0)] {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:819}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node" returned: 0 in 0.017s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[213f07e9-6931-43c0-8185-499f3d302575]: (4, ('172.16.0.220:3260,4294967295 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m session {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m session" returned: 0 in 0.026s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[35fe363c-d741-425d-a5a0-f157a7c99fdf]: (4, ('tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:06:31 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm_bare /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1182}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsi session list stdout=tcp: [53] 172.16.0.220:3260,1 iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 (non-flash)
Jul 29 14:06:31 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsi_session /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1171}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Resulting device map defaultdict(<function ISCSIConnector._get_connection_devices.<locals>.<lambda> at 0x7f7c9828eb00>, {('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26'): ({'sdb'}, set())}) {{(pid=231753) _get_connection_devices /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:852}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Removing single pathed devices sdb {{(pid=231753) remove_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:309}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd show status {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd show status" returned: 0 in 0.023s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[57006b3a-03f1-4cbb-9b2e-4c25629c3639]: (4, ('path checker states:\nup                  1\n\npaths: 0\nbusy: False\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): multipathd del path /dev/sdb {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "multipathd del path /dev/sdb" returned: 0 in 0.020s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[486da57d-cc9c-46f1-8e1e-ef89502ea70b]: (4, ('ok\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Flushing IO for device /dev/sdb {{(pid=231753) flush_device_io /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:369}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): blockdev --flushbufs /dev/sdb {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "blockdev --flushbufs /dev/sdb" returned: 0 in 0.013s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0209949-c00d-4420-82b0-d521b10c6b74]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Remove SCSI device /dev/sdb with /sys/block/sdb/device/delete {{(pid=231753) remove_scsi_device /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:83}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): tee -a /sys/block/sdb/device/delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "tee -a /sys/block/sdb/device/delete" returned: 0 in 0.057s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb6fe445-5aad-4c34-98ff-43eecc780785]: (4, ('1', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Checking to see if SCSI volumes sdb have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:91}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG os_brick.initiator.linuxscsi [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] SCSI volumes sdb have been removed. {{(pid=231753) wait_for_volumes_removal /usr/local/lib/python3.10/dist-packages/os_brick/initiator/linuxscsi.py:101}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Disconnecting from: [('172.16.0.220:3260', 'iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26')] {{(pid=231753) _disconnect_connection /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1160}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --op update -n node.startup -v manual {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --op update -n node.startup -v manual" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[14aa5ecd-eb8a-4ddf-a538-dae304854d05]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --logout {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --logout" returned: 0 in 0.061s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b8974d7-2150-4a72-979e-3cc655674491]: (4, ('Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26, portal: 172.16.0.220,3260]\nLogout of [sid: 53, target: iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26, portal: 172.16.0.220,3260] successful.\n', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 53, target: iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26, portal: 172.16.0.220,3260]
Jul 29 14:06:31 user nova-compute[231753]: Logout of [sid: 53, target: iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26, portal: 172.16.0.220,3260] successful.
Jul 29 14:06:31 user nova-compute[231753]:  stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --op delete {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [-] CMD "iscsiadm -m node -T iqn.2010-10.org.openstack:cdbefe05-ad5a-4372-8011-5253b3627f26 -p 172.16.0.220:3260 --op delete" returned: 0 in 0.018s {{(pid=242780) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9d4d5be-3a05-4396-ae18-81d43ae37a44]: (4, ('', '')) {{(pid=242780) _call_back /usr/local/lib/python3.10/dist-packages/oslo_privsep/daemon.py:501}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=231753) _run_iscsiadm /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/iscsi.py:1026}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.base [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.313s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/os_brick/initiator/connectors/base.py:87}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG os_brick.initiator.connectors.iscsi [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] <== disconnect_volume: return (314ms) None {{(pid=231753) trace_logging_wrapper /usr/local/lib/python3.10/dist-packages/os_brick/utils.py:202}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Disconnected iSCSI Volume {{(pid=231753) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:79}}
Jul 29 14:06:31 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Deleting instance files /opt/stack/data/nova/instances/6bc5023f-6d34-4edc-b189-47d40e58122f_del
Jul 29 14:06:31 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Deletion of /opt/stack/data/nova/instances/6bc5023f-6d34-4edc-b189-47d40e58122f_del complete
Jul 29 14:06:31 user nova-compute[231753]: DEBUG nova.network.neutron [req-4ef2bd52-9696-43bc-92f9-3db5e7ac23db req-948ae120-1da9-4d33-940e-a7bd3e74d572 service nova] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Updated VIF entry in instance network info cache for port d3fc41a6-4687-4c01-b262-4c09c02345ff. {{(pid=231753) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3474}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG nova.network.neutron [req-4ef2bd52-9696-43bc-92f9-3db5e7ac23db req-948ae120-1da9-4d33-940e-a7bd3e74d572 service nova] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Updating instance_info_cache with network_info: [{"id": "d3fc41a6-4687-4c01-b262-4c09c02345ff", "address": "fa:16:3e:b1:c8:f9", "network": {"id": "6f6ddf4e-65f7-4791-a403-40a32e5808ed", "bridge": "br-int", "label": "tempest-TestVolumeBootPattern-1217469920-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "f45c92d3fe964066b9be87489b2c9f7e", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tapd3fc41a6-46", "ovs_interfaceid": "d3fc41a6-4687-4c01-b262-4c09c02345ff", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-4ef2bd52-9696-43bc-92f9-3db5e7ac23db req-948ae120-1da9-4d33-940e-a7bd3e74d572 service nova] Releasing lock "refresh_cache-6bc5023f-6d34-4edc-b189-47d40e58122f" {{(pid=231753) lock /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:333}}
Jul 29 14:06:31 user nova-compute[231753]: INFO nova.compute.manager [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Took 1.16 seconds to destroy the instance on the hypervisor.
Jul 29 14:06:31 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 14:06:31 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:06:31 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Took 0.49 seconds to deallocate network for instance.
Jul 29 14:06:32 user nova-compute[231753]: INFO nova.compute.manager [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Took 0.69 seconds to detach 1 volumes for instance.
Jul 29 14:06:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:06:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:06:32 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:06:32 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:06:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.148s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:06:32 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Deleted allocations for instance 6bc5023f-6d34-4edc-b189-47d40e58122f
Jul 29 14:06:32 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-ff2fe209-b91e-42d9-b975-0e9597e09471 tempest-TestVolumeBootPattern-434673895 tempest-TestVolumeBootPattern-434673895-project-member] Lock "6bc5023f-6d34-4edc-b189-47d40e58122f" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.672s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:06:33 user nova-compute[231753]: DEBUG nova.compute.manager [req-8e24996d-fbeb-4959-ac23-9e508b404e27 req-af4b1b27-cc5e-484f-bfec-e944a68d2933 service nova] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Received event network-vif-plugged-d3fc41a6-4687-4c01-b262-4c09c02345ff {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:06:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8e24996d-fbeb-4959-ac23-9e508b404e27 req-af4b1b27-cc5e-484f-bfec-e944a68d2933 service nova] Acquiring lock "6bc5023f-6d34-4edc-b189-47d40e58122f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:06:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8e24996d-fbeb-4959-ac23-9e508b404e27 req-af4b1b27-cc5e-484f-bfec-e944a68d2933 service nova] Lock "6bc5023f-6d34-4edc-b189-47d40e58122f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:06:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-8e24996d-fbeb-4959-ac23-9e508b404e27 req-af4b1b27-cc5e-484f-bfec-e944a68d2933 service nova] Lock "6bc5023f-6d34-4edc-b189-47d40e58122f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:06:33 user nova-compute[231753]: DEBUG nova.compute.manager [req-8e24996d-fbeb-4959-ac23-9e508b404e27 req-af4b1b27-cc5e-484f-bfec-e944a68d2933 service nova] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] No waiting events found dispatching network-vif-plugged-d3fc41a6-4687-4c01-b262-4c09c02345ff {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:06:33 user nova-compute[231753]: WARNING nova.compute.manager [req-8e24996d-fbeb-4959-ac23-9e508b404e27 req-af4b1b27-cc5e-484f-bfec-e944a68d2933 service nova] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Received unexpected event network-vif-plugged-d3fc41a6-4687-4c01-b262-4c09c02345ff for instance with vm_state deleted and task_state None.
Jul 29 14:06:33 user nova-compute[231753]: DEBUG nova.compute.manager [req-8e24996d-fbeb-4959-ac23-9e508b404e27 req-af4b1b27-cc5e-484f-bfec-e944a68d2933 service nova] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Received event network-vif-deleted-d3fc41a6-4687-4c01-b262-4c09c02345ff {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:06:33 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:06:33 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:06:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:06:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:06:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:06:33 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 14:06:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:06:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk --force-share --output=json" returned: 0 in 0.150s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:06:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running cmd (subprocess): /usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk --force-share --output=json {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:384}}
Jul 29 14:06:33 user nova-compute[231753]: DEBUG oslo_concurrency.processutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CMD "/usr/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c/disk --force-share --output=json" returned: 0 in 0.132s {{(pid=231753) execute /usr/local/lib/python3.10/dist-packages/oslo_concurrency/processutils.py:422}}
Jul 29 14:06:34 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:06:34 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:06:34 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=8585MB free_disk=25.082138061523438GB free_vcpus=11 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 14:06:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:06:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:06:34 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Instance 441fd0df-b5a0-498f-8d02-eb1db2f45b4c actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 512, 'VCPU': 1}}. {{(pid=231753) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1704}}
Jul 29 14:06:34 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 1 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 14:06:34 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=1024MB phys_disk=40GB used_disk=1GB total_vcpus=12 used_vcpus=1 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 14:06:34 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:06:34 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:06:34 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 14:06:34 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.184s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:06:36 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:06:36 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:06:36 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:06:36 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 14:06:36 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Didn't find any instances for network info cache update. {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 29 14:06:36 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:06:36 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:06:36 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 14:06:37 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:06:39 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:06:41 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:06:45 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690639590.9777472, 6bc5023f-6d34-4edc-b189-47d40e58122f => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:06:45 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] VM Stopped (Lifecycle Event)
Jul 29 14:06:46 user nova-compute[231753]: DEBUG nova.compute.manager [None req-6649265a-55f0-42f8-979a-e1866fdd95b4 None None] [instance: 6bc5023f-6d34-4edc-b189-47d40e58122f] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:06:46 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:06:51 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:06:56 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:07:01 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:07:01 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:07:01 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=231753) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 14:07:01 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 14:07:01 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 14:07:01 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:07:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:07:06 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:07:11 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:07:16 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:07:21 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:07:26 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:07:26 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:07:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d2d7adcf-7b9c-4b0f-883d-7659da168856 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Acquiring lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:07:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d2d7adcf-7b9c-4b0f-883d-7659da168856 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" acquired by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:07:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d2d7adcf-7b9c-4b0f-883d-7659da168856 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Acquiring lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:07:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d2d7adcf-7b9c-4b0f-883d-7659da168856 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:07:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d2d7adcf-7b9c-4b0f-883d-7659da168856 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.<locals>._clear_events" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:07:28 user nova-compute[231753]: INFO nova.compute.manager [None req-d2d7adcf-7b9c-4b0f-883d-7659da168856 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Terminating instance
Jul 29 14:07:28 user nova-compute[231753]: DEBUG nova.compute.manager [None req-d2d7adcf-7b9c-4b0f-883d-7659da168856 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Start destroying the instance on the hypervisor. {{(pid=231753) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3124}}
Jul 29 14:07:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:07:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:07:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:07:28 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:07:28 user nova-compute[231753]: DEBUG nova.compute.manager [req-c9ef88ec-6b15-46a6-bf65-b04e668b3670 req-cd3a478a-2d58-431e-8e00-4d10e7bcbe3d service nova] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Received event network-vif-unplugged-e65ce885-2848-4c59-b069-2d3fffab8131 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:07:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c9ef88ec-6b15-46a6-bf65-b04e668b3670 req-cd3a478a-2d58-431e-8e00-4d10e7bcbe3d service nova] Acquiring lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:07:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c9ef88ec-6b15-46a6-bf65-b04e668b3670 req-cd3a478a-2d58-431e-8e00-4d10e7bcbe3d service nova] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:07:28 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-c9ef88ec-6b15-46a6-bf65-b04e668b3670 req-cd3a478a-2d58-431e-8e00-4d10e7bcbe3d service nova] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:07:28 user nova-compute[231753]: DEBUG nova.compute.manager [req-c9ef88ec-6b15-46a6-bf65-b04e668b3670 req-cd3a478a-2d58-431e-8e00-4d10e7bcbe3d service nova] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] No waiting events found dispatching network-vif-unplugged-e65ce885-2848-4c59-b069-2d3fffab8131 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:07:28 user nova-compute[231753]: DEBUG nova.compute.manager [req-c9ef88ec-6b15-46a6-bf65-b04e668b3670 req-cd3a478a-2d58-431e-8e00-4d10e7bcbe3d service nova] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Received event network-vif-unplugged-e65ce885-2848-4c59-b069-2d3fffab8131 for instance with task_state deleting. {{(pid=231753) _process_instance_event /opt/stack/nova/nova/compute/manager.py:10810}}
Jul 29 14:07:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:07:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:07:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:07:29 user nova-compute[231753]: INFO nova.virt.libvirt.driver [-] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Instance destroyed successfully.
Jul 29 14:07:29 user nova-compute[231753]: DEBUG nova.objects.instance [None req-d2d7adcf-7b9c-4b0f-883d-7659da168856 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lazy-loading 'resources' on Instance uuid 441fd0df-b5a0-498f-8d02-eb1db2f45b4c {{(pid=231753) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1139}}
Jul 29 14:07:29 user nova-compute[231753]: DEBUG nova.virt.libvirt.vif [None req-d2d7adcf-7b9c-4b0f-883d-7659da168856 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2023-07-29T14:00:17Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=<?>,disable_terminate=False,display_description='tempest-SnapshotDataIntegrityTests-server-85259245',display_name='tempest-SnapshotDataIntegrityTests-server-85259245',ec2_ids=<?>,ephemeral_gb=0,ephemeral_key_uuid=None,fault=<?>,flavor=Flavor(6),hidden=False,host='user',hostname='tempest-snapshotdataintegritytests-server-85259245',id=47,image_ref='e16ae177-482e-47d8-a71b-737a50412c32',info_cache=InstanceInfoCache,instance_type_id=6,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBI6esz6S9abxI5rgKmwF/BDFhehRMXLrLc+7SStVHQeajZfoIXuWLPSNKYmH3peINRO44ZM78Au8AOSE2ojF+1oz/3Dw7M5GyRNH2nw7cnlN40dhnyCd8wIvRG+T92CXgg==',key_name='tempest-keypair-470384698',keypairs=<?>,launch_index=0,launched_at=2023-07-29T14:00:23Z,launched_on='user',locked=False,locked_by=None,memory_mb=512,metadata={},migration_context=<?>,new_flavor=None,node='user',numa_topology=None,old_flavor=None,os_type=None,pci_devices=<?>,pci_requests=<?>,power_state=1,progress=0,project_id='4c63557bedc94739802fe008139488ba',ramdisk_id='',reservation_id='r-qeo48rej',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=<?>,shutdown_terminate=False,system_metadata={boot_roles='member,reader',image_base_image_ref='e16ae177-482e-47d8-a71b-737a50412c32',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.2-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-SnapshotDataIntegrityTests-327483512',owner_user_name='tempest-SnapshotDataIntegrityTests-327483512-project-member'},tags=<?>,task_state='deleting',terminated_at=None,trusted_certs=<?>,updated_at=2023-07-29T14:00:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='712c035f5bd24704be4a428557fe3694',uuid=441fd0df-b5a0-498f-8d02-eb1db2f45b4c,vcpu_model=<?>,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "e65ce885-2848-4c59-b069-2d3fffab8131", "address": "fa:16:3e:8a:ab:14", "network": {"id": "e850e031-78cb-4491-bc2e-1558870dee53", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1563208818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c63557bedc94739802fe008139488ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65ce885-28", "ovs_interfaceid": "e65ce885-2848-4c59-b069-2d3fffab8131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:828}}
Jul 29 14:07:29 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d2d7adcf-7b9c-4b0f-883d-7659da168856 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Converting VIF {"id": "e65ce885-2848-4c59-b069-2d3fffab8131", "address": "fa:16:3e:8a:ab:14", "network": {"id": "e850e031-78cb-4491-bc2e-1558870dee53", "bridge": "br-int", "label": "tempest-SnapshotDataIntegrityTests-1563208818-network", "subnets": [{"cidr": "10.0.0.0/28", "dns": [], "gateway": {"address": "10.0.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.0.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.4.151", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"dhcp_server": "10.0.0.1"}}], "meta": {"injected": false, "tenant_id": "4c63557bedc94739802fe008139488ba", "mtu": 1442, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "bound_drivers": {"0": "ovn"}}, "devname": "tape65ce885-28", "ovs_interfaceid": "e65ce885-2848-4c59-b069-2d3fffab8131", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}}
Jul 29 14:07:29 user nova-compute[231753]: DEBUG nova.network.os_vif_util [None req-d2d7adcf-7b9c-4b0f-883d-7659da168856 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:8a:ab:14,bridge_name='br-int',has_traffic_filtering=True,id=e65ce885-2848-4c59-b069-2d3fffab8131,network=Network(e850e031-78cb-4491-bc2e-1558870dee53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape65ce885-28') {{(pid=231753) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:548}}
Jul 29 14:07:29 user nova-compute[231753]: DEBUG os_vif [None req-d2d7adcf-7b9c-4b0f-883d-7659da168856 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:ab:14,bridge_name='br-int',has_traffic_filtering=True,id=e65ce885-2848-4c59-b069-2d3fffab8131,network=Network(e850e031-78cb-4491-bc2e-1558870dee53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape65ce885-28') {{(pid=231753) unplug /usr/local/lib/python3.10/dist-packages/os_vif/__init__.py:109}}
Jul 29 14:07:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 23 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:07:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tape65ce885-28, bridge=br-int, if_exists=True) {{(pid=231753) do_commit /usr/local/lib/python3.10/dist-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}}
Jul 29 14:07:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:07:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:07:29 user nova-compute[231753]: INFO os_vif [None req-d2d7adcf-7b9c-4b0f-883d-7659da168856 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:8a:ab:14,bridge_name='br-int',has_traffic_filtering=True,id=e65ce885-2848-4c59-b069-2d3fffab8131,network=Network(e850e031-78cb-4491-bc2e-1558870dee53),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tape65ce885-28')
Jul 29 14:07:29 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-d2d7adcf-7b9c-4b0f-883d-7659da168856 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Deleting instance files /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c_del
Jul 29 14:07:29 user nova-compute[231753]: INFO nova.virt.libvirt.driver [None req-d2d7adcf-7b9c-4b0f-883d-7659da168856 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Deletion of /opt/stack/data/nova/instances/441fd0df-b5a0-498f-8d02-eb1db2f45b4c_del complete
Jul 29 14:07:29 user nova-compute[231753]: INFO nova.compute.manager [None req-d2d7adcf-7b9c-4b0f-883d-7659da168856 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Took 1.22 seconds to destroy the instance on the hypervisor.
Jul 29 14:07:29 user nova-compute[231753]: DEBUG oslo.service.loopingcall [None req-d2d7adcf-7b9c-4b0f-883d-7659da168856 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.<locals>._deallocate_network_with_retries to return. {{(pid=231753) func /usr/local/lib/python3.10/dist-packages/oslo_service/loopingcall.py:435}}
Jul 29 14:07:29 user nova-compute[231753]: DEBUG nova.compute.manager [-] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Deallocating network for instance {{(pid=231753) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2263}}
Jul 29 14:07:29 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] deallocate_for_instance() {{(pid=231753) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1795}}
Jul 29 14:07:30 user nova-compute[231753]: DEBUG nova.network.neutron [-] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Updating instance_info_cache with network_info: [] {{(pid=231753) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:116}}
Jul 29 14:07:30 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Took 1.05 seconds to deallocate network for instance.
Jul 29 14:07:30 user nova-compute[231753]: DEBUG nova.compute.manager [req-ff2407b8-796e-48b1-9753-0d366d7aebb2 req-e0b992a8-5fae-4ab7-a75a-0345821a1aad service nova] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Received event network-vif-deleted-e65ce885-2848-4c59-b069-2d3fffab8131 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:07:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d2d7adcf-7b9c-4b0f-883d-7659da168856 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:07:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d2d7adcf-7b9c-4b0f-883d-7659da168856 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:07:30 user nova-compute[231753]: DEBUG nova.compute.manager [req-3bbacd5d-2854-45dc-9763-f56ef89ab289 req-86aef37c-0041-4f4c-8b4f-ea29ba57818d service nova] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Received event network-vif-plugged-e65ce885-2848-4c59-b069-2d3fffab8131 {{(pid=231753) external_instance_event /opt/stack/nova/nova/compute/manager.py:11032}}
Jul 29 14:07:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3bbacd5d-2854-45dc-9763-f56ef89ab289 req-86aef37c-0041-4f4c-8b4f-ea29ba57818d service nova] Acquiring lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:07:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3bbacd5d-2854-45dc-9763-f56ef89ab289 req-86aef37c-0041-4f4c-8b4f-ea29ba57818d service nova] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:07:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [req-3bbacd5d-2854-45dc-9763-f56ef89ab289 req-86aef37c-0041-4f4c-8b4f-ea29ba57818d service nova] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.<locals>._pop_event" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:07:30 user nova-compute[231753]: DEBUG nova.compute.manager [req-3bbacd5d-2854-45dc-9763-f56ef89ab289 req-86aef37c-0041-4f4c-8b4f-ea29ba57818d service nova] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] No waiting events found dispatching network-vif-plugged-e65ce885-2848-4c59-b069-2d3fffab8131 {{(pid=231753) pop_instance_event /opt/stack/nova/nova/compute/manager.py:320}}
Jul 29 14:07:30 user nova-compute[231753]: WARNING nova.compute.manager [req-3bbacd5d-2854-45dc-9763-f56ef89ab289 req-86aef37c-0041-4f4c-8b4f-ea29ba57818d service nova] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Received unexpected event network-vif-plugged-e65ce885-2848-4c59-b069-2d3fffab8131 for instance with vm_state deleted and task_state None.
Jul 29 14:07:30 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-d2d7adcf-7b9c-4b0f-883d-7659da168856 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:07:30 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-d2d7adcf-7b9c-4b0f-883d-7659da168856 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:07:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d2d7adcf-7b9c-4b0f-883d-7659da168856 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 0.128s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:07:30 user nova-compute[231753]: INFO nova.scheduler.client.report [None req-d2d7adcf-7b9c-4b0f-883d-7659da168856 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Deleted allocations for instance 441fd0df-b5a0-498f-8d02-eb1db2f45b4c
Jul 29 14:07:30 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-d2d7adcf-7b9c-4b0f-883d-7659da168856 tempest-SnapshotDataIntegrityTests-327483512 tempest-SnapshotDataIntegrityTests-327483512-project-member] Lock "441fd0df-b5a0-498f-8d02-eb1db2f45b4c" "released" by "nova.compute.manager.ComputeManager.terminate_instance.<locals>.do_terminate_instance" :: held 2.603s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:07:32 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:07:33 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:07:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:07:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:07:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:07:33 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 14:07:33 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:07:33 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:07:33 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=8784MB free_disk=25.108131408691406GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 14:07:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:07:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:07:33 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 14:07:33 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 14:07:33 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:07:33 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:07:33 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 14:07:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.179s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:07:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:07:35 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:07:35 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:07:35 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 14:07:35 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Rebuilding the list of instances to heal {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 14:07:35 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Didn't find any instances for network info cache update. {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 29 14:07:35 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:07:36 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:07:36 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:07:36 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 14:07:37 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:07:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:07:39 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:07:41 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:07:44 user nova-compute[231753]: DEBUG nova.virt.driver [-] Emitting event <LifecycleEvent: 1690639649.2358158, 441fd0df-b5a0-498f-8d02-eb1db2f45b4c => Stopped> {{(pid=231753) emit_event /opt/stack/nova/nova/virt/driver.py:1653}}
Jul 29 14:07:44 user nova-compute[231753]: INFO nova.compute.manager [-] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] VM Stopped (Lifecycle Event)
Jul 29 14:07:44 user nova-compute[231753]: DEBUG nova.compute.manager [None req-32a8cbe0-35be-4229-8d0f-900c54cd3055 None None] [instance: 441fd0df-b5a0-498f-8d02-eb1db2f45b4c] Checking state {{(pid=231753) _get_power_state /opt/stack/nova/nova/compute/manager.py:1766}}
Jul 29 14:07:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:07:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:07:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=231753) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 14:07:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 14:07:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 14:07:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:07:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:07:54 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:07:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:07:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:07:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=231753) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 14:07:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 14:07:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 14:07:59 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:08:04 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:08:09 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:08:14 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:08:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:08:19 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:08:22 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:08:24 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:08:25 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:08:28 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:08:29 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:08:33 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager.update_available_resource {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:08:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:08:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:08:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:08:33 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Auditing locally available compute resources for user (node: user) {{(pid=231753) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:907}}
Jul 29 14:08:33 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:08:33 user nova-compute[231753]: WARNING nova.virt.libvirt.driver [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.
Jul 29 14:08:33 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Hypervisor/Node resource view: name=user free_ram=8999MB free_disk=25.10645294189453GB free_vcpus=12 pci_devices=[{"dev_id": "pci_0000_00_16_4", "address": "0000:00:16.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_0", "address": "0000:00:17.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_3", "address": "0000:00:17.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "7190", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7190", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "7191", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7191", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_4", "address": "0000:00:18.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_4", "address": "0000:00:17.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_0", "address": "0000:00:16.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_2", "address": "0000:00:16.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_3", "address": "0000:00:16.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_2", "address": "0000:00:17.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_5", "address": "0000:00:18.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_6", "address": "0000:00:17.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_10_0", "address": "0000:00:10.0", "product_id": "0030", "vendor_id": "1000", "numa_node": null, "label": "label_1000_0030", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_1", "address": "0000:00:16.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_6", "address": "0000:00:16.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_2", "address": "0000:00:15.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_3", "address": "0000:00:07.3", "product_id": "7113", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7113", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_0b_00_0", "address": "0000:0b:00.0", "product_id": "07b0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07b0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_1", "address": "0000:00:07.1", "product_id": "7111", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7111", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_6", "address": "0000:00:15.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_4", "address": "0000:00:15.4", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_0", "address": "0000:00:07.0", "product_id": "7110", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7110", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_2", "address": "0000:00:18.2", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_1", "address": "0000:00:15.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_5", "address": "0000:00:16.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_5", "address": "0000:00:17.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "07e0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07e0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_5", "address": "0000:00:15.5", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_0f_0", "address": "0000:00:0f.0", "product_id": "0405", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0405", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_16_7", "address": "0000:00:16.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_7", "address": "0000:00:15.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_1", "address": "0000:00:18.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_07_7", "address": "0000:00:07.7", "product_id": "0740", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0740", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_1", "address": "0000:00:17.1", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_7", "address": "0000:00:18.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_3", "address": "0000:00:18.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_11_0", "address": "0000:00:11.0", "product_id": "0790", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_0790", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_0", "address": "0000:00:18.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_3", "address": "0000:00:15.3", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_17_7", "address": "0000:00:17.7", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_15_0", "address": "0000:00:15.0", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_18_6", "address": "0000:00:18.6", "product_id": "07a0", "vendor_id": "15ad", "numa_node": null, "label": "label_15ad_07a0", "dev_type": "type-PCI"}] {{(pid=231753) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1106}}
Jul 29 14:08:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:404}}
Jul 29 14:08:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:409}}
Jul 29 14:08:33 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Total usable vcpus: 12, total allocated vcpus: 0 {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1129}}
Jul 29 14:08:33 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Final resource view: name=user phys_ram=16011MB used_ram=512MB phys_disk=40GB used_disk=0GB total_vcpus=12 used_vcpus=0 pci_stats=[] {{(pid=231753) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1138}}
Jul 29 14:08:33 user nova-compute[231753]: DEBUG nova.compute.provider_tree [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed in ProviderTree for provider: 222db5c7-e17f-4307-968d-4284bf5c19f4 {{(pid=231753) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}}
Jul 29 14:08:33 user nova-compute[231753]: DEBUG nova.scheduler.client.report [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Inventory has not changed for provider 222db5c7-e17f-4307-968d-4284bf5c19f4 based on inventory data: {'VCPU': {'total': 12, 'reserved': 0, 'min_unit': 1, 'max_unit': 12, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 16011, 'reserved': 512, 'min_unit': 1, 'max_unit': 16011, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 40, 'reserved': 0, 'min_unit': 1, 'max_unit': 40, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=231753) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:940}}
Jul 29 14:08:33 user nova-compute[231753]: DEBUG nova.compute.resource_tracker [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Compute_service record updated for user:user {{(pid=231753) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1067}}
Jul 29 14:08:33 user nova-compute[231753]: DEBUG oslo_concurrency.lockutils [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 0.111s {{(pid=231753) inner /usr/local/lib/python3.10/dist-packages/oslo_concurrency/lockutils.py:423}}
Jul 29 14:08:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:08:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:08:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=231753) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 14:08:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 14:08:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 14:08:34 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:08:36 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:08:37 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:08:37 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._heal_instance_info_cache {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:08:37 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Starting heal instance info cache {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9842}}
Jul 29 14:08:37 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Rebuilding the list of instances to heal {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9846}}
Jul 29 14:08:37 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Didn't find any instances for network info cache update. {{(pid=231753) _heal_instance_info_cache /opt/stack/nova/nova/compute/manager.py:9928}}
Jul 29 14:08:37 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:08:37 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:08:37 user nova-compute[231753]: DEBUG nova.compute.manager [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=231753) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:10461}}
Jul 29 14:08:39 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:08:40 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:08:41 user nova-compute[231753]: DEBUG oslo_service.periodic_task [None req-61ebe323-f8f6-4852-b8c7-7514698b172b None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=231753) run_periodic_tasks /usr/local/lib/python3.10/dist-packages/oslo_service/periodic_task.py:210}}
Jul 29 14:08:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 4999-ms timeout {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:248}}
Jul 29 14:08:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:08:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: idle 5002 ms, sending inactivity probe {{(pid=231753) run /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:117}}
Jul 29 14:08:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering IDLE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 14:08:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=231753) _transition /usr/local/lib/python3.10/dist-packages/ovs/reconnect.py:519}}
Jul 29 14:08:44 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}
Jul 29 14:08:49 user nova-compute[231753]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 25 {{(pid=231753) __log_wakeup /usr/local/lib/python3.10/dist-packages/ovs/poller.py:263}}